Jul 11 03:46:51.648282 ip-10-0-134-138 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 11 03:46:51.648294 ip-10-0-134-138 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 11 03:46:51.648300 ip-10-0-134-138 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 11 03:46:51.648519 ip-10-0-134-138 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 11 03:47:00.755669 ip-10-0-134-138 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 11 03:47:00.755683 ip-10-0-134-138 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7308a7d92cbb4acfbcd667b11505c254 --
Jul 11 03:48:51.197577 ip-10-0-134-138 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 03:48:51.621247 ip-10-0-134-138 systemd[1]: Started Kubernetes Kubelet.
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.544113    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550880    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550899    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550902    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550905    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550908    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550911    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550914    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:51.638608 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550918    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550921    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550924    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550929    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550932    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550936    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550941    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550944    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550948    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550951    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550954    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550957    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550960    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550963    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550966    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550969    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550972    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550974    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550977    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:51.640211 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550980    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550983    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550985    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550989    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550992    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550994    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550996    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.550999    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551001    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551004    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551007    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551009    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551012    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551016    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551020    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551022    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551026    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551030    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551032    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551035    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:51.641452 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551038    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551041    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551043    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551046    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551048    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551051    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551054    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551056    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551060    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551063    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551066    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551068    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551072    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551076    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551079    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551082    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551084    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551087    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551089    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:51.644151 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551092    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551096    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551098    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551101    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551103    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551106    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551108    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551111    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551114    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551117    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551119    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551123    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551127    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551131    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551133    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551136    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551139    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551141    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551144    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551147    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:51.644853 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551150    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551153    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551156    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551159    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551162    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551165    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551168    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551170    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551173    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551175    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551177    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551180    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551182    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551185    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551910    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551918    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551922    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551927    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551930    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551933    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:51.646815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551937    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551940    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551943    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551946    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551949    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551952    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551955    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551958    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551960    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551963    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551966    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551969    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551971    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551974    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551977    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551980    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551982    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551985    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551987    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551990    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:51.908799 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551992    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551995    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.551998    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552001    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552003    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552006    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552008    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552011    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552013    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552016    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552019    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552022    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552025    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552027    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552031    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552033    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552036    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552039    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552042    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552044    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:51.909707 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552047    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552049    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552052    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552055    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552058    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552060    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552063    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552067    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552071    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552074    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552078    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552080    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552083    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552086    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552088    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552091    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552095    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552097    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552100    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:51.910435 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552103    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552105    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552108    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552110    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552113    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552115    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552118    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552120    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552123    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552125    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552128    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552131    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552134    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552137    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552139    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552142    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552145    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552147    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552150    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552152    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:51.911047 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552155    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552158    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552161    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552164    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552167    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552170    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552172    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552174    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552177    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552180    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552182    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552184    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552187    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.552190    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557136    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557152    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557155    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557160    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557163    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557170    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:51.911749 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557173    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557177    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557180    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557185    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557188    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557191    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557194    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557197    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557200    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557204    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557210    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557217    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557220    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557224    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557227    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557230    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557234    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557240    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557243    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:51.912381 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557247    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557251    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557255    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557258    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557260    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557266    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557269    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557273    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557277    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557281    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557286    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557290    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557295    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557299    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557304    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557323    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557327    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557337    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557342    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557347    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:51.913099 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557351    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557356    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557360    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557369    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557391    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557501    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557509    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557513    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557518    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557522    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557526    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557531    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557535    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557539    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557546    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557550    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557555    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557559    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557563    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:51.913779 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557568    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557573    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557577    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557581    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557588    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557592    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557596    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557600    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557604    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557608    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557612    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557616    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557621    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557625    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557632    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557637    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557641    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557645    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557650    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557654    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:51.914444 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557658    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557662    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557666    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557670    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557674    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557679    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557683    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557689    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557694    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557698    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557702    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557706    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557711    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557715    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.557719    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557822    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557834    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557841    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557846    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557850    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557853    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 03:48:51.915101 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557858    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557863    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557869    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557873    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557879    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557885    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557889    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557893    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557898    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557902    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557907    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557910    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557915    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557918    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557921    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557925    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557928    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557932    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557937    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557940    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557944    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557947    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557950    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557953    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 03:48:51.915969 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557956    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557959    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557964    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557968    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557971    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557974    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557977    2580 flags.go:64] FLAG: --enable-server="true"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557980    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557986    2580 flags.go:64] FLAG: --event-burst="100"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557989    2580 flags.go:64] FLAG: --event-qps="50"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557992    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557995    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.557998    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558001    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558004    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558007    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558010    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558013    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558016    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558019    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558023    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558026    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558029    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558032    2580 flags.go:64] FLAG: --feature-gates=""
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558036    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 03:48:51.916658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558039    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558043    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558046    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558049    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558052    2580 flags.go:64] FLAG: --help="false"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558056    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-134-138.ec2.internal"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558059    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558061    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558064    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558068    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558073    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558076    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558079    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558082    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558085    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558088    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558091    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558093    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558096    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558099    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558102    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558105    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558108    2580 flags.go:64] FLAG: --lock-file=""
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558110    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 03:48:51.917496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558113    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558116    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558123    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558125    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558129    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558132    2580 flags.go:64] FLAG: --logging-format="text"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558135    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558138    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558141    2580 flags.go:64] FLAG: --manifest-url=""
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558145    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558150    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558153    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558157    2580 flags.go:64] FLAG: --max-pods="110"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558160    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558163    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558166    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558169    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558172    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558176    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558179    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558187    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558190    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558193    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 03:48:51.918184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558196    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558199    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558205    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558207    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558211    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558213    2580 flags.go:64] FLAG: --port="10250"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558216    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558219    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0888d6aa4b1afb439"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558223    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558225    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558229    2580 flags.go:64] FLAG: --register-node="true"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558232    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558236    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558239    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558242    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558245    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558249    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558252    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558257    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558260    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558263    2580 flags.go:64] FLAG: --runonce="false"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558266    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558269    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558272    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558275    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 03:48:51.918889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558278    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558281    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558284    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558288    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558291    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558294    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558296    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558299    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558302    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558321    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558324    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558330    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558333    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558336    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558340    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558343    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558346    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558348    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558351    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558354    2580 flags.go:64] FLAG: --v="2"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558359    2580 flags.go:64] FLAG: --version="false"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558363    2580 flags.go:64] FLAG: --vmodule=""
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558368    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.558371    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 03:48:51.919639 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558501    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558507    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558510    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558512    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558515    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558519    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558523    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558526    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558529    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558532    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558535    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558539    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558543    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558546    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558549    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558553    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558556    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558558    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558561    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:51.920357 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558564    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558566    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558569    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558571    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558574    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558576    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558579    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558582    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558584    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558587    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558589    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558591    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558599    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558602    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558606    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558609    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558611    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558614    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558616    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558620    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:51.920933 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558624    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558626    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558629    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558631    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558635    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558638    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558640    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558643    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558646    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558648    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558651    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558653    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558656    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558659    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558662    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558664    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558667    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558669    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558672    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558674    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:51.921563 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558677    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558679    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558682    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558684    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558687    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558690    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558694    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558696    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558699    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558701    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558704    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558706    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558709    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558711    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558714    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558716    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558720    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558723    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558725    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558728    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:51.922447 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558730    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558733    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558735    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558738    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558741    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558743    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558746    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558748    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558751    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558753    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558756    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558758    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558761    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558763    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558766    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558768    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558771    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558773    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558778    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:51.923056 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.558780    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.559448    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.566694    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.566712    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.566734    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.566740    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566797    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566803    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566807    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566810    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566813    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566817    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566820    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566823    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566826    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:51.923880 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566829    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566832    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566835    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566838    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566840    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566843    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566846    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566848    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566851    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566854    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566857    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566860    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566863    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566866    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566869    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566872    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566875    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566878    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566881    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566883    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:51.924343 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566886    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566889    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566895    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566898    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566900    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566903    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566906    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566909    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566913    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566915    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566918    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566920    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566924    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566926    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566929    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566931    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566934    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566937    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566939    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:51.925009 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566942    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566944    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566947    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566950    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566953    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566955    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566958    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566962    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566965    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566969    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566972    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566976    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566980    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566983    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566986    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566991    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566993    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566996    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.566999    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:51.925590 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567001    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567005    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567009    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567011    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567014    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567016    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567019    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567022    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567024    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567027    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567030    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567033    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567035    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567038    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567040    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567042    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567045    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567047    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567050    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:52.160518 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567053    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567055    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567058    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567062    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567065    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567069    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567073    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567076    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567079    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567083    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567086    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567089    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567092    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.567097    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567224    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:52.161228 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567229    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567231    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567234    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567237    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567241    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567244    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567247    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567250    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567253    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567256    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567259    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567262    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567265    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567267    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567270    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567273    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567276    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567278    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567281    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567284    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:52.161822 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567286    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567289    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567291    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567296    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567299    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567301    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567304    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567328    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567332    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567334    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567337    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567340    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567342    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567345    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567348    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567350    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567353    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567355    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567358    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567361    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:52.162408 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567363    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567366    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567368    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567371    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567373    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567376    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567378    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567381    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567383    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567386    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567388    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567391    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567394    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567396    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567399    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567406    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567411    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567415    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567417    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:52.163087 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567421    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567424    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567426    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567429    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567432    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567434    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567438    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567440    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567443    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567446    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567448    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567451    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567454    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567456    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567459    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567463    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567466    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567469    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567472    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:52.164160 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567475    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567477    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567480    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567482    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567485    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567487    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567490    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567493    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567495    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567499    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567502    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567505    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567507    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567511    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567514    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567516    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567519    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567521    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567524    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:52.164815 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:51.567528    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.567534    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.567665    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.569854    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.571245    2580 server.go:1019] "Starting client certificate rotation"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.571354    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.572214    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.573887    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.575455    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.588525    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.592146    2580 log.go:25] "Validated CRI v1 image API"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.592938    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 03:48:52.165397 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.595604    2580 fs.go:135] Filesystem UUIDs: map[719c2a8e-e4d4-4051-869a-1c39118f81f9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ebc4eb33-5fe6-4739-8a65-e9fed91f04ac:/dev/nvme0n1p4]
Jul 11 03:48:52.165889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.595621    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 03:48:52.165889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.597278    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.600619    2580 manager.go:216] Machine: {Timestamp:2026-07-11 03:48:51.599350002 +0000 UTC m=+0.296621854 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099950 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c6da5b172478f3391ab2cdf221d2 SystemUUID:ec22c6da-5b17-2478-f339-1ab2cdf221d2 BootID:7308a7d9-2cbb-4acf-bcd6-67b11505c254 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:36:96:f9:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:36:96:f9:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:ac:a5:28:e4:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.600729    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.600820    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.603642    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.603685    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.604394    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.604407    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.604415    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.605003    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.606472    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.609983    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610118    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610154    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610166    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610182    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610194    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610203    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 03:48:52.166104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610651    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.610668    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.613434    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.615337    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8djw7"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.615838    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.615868    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616072    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616086    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616093    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616099    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616109    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616120    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616381    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616402    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616411    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616418    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616426    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616435    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616461    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.616467    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.620474    2580 server.go:1268] "Started kubelet"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.620910    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.622057    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.622145    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.622389    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.622488    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.625721    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.625991    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.626043    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.626537    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8djw7"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.628929    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.629658    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-138.ec2.internal.18c11fa77c46e9a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-138.ec2.internal,UID:ip-10-0-134-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-138.ec2.internal,},FirstTimestamp:2026-07-11 03:48:51.620448679 +0000 UTC m=+0.317720535,LastTimestamp:2026-07-11 03:48:51.620448679 +0000 UTC m=+0.317720535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-138.ec2.internal,}"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.632163    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.632174    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.632418    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.632864    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.632881    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.632908    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633003    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633038    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 03:48:52.420018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633161    2580 factory.go:55] Registering systemd factory
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633192    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633438    2580 factory.go:153] Registering CRI-O factory
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633450    2580 factory.go:223] Registration of the crio container factory successfully
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633499    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633524    2580 factory.go:103] Registering Raw factory
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.633542    2580 manager.go:1196] Started watching for new ooms in manager
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.634183    2580 manager.go:349] Starting recovery of all containers
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.644109    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.646433    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-138.ec2.internal\" not found" node="ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.651004    2580 manager.go:354] Recovery completed
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.656297    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.658487    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.658517    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.658529    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.658991    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.659001    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.659018    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.659079    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.659832    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.659858    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.659874    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.660239    2580 policy_none.go:49] "None policy: Start"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.660254    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.660264    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.661407    2580 policy_none.go:47] "Start"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.702948    2580 manager.go:337] "Starting Device Plugin manager"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.702980    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.702991    2580 server.go:87] "Starting device plugin registration server"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.703245    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.703258    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.703386    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.703483    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.703497    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.704059    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.704114    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.780771    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.782018    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.782058    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.782085    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.782122    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.785479    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.803515    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.804583    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.804614    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.804625    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.804656    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.812540    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.812563    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-138.ec2.internal\": node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.421941 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.825215    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.885664    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"]
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.885766    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.886861    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.886899    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.886916    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.888347    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.888492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.888535    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.889217    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.889242    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.889255    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.889349    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.889377    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.889389    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.890627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.890651    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.891450    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.891474    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.891487    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.925314    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.925505    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-138.ec2.internal\" not found" node="ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:51.931335    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-138.ec2.internal\" not found" node="ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.934727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1044a46517d2ab21fef8e62c939ff5a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal\" (UID: \"1044a46517d2ab21fef8e62c939ff5a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.934753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1044a46517d2ab21fef8e62c939ff5a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal\" (UID: \"1044a46517d2ab21fef8e62c939ff5a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:51.934773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0229b4e6d3ad7be1121dd1ab53b129a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-138.ec2.internal\" (UID: \"f0229b4e6d3ad7be1121dd1ab53b129a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.026405    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.037786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1044a46517d2ab21fef8e62c939ff5a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal\" (UID: \"1044a46517d2ab21fef8e62c939ff5a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.423538 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.037823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1044a46517d2ab21fef8e62c939ff5a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal\" (UID: \"1044a46517d2ab21fef8e62c939ff5a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.037845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0229b4e6d3ad7be1121dd1ab53b129a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-138.ec2.internal\" (UID: \"f0229b4e6d3ad7be1121dd1ab53b129a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.037903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0229b4e6d3ad7be1121dd1ab53b129a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-138.ec2.internal\" (UID: \"f0229b4e6d3ad7be1121dd1ab53b129a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.037914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1044a46517d2ab21fef8e62c939ff5a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal\" (UID: \"1044a46517d2ab21fef8e62c939ff5a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.037903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1044a46517d2ab21fef8e62c939ff5a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal\" (UID: \"1044a46517d2ab21fef8e62c939ff5a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.126898    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.233455    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.233522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.236127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.424444 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.333707    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.436699    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.540396    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-138.ec2.internal\" not found"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.571151    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.571369    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.571377    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.595094    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.611185    2580 apiserver.go:52] "Watching apiserver"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.623013    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.624615    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wcqn5","openshift-image-registry/node-ca-lrl8g","openshift-multus/multus-s4dl7","openshift-multus/network-metrics-daemon-8srd5","openshift-network-diagnostics/network-check-target-tmbqw","kube-system/konnectivity-agent-qc88h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc","openshift-cluster-node-tuning-operator/tuned-69dxw","openshift-dns/node-resolver-49drc","openshift-multus/multus-additional-cni-plugins-t7snj","openshift-network-operator/iptables-alerter-jqlb7","openshift-ovn-kubernetes/ovnkube-node-5l5tn"]
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.626062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.626158    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.627064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.628275    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.629619    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.629833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.629860    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8kkdx\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.630187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.630713    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.630804    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.631162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lbxmz\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.631242    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.631165    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.631562    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.631640    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.632310    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.632433    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.632835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.632886    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:48:52.679854 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.634354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.634628    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 03:43:52 +0000 UTC" deadline="2028-04-19 01:23:25.399895266 +0000 UTC"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.634675    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15549h34m32.76522415s"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.635450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.636583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.636878    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.636926    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.637029    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6wgwp\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.637591    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.637740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.637931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.637995    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rkc6p\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.638041    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.639027    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.639076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4j5f2\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.639210    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.639380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.640552    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.640593    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.640554    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7pq4s\""
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.640814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4acd2da-c938-47ef-bbc3-b14ef64a07d3-konnectivity-ca\") pod \"konnectivity-agent-qc88h\" (UID: \"c4acd2da-c938-47ef-bbc3-b14ef64a07d3\") " pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-cni-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-cni-multus\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-hostroot\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-etc-kubernetes\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4acd2da-c938-47ef-bbc3-b14ef64a07d3-agent-certs\") pod \"konnectivity-agent-qc88h\" (UID: \"c4acd2da-c938-47ef-bbc3-b14ef64a07d3\") " pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.681630 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f332a94-9880-44f5-98a5-deee84e855a6-dbus\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86c220b7-6a8d-4717-8b44-ec0d42e38189-serviceca\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-system-cni-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.641982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-cnibin\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.642269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-multus-certs\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-cni-binary-copy\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-k8s-cni-cncf-io\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-kubelet\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pt9v\" (UniqueName: \"kubernetes.io/projected/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-kube-api-access-8pt9v\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xwxg\" (UniqueName: \"kubernetes.io/projected/86c220b7-6a8d-4717-8b44-ec0d42e38189-kube-api-access-4xwxg\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-os-release\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-cni-bin\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-daemon-config\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f332a94-9880-44f5-98a5-deee84e855a6-kubelet-config\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645434    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rk2m\" (UniqueName: \"kubernetes.io/projected/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-kube-api-access-5rk2m\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:52.682730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645484    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f422c\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645489    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86c220b7-6a8d-4717-8b44-ec0d42e38189-host\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645436    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jq2l5\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-socket-dir-parent\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-netns\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-conf-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645893    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645906    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.645955    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcm2j\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.646022    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.646029    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.646159    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.646238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.646300    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.646950    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.649427    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.653533    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.653618    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal"]
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.653621    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.662044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal"]
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.662055    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.669878    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dkxj5"
Jul 11 03:48:52.683334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.677844    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dkxj5"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.733787    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-socket-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysctl-d\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86c220b7-6a8d-4717-8b44-ec0d42e38189-host\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-socket-dir-parent\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86c220b7-6a8d-4717-8b44-ec0d42e38189-host\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-socket-dir-parent\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-netns\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-netns\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-slash\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.746832    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-log-socket\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.746938    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:53.246913624 +0000 UTC m=+1.944185467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysctl-conf\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.746984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-conf-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.856569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-tmp\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovn-node-metrics-cert\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-hostroot\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-conf-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-etc-kubernetes\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-kubelet\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-etc-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-hostroot\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-etc-kubernetes\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p4cm\" (UniqueName: \"kubernetes.io/projected/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-kube-api-access-5p4cm\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-os-release\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86c220b7-6a8d-4717-8b44-ec0d42e38189-serviceca\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-system-cni-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-cnibin\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-multus-certs\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-systemd-units\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-system-cni-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e87a3290-e12e-44f2-8ce0-8489f2d17493-hosts-file\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.857827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-cni-binary-copy\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-cnibin\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-multus-certs\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-k8s-cni-cncf-io\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-run-k8s-cni-cncf-io\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovnkube-script-lib\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-registration-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-sys-fs\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-kubernetes\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xwxg\" (UniqueName: \"kubernetes.io/projected/86c220b7-6a8d-4717-8b44-ec0d42e38189-kube-api-access-4xwxg\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-cni-bin\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-iptables-alerter-script\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-host\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-system-cni-dir\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-run-netns\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-device-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.858963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86c220b7-6a8d-4717-8b44-ec0d42e38189-serviceca\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-modprobe-d\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysconfig\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-cni-bin\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r4w6\" (UniqueName: \"kubernetes.io/projected/e87a3290-e12e-44f2-8ce0-8489f2d17493-kube-api-access-6r4w6\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.747998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rk2m\" (UniqueName: \"kubernetes.io/projected/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-kube-api-access-5rk2m\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovnkube-config\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-cni-binary-copy\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-systemd\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-run\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-node-log\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rc7b\" (UniqueName: \"kubernetes.io/projected/7dfdeabf-7d4b-473e-bb62-9b856a208351-kube-api-access-9rc7b\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.860408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-sys\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-cni-binary-copy\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-ovn\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-env-overrides\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4acd2da-c938-47ef-bbc3-b14ef64a07d3-konnectivity-ca\") pod \"konnectivity-agent-qc88h\" (UID: \"c4acd2da-c938-47ef-bbc3-b14ef64a07d3\") " pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-cni-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-cni-multus\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzcl\" (UniqueName: \"kubernetes.io/projected/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-kube-api-access-5tzcl\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4acd2da-c938-47ef-bbc3-b14ef64a07d3-agent-certs\") pod \"konnectivity-agent-qc88h\" (UID: \"c4acd2da-c938-47ef-bbc3-b14ef64a07d3\") " pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f332a94-9880-44f5-98a5-deee84e855a6-dbus\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-cni-multus\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-cni-dir\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f332a94-9880-44f5-98a5-deee84e855a6-dbus\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-var-lib-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.748804    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-etc-selinux\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.861327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-cnibin\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.748869    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:53.248850578 +0000 UTC m=+1.946122434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-kubelet\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pt9v\" (UniqueName: \"kubernetes.io/projected/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-kube-api-access-8pt9v\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-lib-modules\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748930    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-os-release\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.748999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-host-var-lib-kubelet\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-os-release\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4acd2da-c938-47ef-bbc3-b14ef64a07d3-konnectivity-ca\") pod \"konnectivity-agent-qc88h\" (UID: \"c4acd2da-c938-47ef-bbc3-b14ef64a07d3\") " pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-daemon-config\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q6xp\" (UniqueName: \"kubernetes.io/projected/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-kube-api-access-4q6xp\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-var-lib-kubelet\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-tuned\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e87a3290-e12e-44f2-8ce0-8489f2d17493-tmp-dir\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.862993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9jn\" (UniqueName: \"kubernetes.io/projected/98d0747b-7781-4416-a833-b61b4b78de90-kube-api-access-tn9jn\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f332a94-9880-44f5-98a5-deee84e855a6-kubelet-config\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-systemd\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-cni-bin\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f332a94-9880-44f5-98a5-deee84e855a6-kubelet-config\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-cni-netd\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-host-slash\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.749544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-multus-daemon-config\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.753011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4acd2da-c938-47ef-bbc3-b14ef64a07d3-agent-certs\") pod \"konnectivity-agent-qc88h\" (UID: \"c4acd2da-c938-47ef-bbc3-b14ef64a07d3\") " pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.755747    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.755794    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.755808    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:52.755882    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:48:53.255863846 +0000 UTC m=+1.953135693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.758275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xwxg\" (UniqueName: \"kubernetes.io/projected/86c220b7-6a8d-4717-8b44-ec0d42e38189-kube-api-access-4xwxg\") pod \"node-ca-lrl8g\" (UID: \"86c220b7-6a8d-4717-8b44-ec0d42e38189\") " pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.758292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pt9v\" (UniqueName: \"kubernetes.io/projected/82b7dbfc-e082-41d4-ad90-c7ec819c23cd-kube-api-access-8pt9v\") pod \"multus-s4dl7\" (UID: \"82b7dbfc-e082-41d4-ad90-c7ec819c23cd\") " pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.758443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rk2m\" (UniqueName: \"kubernetes.io/projected/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-kube-api-access-5rk2m\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:52.863937 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-lib-modules\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q6xp\" (UniqueName: \"kubernetes.io/projected/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-kube-api-access-4q6xp\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-var-lib-kubelet\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-tuned\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-lib-modules\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-var-lib-kubelet\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e87a3290-e12e-44f2-8ce0-8489f2d17493-tmp-dir\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9jn\" (UniqueName: \"kubernetes.io/projected/98d0747b-7781-4416-a833-b61b4b78de90-kube-api-access-tn9jn\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-systemd\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-cni-bin\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-cni-netd\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-host-slash\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-socket-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysctl-d\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.865802 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-slash\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-cni-netd\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850992    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-systemd\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.850999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-log-socket\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e87a3290-e12e-44f2-8ce0-8489f2d17493-tmp-dir\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-cni-bin\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysctl-d\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysctl-conf\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-tmp\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovn-node-metrics-cert\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-kubelet\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-etc-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p4cm\" (UniqueName: \"kubernetes.io/projected/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-kube-api-access-5p4cm\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-os-release\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-systemd-units\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e87a3290-e12e-44f2-8ce0-8489f2d17493-hosts-file\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.866982 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovnkube-script-lib\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-registration-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-sys-fs\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-kubernetes\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-iptables-alerter-script\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-host\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.851990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-system-cni-dir\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-run-netns\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-device-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-modprobe-d\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysconfig\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r4w6\" (UniqueName: \"kubernetes.io/projected/e87a3290-e12e-44f2-8ce0-8489f2d17493-kube-api-access-6r4w6\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovnkube-config\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-systemd\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-run\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.868357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-node-log\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rc7b\" (UniqueName: \"kubernetes.io/projected/7dfdeabf-7d4b-473e-bb62-9b856a208351-kube-api-access-9rc7b\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-sys\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-cni-binary-copy\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-ovn\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-host\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-system-cni-dir\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-env-overrides\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-run-netns\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzcl\" (UniqueName: \"kubernetes.io/projected/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-kube-api-access-5tzcl\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-device-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-var-lib-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-var-lib-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-run\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.869321 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysconfig\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e87a3290-e12e-44f2-8ce0-8489f2d17493-hosts-file\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-modprobe-d\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-socket-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-tuned\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-sys\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-node-log\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-log-socket\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.852928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-kubelet\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-sysctl-conf\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-etc-openvswitch\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovnkube-script-lib\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-registration-dir\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.871004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-os-release\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-sys-fs\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-systemd-units\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-etc-selinux\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-kubernetes\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-cnibin\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-etc-systemd\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98d0747b-7781-4416-a833-b61b4b78de90-cnibin\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7dfdeabf-7d4b-473e-bb62-9b856a208351-etc-selinux\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-host-slash\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-run-ovn\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-host-slash\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-env-overrides\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovnkube-config\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.853945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-iptables-alerter-script\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.854385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98d0747b-7781-4416-a833-b61b4b78de90-cni-binary-copy\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.871931 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.855786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-tmp\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.855892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-ovn-node-metrics-cert\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.859229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9jn\" (UniqueName: \"kubernetes.io/projected/98d0747b-7781-4416-a833-b61b4b78de90-kube-api-access-tn9jn\") pod \"multus-additional-cni-plugins-t7snj\" (UID: \"98d0747b-7781-4416-a833-b61b4b78de90\") " pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.860082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q6xp\" (UniqueName: \"kubernetes.io/projected/ecbdffa3-52ad-4b41-9f5d-73e94cd82788-kube-api-access-4q6xp\") pod \"ovnkube-node-5l5tn\" (UID: \"ecbdffa3-52ad-4b41-9f5d-73e94cd82788\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.861320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p4cm\" (UniqueName: \"kubernetes.io/projected/a565fa3d-b06a-4371-a57c-f3ac94e8d3a9-kube-api-access-5p4cm\") pod \"tuned-69dxw\" (UID: \"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9\") " pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.861658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rc7b\" (UniqueName: \"kubernetes.io/projected/7dfdeabf-7d4b-473e-bb62-9b856a208351-kube-api-access-9rc7b\") pod \"aws-ebs-csi-driver-node-5kczc\" (UID: \"7dfdeabf-7d4b-473e-bb62-9b856a208351\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.862554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzcl\" (UniqueName: \"kubernetes.io/projected/17f8fe7d-6cb4-4d50-baff-b9417dce82f5-kube-api-access-5tzcl\") pod \"iptables-alerter-jqlb7\" (UID: \"17f8fe7d-6cb4-4d50-baff-b9417dce82f5\") " pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:52.873104 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.862704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r4w6\" (UniqueName: \"kubernetes.io/projected/e87a3290-e12e-44f2-8ce0-8489f2d17493-kube-api-access-6r4w6\") pod \"node-resolver-49drc\" (UID: \"e87a3290-e12e-44f2-8ce0-8489f2d17493\") " pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:52.878021 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.877237    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:52.891874    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1044a46517d2ab21fef8e62c939ff5a0.slice/crio-fe18238e886af66eda7ec27413e8759240c2945e3ff29451a39d5ad446eda04c WatchSource:0}: Error finding container fe18238e886af66eda7ec27413e8759240c2945e3ff29451a39d5ad446eda04c: Status 404 returned error can't find the container with id fe18238e886af66eda7ec27413e8759240c2945e3ff29451a39d5ad446eda04c
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:52.892124    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0229b4e6d3ad7be1121dd1ab53b129a.slice/crio-3f9842621ffd413c2964d5a46acd322639f84c5c13b6a9529680c942df70f191 WatchSource:0}: Error finding container 3f9842621ffd413c2964d5a46acd322639f84c5c13b6a9529680c942df70f191: Status 404 returned error can't find the container with id 3f9842621ffd413c2964d5a46acd322639f84c5c13b6a9529680c942df70f191
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.898250    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.966670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrl8g"
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:52.978062    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c220b7_6a8d_4717_8b44_ec0d42e38189.slice/crio-48e13ff635113ac2f5b6dea7aa888fe5ba1565960fc0c912b37347e59aa1884e WatchSource:0}: Error finding container 48e13ff635113ac2f5b6dea7aa888fe5ba1565960fc0c912b37347e59aa1884e: Status 404 returned error can't find the container with id 48e13ff635113ac2f5b6dea7aa888fe5ba1565960fc0c912b37347e59aa1884e
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:52.985801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s4dl7"
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:52.993878    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b7dbfc_e082_41d4_ad90_c7ec819c23cd.slice/crio-8d20c6ba01ed91aaebc3b952236e46c99667a608d696b3207c69ffb69afd871d WatchSource:0}: Error finding container 8d20c6ba01ed91aaebc3b952236e46c99667a608d696b3207c69ffb69afd871d: Status 404 returned error can't find the container with id 8d20c6ba01ed91aaebc3b952236e46c99667a608d696b3207c69ffb69afd871d
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.010349    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.013211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc"
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:53.021473    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4acd2da_c938_47ef_bbc3_b14ef64a07d3.slice/crio-b577431a323fd1db6753e46a509491c051c8a2bfcc21716c9959d30067750601 WatchSource:0}: Error finding container b577431a323fd1db6753e46a509491c051c8a2bfcc21716c9959d30067750601: Status 404 returned error can't find the container with id b577431a323fd1db6753e46a509491c051c8a2bfcc21716c9959d30067750601
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:53.030285    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfdeabf_7d4b_473e_bb62_9b856a208351.slice/crio-a2d0aab938ae5e4d3ecdaf1f827f3a3fb9d0ff8412734edbc98d4dfb626d5fbd WatchSource:0}: Error finding container a2d0aab938ae5e4d3ecdaf1f827f3a3fb9d0ff8412734edbc98d4dfb626d5fbd: Status 404 returned error can't find the container with id a2d0aab938ae5e4d3ecdaf1f827f3a3fb9d0ff8412734edbc98d4dfb626d5fbd
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.030953    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69dxw"
Jul 11 03:48:53.042894 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:53.038841    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda565fa3d_b06a_4371_a57c_f3ac94e8d3a9.slice/crio-b99583aaa82e1d8d114869509ffd0b1482ffb881ce8d2d7eaeeae92645516317 WatchSource:0}: Error finding container b99583aaa82e1d8d114869509ffd0b1482ffb881ce8d2d7eaeeae92645516317: Status 404 returned error can't find the container with id b99583aaa82e1d8d114869509ffd0b1482ffb881ce8d2d7eaeeae92645516317
Jul 11 03:48:53.053118 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.051183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49drc"
Jul 11 03:48:53.219345 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.078647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t7snj"
Jul 11 03:48:53.219345 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:53.086725    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d0747b_7781_4416_a833_b61b4b78de90.slice/crio-981d8f93471c58384a4a11fe4fee1aa512926eaf2278b0b0b4f56720a085ef29 WatchSource:0}: Error finding container 981d8f93471c58384a4a11fe4fee1aa512926eaf2278b0b0b4f56720a085ef29: Status 404 returned error can't find the container with id 981d8f93471c58384a4a11fe4fee1aa512926eaf2278b0b0b4f56720a085ef29
Jul 11 03:48:53.219345 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.104082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jqlb7"
Jul 11 03:48:53.219345 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.108680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:48:53.219345 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:53.112767    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f8fe7d_6cb4_4d50_baff_b9417dce82f5.slice/crio-165f34815a2b04851dac996ed99001cc9308119f4305cbf00b70a7fbd47792a9 WatchSource:0}: Error finding container 165f34815a2b04851dac996ed99001cc9308119f4305cbf00b70a7fbd47792a9: Status 404 returned error can't find the container with id 165f34815a2b04851dac996ed99001cc9308119f4305cbf00b70a7fbd47792a9
Jul 11 03:48:53.219345 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:48:53.124663    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbdffa3_52ad_4b41_9f5d_73e94cd82788.slice/crio-86efff804e164097ab6fd6467ab51d1a6c0debebf8a458ab95953b2e19997314 WatchSource:0}: Error finding container 86efff804e164097ab6fd6467ab51d1a6c0debebf8a458ab95953b2e19997314: Status 404 returned error can't find the container with id 86efff804e164097ab6fd6467ab51d1a6c0debebf8a458ab95953b2e19997314
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.256217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256340    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.256292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256440    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:54.256419548 +0000 UTC m=+2.953691395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256464    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.256473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256505    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256521    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256562    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:48:54.25654985 +0000 UTC m=+2.953821706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256586    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:53.371045 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:53.256614    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:54.256605546 +0000 UTC m=+2.953877392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:53.680063 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.679933    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:43:53 +0000 UTC" deadline="2028-04-17 07:53:09.704533396 +0000 UTC"
Jul 11 03:48:53.680063 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.680006    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15508h4m16.024532819s"
Jul 11 03:48:53.808245 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.808171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49drc" event={"ID":"e87a3290-e12e-44f2-8ce0-8489f2d17493","Type":"ContainerStarted","Data":"8c90bcef35594266aa2585b7182cc30fb5a55e15c8af062d8b20b18a7dc0865d"}
Jul 11 03:48:53.825234 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.825117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qc88h" event={"ID":"c4acd2da-c938-47ef-bbc3-b14ef64a07d3","Type":"ContainerStarted","Data":"b577431a323fd1db6753e46a509491c051c8a2bfcc21716c9959d30067750601"}
Jul 11 03:48:53.831571 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.831471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s4dl7" event={"ID":"82b7dbfc-e082-41d4-ad90-c7ec819c23cd","Type":"ContainerStarted","Data":"8d20c6ba01ed91aaebc3b952236e46c99667a608d696b3207c69ffb69afd871d"}
Jul 11 03:48:53.837198 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.836994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jqlb7" event={"ID":"17f8fe7d-6cb4-4d50-baff-b9417dce82f5","Type":"ContainerStarted","Data":"165f34815a2b04851dac996ed99001cc9308119f4305cbf00b70a7fbd47792a9"}
Jul 11 03:48:53.844270 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.844227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerStarted","Data":"981d8f93471c58384a4a11fe4fee1aa512926eaf2278b0b0b4f56720a085ef29"}
Jul 11 03:48:53.858676 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.858627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69dxw" event={"ID":"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9","Type":"ContainerStarted","Data":"b99583aaa82e1d8d114869509ffd0b1482ffb881ce8d2d7eaeeae92645516317"}
Jul 11 03:48:53.859199 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.859136    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:53.878929 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.878884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc" event={"ID":"7dfdeabf-7d4b-473e-bb62-9b856a208351","Type":"ContainerStarted","Data":"a2d0aab938ae5e4d3ecdaf1f827f3a3fb9d0ff8412734edbc98d4dfb626d5fbd"}
Jul 11 03:48:53.894256 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.894214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrl8g" event={"ID":"86c220b7-6a8d-4717-8b44-ec0d42e38189","Type":"ContainerStarted","Data":"48e13ff635113ac2f5b6dea7aa888fe5ba1565960fc0c912b37347e59aa1884e"}
Jul 11 03:48:53.912379 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.912174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal" event={"ID":"1044a46517d2ab21fef8e62c939ff5a0","Type":"ContainerStarted","Data":"fe18238e886af66eda7ec27413e8759240c2945e3ff29451a39d5ad446eda04c"}
Jul 11 03:48:53.931532 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.931306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal" event={"ID":"f0229b4e6d3ad7be1121dd1ab53b129a","Type":"ContainerStarted","Data":"3f9842621ffd413c2964d5a46acd322639f84c5c13b6a9529680c942df70f191"}
Jul 11 03:48:53.965139 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:53.964995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"86efff804e164097ab6fd6467ab51d1a6c0debebf8a458ab95953b2e19997314"}
Jul 11 03:48:54.088449 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.088290    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:54.266537 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.266427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:54.266537 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.266500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:54.266537 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.266537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:54.266831 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.266702    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:54.266831 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.266772    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.266750981 +0000 UTC m=+4.964022825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:54.267461 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.267243    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:54.267461 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.267277    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:54.267461 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.267290    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:54.267461 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.267286    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:54.267461 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.267346    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.267331097 +0000 UTC m=+4.964602942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:54.267461 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.267416    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.267395369 +0000 UTC m=+4.964667214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:54.681362 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.681180    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:43:53 +0000 UTC" deadline="2028-01-20 17:22:18.668134297 +0000 UTC"
Jul 11 03:48:54.681362 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.681246    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13405h33m23.986892941s"
Jul 11 03:48:54.783235 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.783199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:54.783458 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.783367    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:48:54.783825 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.783805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:54.783931 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.783910    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:48:54.784000 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:54.783978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:54.784070 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:54.784052    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:56.282224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:56.282280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:56.282378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.282534    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.282607    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:00.28258642 +0000 UTC m=+8.979858277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.283066    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.283087    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.283101    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.283154    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:49:00.283135048 +0000 UTC m=+8.980406906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.283216    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:56.283360 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.283252    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:00.283239674 +0000 UTC m=+8.980511520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:56.782808 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:56.782724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:56.782999 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:56.782895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:56.782999 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.782901    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:48:56.783170 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.783004    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:48:56.783170 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:56.783063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:56.783170 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:56.783156    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:48:58.782769 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:58.782735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:48:58.783253 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:58.782781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:48:58.783253 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:48:58.782735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:48:58.783253 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:58.782872    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:48:58.783253 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:58.782985    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:48:58.783253 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:48:58.783084    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:00.318910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:00.318968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:00.319037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319129    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319134    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319160    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319174    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319188    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:08.319168896 +0000 UTC m=+17.016440759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319136    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319229    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:49:08.319211845 +0000 UTC m=+17.016483692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:00.319576 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.319271    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:08.319253459 +0000 UTC m=+17.016525317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:00.783259 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:00.783129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:00.783432 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.783274    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:00.783432 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:00.783365    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:00.783568 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.783487    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:00.783568 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:00.783529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:00.783663 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:00.783603    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:02.783244 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:02.783208    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:02.783718 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:02.783278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:02.783718 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:02.783404    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:02.783718 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:02.783433    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:02.783718 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:02.783499    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:02.783718 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:02.783587    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:04.782414 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:04.782373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:04.782883 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:04.782390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:04.782883 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:04.782509    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:04.782883 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:04.782392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:04.782883 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:04.782587    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:04.782883 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:04.782665    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:06.782354 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:06.782296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:06.782354 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:06.782352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:06.782878 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:06.782352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:06.782878 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:06.782452    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:06.782878 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:06.782546    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:06.782878 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:06.782627    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:08.383457 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:08.383407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:08.383482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:08.383516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383588    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383641    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383657    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383677    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:24.383654298 +0000 UTC m=+33.080926142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383681    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383699    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383700    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:24.383689602 +0000 UTC m=+33.080961448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:08.383966 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.383753    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:49:24.383736379 +0000 UTC m=+33.081008239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:08.783264 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:08.783225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:08.783463 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:08.783225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:08.783463 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:08.783372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:08.783463 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.783388    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:08.783614 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.783460    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:08.783614 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:08.783554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:10.782871 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:10.782835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:10.783349 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:10.782835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:10.783349 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:10.782971    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:10.783349 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:10.782851    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:10.783349 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:10.783048    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:10.783349 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:10.783120    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:12.783283 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:12.783239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:12.783759 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:12.783294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:12.783759 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:12.783243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:12.783759 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:12.783384    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:12.783759 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:12.783446    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:12.783759 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:12.783515    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:14.007488 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.007189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal" event={"ID":"f0229b4e6d3ad7be1121dd1ab53b129a","Type":"ContainerStarted","Data":"c2564f35e5909f57c323f6b468e36f516dc351ac62532e5c16e15bf83ca07433"}
Jul 11 03:49:14.013511 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.013484    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:49:14.014842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.014140    2580 generic.go:356] "Generic (PLEG): container finished" podID="ecbdffa3-52ad-4b41-9f5d-73e94cd82788" containerID="1fdec36812b2b2876e2ea30292a689e21f97d0edc98d88db10f9911936b0a58a" exitCode=1
Jul 11 03:49:14.014842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.014226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"de129bef136f89aa457de98f30ad4349133ec52d78e28a0eabac5fba0f6a505e"}
Jul 11 03:49:14.014842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.014334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"514fcb3358596dbaa26ee981f5696a61715826bbdff85892dc64bd5023272456"}
Jul 11 03:49:14.014842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.014383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"4f2a14571e8d1237688578d2af314d3cd5e7006527f214944004fa249be6f524"}
Jul 11 03:49:14.014842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.014430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerDied","Data":"1fdec36812b2b2876e2ea30292a689e21f97d0edc98d88db10f9911936b0a58a"}
Jul 11 03:49:14.014842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.014479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"de28afe85ec23e39da2b6605f658f7d4f7f667db4a73aab6088aec45608a2916"}
Jul 11 03:49:14.017684 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.016853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s4dl7" event={"ID":"82b7dbfc-e082-41d4-ad90-c7ec819c23cd","Type":"ContainerStarted","Data":"dbceb555a8f979e0671fdb75ac17f5a1989c411bd3c6233256bf900ea70727ff"}
Jul 11 03:49:14.018690 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.018618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69dxw" event={"ID":"a565fa3d-b06a-4371-a57c-f3ac94e8d3a9","Type":"ContainerStarted","Data":"24253569a538f0ccd61c61b3af84286f02a94db2d77c70dcb39d4f26499aa629"}
Jul 11 03:49:14.020536 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.020485    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-138.ec2.internal" podStartSLOduration=21.020443432 podStartE2EDuration="21.020443432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:14.019357037 +0000 UTC m=+22.716628901" watchObservedRunningTime="2026-07-11 03:49:14.020443432 +0000 UTC m=+22.717715296"
Jul 11 03:49:14.034966 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.034925    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-69dxw" podStartSLOduration=1.7467870300000001 podStartE2EDuration="22.034912489s" totalImagesPullingTime="20.288125459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:14.033831006 +0000 UTC m=+22.731102868" watchObservedRunningTime="2026-07-11 03:49:14.034912489 +0000 UTC m=+22.732184350"
Jul 11 03:49:14.048267 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.048221    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s4dl7" podStartSLOduration=1.469975837 podStartE2EDuration="22.048208548s" totalImagesPullingTime="20.578232711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:14.048173007 +0000 UTC m=+22.745444869" watchObservedRunningTime="2026-07-11 03:49:14.048208548 +0000 UTC m=+22.745480411"
Jul 11 03:49:14.782795 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.782761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:14.782980 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.782803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:14.782980 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:14.782854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:14.782980 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:14.782870    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:14.782980 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:14.782932    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:14.783143 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:14.783007    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:15.022043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.021951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qc88h" event={"ID":"c4acd2da-c938-47ef-bbc3-b14ef64a07d3","Type":"ContainerStarted","Data":"3209e452b3c0054858bf45dfd32f8859d34ccab55181c27cbd25afa437005c23"}
Jul 11 03:49:15.023325 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.023282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jqlb7" event={"ID":"17f8fe7d-6cb4-4d50-baff-b9417dce82f5","Type":"ContainerStarted","Data":"51aee0930c578332e49214261986bae9742059d579cb0ea20b8ce1716b4e2477"}
Jul 11 03:49:15.024757 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.024731    2580 generic.go:356] "Generic (PLEG): container finished" podID="98d0747b-7781-4416-a833-b61b4b78de90" containerID="5142451595cd21c483e20420dc86c65ef107410daa525a707e2b27685cad113a" exitCode=0
Jul 11 03:49:15.024888 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.024818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerDied","Data":"5142451595cd21c483e20420dc86c65ef107410daa525a707e2b27685cad113a"}
Jul 11 03:49:15.026332 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.026298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc" event={"ID":"7dfdeabf-7d4b-473e-bb62-9b856a208351","Type":"ContainerStarted","Data":"be1f712c950a0afd37de2e82676ed3a04b1783daa3c31ea72050c7c4b8426a37"}
Jul 11 03:49:15.027617 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.027599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrl8g" event={"ID":"86c220b7-6a8d-4717-8b44-ec0d42e38189","Type":"ContainerStarted","Data":"94fcd2077e1420b761661ef9ce0a6e4f815df9d587c1476c6ca5a1e27ed5a0e7"}
Jul 11 03:49:15.029091 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.029070    2580 generic.go:356] "Generic (PLEG): container finished" podID="1044a46517d2ab21fef8e62c939ff5a0" containerID="a97010fa9954a66dea59f4e0d7cc2f8a0ced4a15d7fabf4ffaa6045422c6ceff" exitCode=0
Jul 11 03:49:15.029184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.029140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal" event={"ID":"1044a46517d2ab21fef8e62c939ff5a0","Type":"ContainerDied","Data":"a97010fa9954a66dea59f4e0d7cc2f8a0ced4a15d7fabf4ffaa6045422c6ceff"}
Jul 11 03:49:15.032219 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.032203    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:49:15.032569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.032551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"1ac4051ad508b131ea3b18d5599695d84547438b52f416731fa70b15ef843ece"}
Jul 11 03:49:15.033881 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.033851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49drc" event={"ID":"e87a3290-e12e-44f2-8ce0-8489f2d17493","Type":"ContainerStarted","Data":"2dcdc1eede958fb3a0f75e01155d3dede0aceee02c68db429fd6f278c9d6af45"}
Jul 11 03:49:15.037409 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.036517    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qc88h" podStartSLOduration=2.738823436 podStartE2EDuration="23.036500783s" totalImagesPullingTime="20.297677347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:15.035541306 +0000 UTC m=+23.732813169" watchObservedRunningTime="2026-07-11 03:49:15.036500783 +0000 UTC m=+23.733772648"
Jul 11 03:49:15.048843 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.048799    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-49drc" podStartSLOduration=2.788461797 podStartE2EDuration="23.048784823s" totalImagesPullingTime="20.260323026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:15.04850469 +0000 UTC m=+23.745776552" watchObservedRunningTime="2026-07-11 03:49:15.048784823 +0000 UTC m=+23.746056684"
Jul 11 03:49:15.078156 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.078097    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jqlb7" podStartSLOduration=2.871652379 podStartE2EDuration="23.078076126s" totalImagesPullingTime="20.206423747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:15.077639041 +0000 UTC m=+23.774910906" watchObservedRunningTime="2026-07-11 03:49:15.078076126 +0000 UTC m=+23.775347990"
Jul 11 03:49:15.103915 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.103872    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lrl8g" podStartSLOduration=2.762792726 podStartE2EDuration="23.103856914s" totalImagesPullingTime="20.341064188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:15.103530581 +0000 UTC m=+23.800802443" watchObservedRunningTime="2026-07-11 03:49:15.103856914 +0000 UTC m=+23.801128775"
Jul 11 03:49:15.422224 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.422194    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 03:49:15.718300 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.718165    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T03:49:15.422222545Z","UUID":"deca7714-7e40-4e91-ad02-6d407ea2329f","Handler":null,"Name":"","Endpoint":""}
Jul 11 03:49:15.719837 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.719808    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 03:49:15.719962 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:15.719847    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 03:49:16.039184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:16.039060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc" event={"ID":"7dfdeabf-7d4b-473e-bb62-9b856a208351","Type":"ContainerStarted","Data":"4810b3331568f8e578eaf52353b7dc11b9c889721e3c7600799c24085b09b913"}
Jul 11 03:49:16.041475 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:16.041445    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal" event={"ID":"1044a46517d2ab21fef8e62c939ff5a0","Type":"ContainerStarted","Data":"96eac3c21c8dc5beb322b2914b4e93c3deccab39475840e604c5e681c5594269"}
Jul 11 03:49:16.056091 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:16.056033    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-138.ec2.internal" podStartSLOduration=23.056011075 podStartE2EDuration="23.056011075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:16.05533059 +0000 UTC m=+24.752602453" watchObservedRunningTime="2026-07-11 03:49:16.056011075 +0000 UTC m=+24.753282937"
Jul 11 03:49:16.783133 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:16.783097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:16.783349 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:16.783148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:16.783349 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:16.783149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:16.783349 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:16.783220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:16.783547 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:16.783340    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:16.783547 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:16.783396    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:17.045679 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:17.045646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc" event={"ID":"7dfdeabf-7d4b-473e-bb62-9b856a208351","Type":"ContainerStarted","Data":"cbdef16ca0c4554610b7d141f86006258b4d53616a6f74abc5e6f92d5af83af0"}
Jul 11 03:49:17.049007 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:17.048978    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:49:17.049550 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:17.049520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"b984f5b8d60c2300d895cc05147aa86a251f013bdd7f0f34c0e90446ee3aec99"}
Jul 11 03:49:17.062933 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:17.062892    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kczc" podStartSLOduration=2.394800368 podStartE2EDuration="25.062878557s" totalImagesPullingTime="22.668078189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:17.061971605 +0000 UTC m=+25.759243469" watchObservedRunningTime="2026-07-11 03:49:17.062878557 +0000 UTC m=+25.760150451"
Jul 11 03:49:17.230703 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:17.230668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:49:17.231303 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:17.231282    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:49:18.051827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:18.051803    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:49:18.052346 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:18.052326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qc88h"
Jul 11 03:49:18.782725 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:18.782625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:18.782889 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:18.782790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:18.782889 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:18.782785    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:18.782997 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:18.782898    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:18.782997 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:18.782926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:18.783074 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:18.783004    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:20.058442 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.058214    2580 generic.go:356] "Generic (PLEG): container finished" podID="98d0747b-7781-4416-a833-b61b4b78de90" containerID="72d839b8375d966394796ccd3355f8f18039ae8f5a62924eff432f4a93ad8690" exitCode=0
Jul 11 03:49:20.059327 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.058300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerDied","Data":"72d839b8375d966394796ccd3355f8f18039ae8f5a62924eff432f4a93ad8690"}
Jul 11 03:49:20.062037 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.062021    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:49:20.062418 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.062395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"1c60fbe07d372ff7c78beb11ab9db814a39711ac2c4355644debc4303bfe7311"}
Jul 11 03:49:20.062738 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.062719    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:49:20.062827 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.062762    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:49:20.062935 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.062919    2580 scope.go:117] "RemoveContainer" containerID="1fdec36812b2b2876e2ea30292a689e21f97d0edc98d88db10f9911936b0a58a"
Jul 11 03:49:20.079145 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.079121    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:49:20.782797 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.782757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:20.782797 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.782782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:20.783094 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:20.782782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:20.783094 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:20.782892    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:20.783094 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:20.783014    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:20.783094 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:20.783090    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:21.067460 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:21.067427    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:49:21.067886 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:21.067755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" event={"ID":"ecbdffa3-52ad-4b41-9f5d-73e94cd82788","Type":"ContainerStarted","Data":"b9b01c7267967a1dc0d817652c6459bb9189990726e7a2bb785cd0c6e21c3757"}
Jul 11 03:49:21.068093 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:21.068071    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:49:21.082932 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:21.082910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:49:21.090722 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:21.090682    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn" podStartSLOduration=8.735528369 podStartE2EDuration="29.09067075s" totalImagesPullingTime="20.355142381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:21.090221301 +0000 UTC m=+29.787493162" watchObservedRunningTime="2026-07-11 03:49:21.09067075 +0000 UTC m=+29.787942611"
Jul 11 03:49:22.072530 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:22.072494    2580 generic.go:356] "Generic (PLEG): container finished" podID="98d0747b-7781-4416-a833-b61b4b78de90" containerID="4804c610f0aec2102700bc20cbfd4a6c0d6571c7dda09e93300862987a81ea35" exitCode=0
Jul 11 03:49:22.072903 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:22.072581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerDied","Data":"4804c610f0aec2102700bc20cbfd4a6c0d6571c7dda09e93300862987a81ea35"}
Jul 11 03:49:22.782826 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:22.782773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:22.782826 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:22.782825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:22.783068 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:22.782825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:22.783068 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:22.782922    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:22.783068 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:22.783007    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:22.783169 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:22.783066    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:24.078960 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.078913    2580 generic.go:356] "Generic (PLEG): container finished" podID="98d0747b-7781-4416-a833-b61b4b78de90" containerID="fabe46628deadacb6bbe6c77e0ec9feae9ca2a0e205325989b67f104daf24025" exitCode=0
Jul 11 03:49:24.079340 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.078969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerDied","Data":"fabe46628deadacb6bbe6c77e0ec9feae9ca2a0e205325989b67f104daf24025"}
Jul 11 03:49:24.403032 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.402953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:24.403032 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.402991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:24.403032 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.403010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403112    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403118    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403133    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403151    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403162    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs podName:cfc53e74-81fc-4fa2-b0a9-b65bb79b679e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:56.403147479 +0000 UTC m=+65.100419319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs") pod "network-metrics-daemon-8srd5" (UID: "cfc53e74-81fc-4fa2-b0a9-b65bb79b679e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403164    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jk6ck for pod openshift-network-diagnostics/network-check-target-tmbqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403174    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret podName:6f332a94-9880-44f5-98a5-deee84e855a6 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:56.40316807 +0000 UTC m=+65.100439910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret") pod "global-pull-secret-syncer-wcqn5" (UID: "6f332a94-9880-44f5-98a5-deee84e855a6") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:24.403226 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.403203    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck podName:31cd7ae8-b2d0-478a-a5d5-60e325657cdc nodeName:}" failed. No retries permitted until 2026-07-11 03:49:56.403188917 +0000 UTC m=+65.100460763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jk6ck" (UniqueName: "kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck") pod "network-check-target-tmbqw" (UID: "31cd7ae8-b2d0-478a-a5d5-60e325657cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:24.782898 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.782808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:24.783074 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.782825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:24.783074 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.782971    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:24.783074 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:24.782825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:24.783074 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.783037    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:24.783299 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:24.783102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:26.782924 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:26.782888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:26.783426 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:26.782887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:26.783426 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:26.783027    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:26.783426 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:26.782884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:26.783426 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:26.783126    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:26.783426 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:26.783217    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:28.783015 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:28.782974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:28.783394 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:28.782995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:28.783394 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:28.783094    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:28.783394 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:28.783153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:28.783394 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:28.783255    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:28.783394 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:28.783290    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:29.092614 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:29.092575    2580 generic.go:356] "Generic (PLEG): container finished" podID="98d0747b-7781-4416-a833-b61b4b78de90" containerID="8414658d921425f8c4146c336cae16a557070af1eed09a097e339d3fa5243188" exitCode=0
Jul 11 03:49:29.092750 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:29.092650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerDied","Data":"8414658d921425f8c4146c336cae16a557070af1eed09a097e339d3fa5243188"}
Jul 11 03:49:30.098141 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:30.098110    2580 generic.go:356] "Generic (PLEG): container finished" podID="98d0747b-7781-4416-a833-b61b4b78de90" containerID="7381bdcd563f8e98b3b100908674916ed7823de6abb597f51f53d731fc3777da" exitCode=0
Jul 11 03:49:30.098567 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:30.098172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerDied","Data":"7381bdcd563f8e98b3b100908674916ed7823de6abb597f51f53d731fc3777da"}
Jul 11 03:49:30.782605 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:30.782563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:30.782605 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:30.782598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:30.782868 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:30.782603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:30.782868 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:30.782693    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:30.782868 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:30.782753    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:30.782868 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:30.782824    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:31.103580 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:31.103548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7snj" event={"ID":"98d0747b-7781-4416-a833-b61b4b78de90","Type":"ContainerStarted","Data":"7ebb991b2aa61ad35519ceface29e255c5bf9e8998dbcecdf4ea94c5d03fa550"}
Jul 11 03:49:31.158090 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:31.158039    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t7snj" podStartSLOduration=8.48212269 podStartE2EDuration="39.158023632s" totalImagesPullingTime="30.675900942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:31.157849954 +0000 UTC m=+39.855121815" watchObservedRunningTime="2026-07-11 03:49:31.158023632 +0000 UTC m=+39.855295495"
Jul 11 03:49:32.246658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:32.246451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tmbqw"]
Jul 11 03:49:32.247102 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:32.246770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:32.247102 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:32.246889    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:32.249613 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:32.249585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8srd5"]
Jul 11 03:49:32.249727 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:32.249707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:32.249844 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:32.249819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:32.260545 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:32.260515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wcqn5"]
Jul 11 03:49:32.260675 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:32.260620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:32.260724 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:32.260699    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:33.783119 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:33.783084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:33.783718 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:33.783098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:33.783718 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:33.783218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:33.783718 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:33.783221    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:33.783718 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:33.783305    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:33.783718 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:33.783387    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:35.783390 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:35.783351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:35.783843 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:35.783399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:35.783843 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:35.783351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:35.783843 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:35.783476    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcqn5" podUID="6f332a94-9880-44f5-98a5-deee84e855a6"
Jul 11 03:49:35.783843 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:35.783539    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8srd5" podUID="cfc53e74-81fc-4fa2-b0a9-b65bb79b679e"
Jul 11 03:49:35.783843 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:35.783606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmbqw" podUID="31cd7ae8-b2d0-478a-a5d5-60e325657cdc"
Jul 11 03:49:36.131386 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.131362    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-138.ec2.internal" event="NodeReady"
Jul 11 03:49:36.131525 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.131478    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 03:49:36.161470 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.161441    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-746dcb8c78-vznmc"]
Jul 11 03:49:36.167386 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.167367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.170253 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.170227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 03:49:36.170406 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.170334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m95jx\""
Jul 11 03:49:36.170466 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.170411    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 03:49:36.170466 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.170339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 03:49:36.170564 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.170544    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wjx8s"]
Jul 11 03:49:36.174668 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.174647    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 03:49:36.175515 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.175497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.176711 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.176666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-746dcb8c78-vznmc"]
Jul 11 03:49:36.177875 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.177854    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 03:49:36.177979 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.177874    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 03:49:36.177979 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.177894    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 03:49:36.177979 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.177917    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 03:49:36.177979 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.177957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cjtvr\""
Jul 11 03:49:36.179948 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.179925    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bq4nj"]
Jul 11 03:49:36.193529 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.193478    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjx8s"]
Jul 11 03:49:36.193641 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.193605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.193704 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.193645    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bq4nj"]
Jul 11 03:49:36.195794 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.195776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzk9c\""
Jul 11 03:49:36.195928 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.195908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 03:49:36.196016 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.195915    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 03:49:36.275880 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.275847    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r4zrw"]
Jul 11 03:49:36.291981 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.291951    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4zrw"]
Jul 11 03:49:36.292100 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.292596 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqkx4\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-kube-api-access-dqkx4\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.292703 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8069c608-4998-482c-b8d0-f6e7ae81c6a5-ca-trust-extracted\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.292703 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dad95498-e584-4b36-9f2a-4d3c25001f12-config-volume\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.292785 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc3335fa-a8b4-46f9-9aae-c64185790e9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.292785 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqq6n\" (UniqueName: \"kubernetes.io/projected/cc3335fa-a8b4-46f9-9aae-c64185790e9c-kube-api-access-gqq6n\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.292785 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8069c608-4998-482c-b8d0-f6e7ae81c6a5-trusted-ca\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.292785 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8069c608-4998-482c-b8d0-f6e7ae81c6a5-installation-pull-secrets\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.292906 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc3335fa-a8b4-46f9-9aae-c64185790e9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.292906 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8069c608-4998-482c-b8d0-f6e7ae81c6a5-image-registry-private-configuration\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.292906 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-registry-tls\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.292906 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-bound-sa-token\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.293023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8069c608-4998-482c-b8d0-f6e7ae81c6a5-registry-certificates\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.293023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc3335fa-a8b4-46f9-9aae-c64185790e9c-data-volume\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.293023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad95498-e584-4b36-9f2a-4d3c25001f12-tmp-dir\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.293023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.292970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc3335fa-a8b4-46f9-9aae-c64185790e9c-crio-socket\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.293023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.293008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dad95498-e584-4b36-9f2a-4d3c25001f12-metrics-tls\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.293023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.293022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7th\" (UniqueName: \"kubernetes.io/projected/dad95498-e584-4b36-9f2a-4d3c25001f12-kube-api-access-zj7th\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.294539 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.294525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 03:49:36.294809 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.294787    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 03:49:36.294933 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.294869    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mltsp\""
Jul 11 03:49:36.294933 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.294869    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 03:49:36.393763 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8069c608-4998-482c-b8d0-f6e7ae81c6a5-image-registry-private-configuration\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.393763 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-registry-tls\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.393763 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-bound-sa-token\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.393763 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8069c608-4998-482c-b8d0-f6e7ae81c6a5-registry-certificates\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.394075 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgj8\" (UniqueName: \"kubernetes.io/projected/aadb1db3-28b0-4aeb-b615-ecf22880259d-kube-api-access-8fgj8\") pod \"ingress-canary-r4zrw\" (UID: \"aadb1db3-28b0-4aeb-b615-ecf22880259d\") " pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.394075 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc3335fa-a8b4-46f9-9aae-c64185790e9c-data-volume\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394075 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadb1db3-28b0-4aeb-b615-ecf22880259d-cert\") pod \"ingress-canary-r4zrw\" (UID: \"aadb1db3-28b0-4aeb-b615-ecf22880259d\") " pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.394075 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad95498-e584-4b36-9f2a-4d3c25001f12-tmp-dir\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.394075 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.393877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc3335fa-a8b4-46f9-9aae-c64185790e9c-crio-socket\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dad95498-e584-4b36-9f2a-4d3c25001f12-metrics-tls\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7th\" (UniqueName: \"kubernetes.io/projected/dad95498-e584-4b36-9f2a-4d3c25001f12-kube-api-access-zj7th\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc3335fa-a8b4-46f9-9aae-c64185790e9c-crio-socket\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqkx4\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-kube-api-access-dqkx4\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8069c608-4998-482c-b8d0-f6e7ae81c6a5-ca-trust-extracted\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dad95498-e584-4b36-9f2a-4d3c25001f12-tmp-dir\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dad95498-e584-4b36-9f2a-4d3c25001f12-config-volume\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc3335fa-a8b4-46f9-9aae-c64185790e9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc3335fa-a8b4-46f9-9aae-c64185790e9c-data-volume\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqq6n\" (UniqueName: \"kubernetes.io/projected/cc3335fa-a8b4-46f9-9aae-c64185790e9c-kube-api-access-gqq6n\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8069c608-4998-482c-b8d0-f6e7ae81c6a5-trusted-ca\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.394915 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8069c608-4998-482c-b8d0-f6e7ae81c6a5-registry-certificates\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.394915 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8069c608-4998-482c-b8d0-f6e7ae81c6a5-installation-pull-secrets\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.394993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc3335fa-a8b4-46f9-9aae-c64185790e9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.394993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dad95498-e584-4b36-9f2a-4d3c25001f12-config-volume\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.394993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.394943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc3335fa-a8b4-46f9-9aae-c64185790e9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.395625 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.395599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8069c608-4998-482c-b8d0-f6e7ae81c6a5-ca-trust-extracted\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.396021 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.395996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8069c608-4998-482c-b8d0-f6e7ae81c6a5-trusted-ca\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.398243 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.398221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8069c608-4998-482c-b8d0-f6e7ae81c6a5-image-registry-private-configuration\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.398243 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.398232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc3335fa-a8b4-46f9-9aae-c64185790e9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.398243 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.398244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8069c608-4998-482c-b8d0-f6e7ae81c6a5-installation-pull-secrets\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.398419 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.398232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dad95498-e584-4b36-9f2a-4d3c25001f12-metrics-tls\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.398419 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.398290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-registry-tls\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.401299 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.401274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-bound-sa-token\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.401574 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.401558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqq6n\" (UniqueName: \"kubernetes.io/projected/cc3335fa-a8b4-46f9-9aae-c64185790e9c-kube-api-access-gqq6n\") pod \"insights-runtime-extractor-wjx8s\" (UID: \"cc3335fa-a8b4-46f9-9aae-c64185790e9c\") " pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.401621 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.401590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7th\" (UniqueName: \"kubernetes.io/projected/dad95498-e584-4b36-9f2a-4d3c25001f12-kube-api-access-zj7th\") pod \"dns-default-bq4nj\" (UID: \"dad95498-e584-4b36-9f2a-4d3c25001f12\") " pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.402018 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.402002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqkx4\" (UniqueName: \"kubernetes.io/projected/8069c608-4998-482c-b8d0-f6e7ae81c6a5-kube-api-access-dqkx4\") pod \"image-registry-746dcb8c78-vznmc\" (UID: \"8069c608-4998-482c-b8d0-f6e7ae81c6a5\") " pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.477913 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.477875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:36.485993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.485967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjx8s"
Jul 11 03:49:36.495420 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.495267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgj8\" (UniqueName: \"kubernetes.io/projected/aadb1db3-28b0-4aeb-b615-ecf22880259d-kube-api-access-8fgj8\") pod \"ingress-canary-r4zrw\" (UID: \"aadb1db3-28b0-4aeb-b615-ecf22880259d\") " pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.495420 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.495293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadb1db3-28b0-4aeb-b615-ecf22880259d-cert\") pod \"ingress-canary-r4zrw\" (UID: \"aadb1db3-28b0-4aeb-b615-ecf22880259d\") " pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.497648 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.497628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadb1db3-28b0-4aeb-b615-ecf22880259d-cert\") pod \"ingress-canary-r4zrw\" (UID: \"aadb1db3-28b0-4aeb-b615-ecf22880259d\") " pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.502191 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.502158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:36.503281 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.503260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgj8\" (UniqueName: \"kubernetes.io/projected/aadb1db3-28b0-4aeb-b615-ecf22880259d-kube-api-access-8fgj8\") pod \"ingress-canary-r4zrw\" (UID: \"aadb1db3-28b0-4aeb-b615-ecf22880259d\") " pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.600666 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.600485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4zrw"
Jul 11 03:49:36.649050 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.648944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-746dcb8c78-vznmc"]
Jul 11 03:49:36.651639 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.651542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjx8s"]
Jul 11 03:49:36.653430 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:36.653405    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8069c608_4998_482c_b8d0_f6e7ae81c6a5.slice/crio-af86133b5e104a525caff991c1601db8b3c177f940cc86aaa0bc4f6541b93759 WatchSource:0}: Error finding container af86133b5e104a525caff991c1601db8b3c177f940cc86aaa0bc4f6541b93759: Status 404 returned error can't find the container with id af86133b5e104a525caff991c1601db8b3c177f940cc86aaa0bc4f6541b93759
Jul 11 03:49:36.654378 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:36.654345    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3335fa_a8b4_46f9_9aae_c64185790e9c.slice/crio-b52366d96281a294ab2a7ad11432d42d8a51d08bf682d03fc1c12ea3f5805ab9 WatchSource:0}: Error finding container b52366d96281a294ab2a7ad11432d42d8a51d08bf682d03fc1c12ea3f5805ab9: Status 404 returned error can't find the container with id b52366d96281a294ab2a7ad11432d42d8a51d08bf682d03fc1c12ea3f5805ab9
Jul 11 03:49:36.671792 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.671640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bq4nj"]
Jul 11 03:49:36.675604 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:36.675581    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad95498_e584_4b36_9f2a_4d3c25001f12.slice/crio-944158c71fac2eba25894e2c8314c7d3cbafdd7139573fa55d01329497406701 WatchSource:0}: Error finding container 944158c71fac2eba25894e2c8314c7d3cbafdd7139573fa55d01329497406701: Status 404 returned error can't find the container with id 944158c71fac2eba25894e2c8314c7d3cbafdd7139573fa55d01329497406701
Jul 11 03:49:36.760223 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:36.760196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4zrw"]
Jul 11 03:49:36.763251 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:36.763226    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadb1db3_28b0_4aeb_b615_ecf22880259d.slice/crio-dbc044c285768d77ce3199d254e0dee15a875e02b384159ca768a539d0f4f17f WatchSource:0}: Error finding container dbc044c285768d77ce3199d254e0dee15a875e02b384159ca768a539d0f4f17f: Status 404 returned error can't find the container with id dbc044c285768d77ce3199d254e0dee15a875e02b384159ca768a539d0f4f17f
Jul 11 03:49:37.119932 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.119888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc" event={"ID":"8069c608-4998-482c-b8d0-f6e7ae81c6a5","Type":"ContainerStarted","Data":"70533cb228e97a428e09f564ef5a8d953307c0b3f575a1bc587969192a6545d3"}
Jul 11 03:49:37.120707 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.119951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc" event={"ID":"8069c608-4998-482c-b8d0-f6e7ae81c6a5","Type":"ContainerStarted","Data":"af86133b5e104a525caff991c1601db8b3c177f940cc86aaa0bc4f6541b93759"}
Jul 11 03:49:37.120707 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.120081    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:37.121755 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.121729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjx8s" event={"ID":"cc3335fa-a8b4-46f9-9aae-c64185790e9c","Type":"ContainerStarted","Data":"b52366d96281a294ab2a7ad11432d42d8a51d08bf682d03fc1c12ea3f5805ab9"}
Jul 11 03:49:37.123097 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.123073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq4nj" event={"ID":"dad95498-e584-4b36-9f2a-4d3c25001f12","Type":"ContainerStarted","Data":"944158c71fac2eba25894e2c8314c7d3cbafdd7139573fa55d01329497406701"}
Jul 11 03:49:37.124441 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.124419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4zrw" event={"ID":"aadb1db3-28b0-4aeb-b615-ecf22880259d","Type":"ContainerStarted","Data":"dbc044c285768d77ce3199d254e0dee15a875e02b384159ca768a539d0f4f17f"}
Jul 11 03:49:37.147954 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.147892    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc" podStartSLOduration=6.147712007 podStartE2EDuration="6.147712007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:37.1470614 +0000 UTC m=+45.844333263" watchObservedRunningTime="2026-07-11 03:49:37.147712007 +0000 UTC m=+45.844983869"
Jul 11 03:49:37.782677 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.782650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:37.783140 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.783122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:37.783595 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.783575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:37.785610 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.785568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 03:49:37.786844 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.786822    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 03:49:37.787040 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.787024    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgqwh\""
Jul 11 03:49:37.787364 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.787348    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 03:49:37.787565 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.787547    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kfp2p\""
Jul 11 03:49:37.787792 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:37.787777    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 03:49:43.143582 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.143288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjx8s" event={"ID":"cc3335fa-a8b4-46f9-9aae-c64185790e9c","Type":"ContainerStarted","Data":"1d9a6f9d7504731f4186c77470178cd8fdd5f78698f013d7e5f52d88b5b94d84"}
Jul 11 03:49:43.145004 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.144976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq4nj" event={"ID":"dad95498-e584-4b36-9f2a-4d3c25001f12","Type":"ContainerStarted","Data":"89545877c3fb8c6206a96cd16ea5800e1f77011c5ef0e73c92dfd5893e1b8531"}
Jul 11 03:49:43.145107 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.145031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq4nj" event={"ID":"dad95498-e584-4b36-9f2a-4d3c25001f12","Type":"ContainerStarted","Data":"64e80853d3f9ebb0c6aeee7fd586aa6afdc3d296a2e7cd9acc93ef146f82a0d9"}
Jul 11 03:49:43.145107 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.145071    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:43.146592 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.146571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4zrw" event={"ID":"aadb1db3-28b0-4aeb-b615-ecf22880259d","Type":"ContainerStarted","Data":"f150af238b2cfb1683bffcf37443ec1e499115394a38932bff8c705d8264cb13"}
Jul 11 03:49:43.160967 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.160918    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bq4nj" podStartSLOduration=1.243164949 podStartE2EDuration="7.160900748s" totalImagesPullingTime="5.917735799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:43.160260637 +0000 UTC m=+51.857532510" watchObservedRunningTime="2026-07-11 03:49:43.160900748 +0000 UTC m=+51.858172611"
Jul 11 03:49:43.173640 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:43.173584    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r4zrw" podStartSLOduration=1.334501164 podStartE2EDuration="7.173562966s" totalImagesPullingTime="5.839061802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:43.173129461 +0000 UTC m=+51.870401322" watchObservedRunningTime="2026-07-11 03:49:43.173562966 +0000 UTC m=+51.870834831"
Jul 11 03:49:44.150760 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:44.150730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjx8s" event={"ID":"cc3335fa-a8b4-46f9-9aae-c64185790e9c","Type":"ContainerStarted","Data":"52d61898261d45db9fb65f7450f54b4e239b10248ed9df931b71c73ff5f29045"}
Jul 11 03:49:47.162648 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:47.162451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjx8s" event={"ID":"cc3335fa-a8b4-46f9-9aae-c64185790e9c","Type":"ContainerStarted","Data":"d0456327076bd0b1e9ec0f6038337bdb761be132b3915e2ae0a49d419d4e1f2f"}
Jul 11 03:49:47.179604 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:47.179552    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wjx8s" podStartSLOduration=1.306779683 podStartE2EDuration="11.179537084s" totalImagesPullingTime="9.872757401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:49:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:47.177674568 +0000 UTC m=+55.874946454" watchObservedRunningTime="2026-07-11 03:49:47.179537084 +0000 UTC m=+55.876808923"
Jul 11 03:49:50.532526 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.532490    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"]
Jul 11 03:49:50.535428 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.535407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.538114 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.538092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 11 03:49:50.538275 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.538255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 11 03:49:50.538413 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.538396    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 03:49:50.539656 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.539640    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j7ttl\""
Jul 11 03:49:50.539722 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.539706    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 03:49:50.539722 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.539715    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 03:49:50.541885 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.541867    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4zz9g"]
Jul 11 03:49:50.544064 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.544039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.545296 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.545277    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"]
Jul 11 03:49:50.546869 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.546846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 03:49:50.546976 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.546891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zqpj\""
Jul 11 03:49:50.547035 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.546992    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 03:49:50.547084 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.546848    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 03:49:50.548407 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.548390    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"]
Jul 11 03:49:50.550671 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.550523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.552750 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.552732    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 11 03:49:50.553193 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.553177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 11 03:49:50.553292 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.553183    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 11 03:49:50.553292 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.553276    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x7rmk\""
Jul 11 03:49:50.561861 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.561839    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"]
Jul 11 03:49:50.614611 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-wtmp\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.614790 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.614790 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.614790 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czlx4\" (UniqueName: \"kubernetes.io/projected/35335482-699b-4fc9-890a-e07dec5dd705-kube-api-access-czlx4\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.614790 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.614790 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.614790 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35335482-699b-4fc9-890a-e07dec5dd705-metrics-client-ca\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b662590-c854-4eea-ab19-095510466106-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b662590-c854-4eea-ab19-095510466106-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-textfile\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.614995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dtvx\" (UniqueName: \"kubernetes.io/projected/7b662590-c854-4eea-ab19-095510466106-kube-api-access-8dtvx\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.615021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.615040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b662590-c854-4eea-ab19-095510466106-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.615072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6rpj\" (UniqueName: \"kubernetes.io/projected/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-api-access-h6rpj\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.615096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-sys\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.615263 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.615112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-root\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.716270 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.716270 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czlx4\" (UniqueName: \"kubernetes.io/projected/35335482-699b-4fc9-890a-e07dec5dd705-kube-api-access-czlx4\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35335482-699b-4fc9-890a-e07dec5dd705-metrics-client-ca\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b662590-c854-4eea-ab19-095510466106-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b662590-c854-4eea-ab19-095510466106-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:50.716459    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 03:49:50.716547 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-textfile\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.716955 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:50.716621    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls podName:35335482-699b-4fc9-890a-e07dec5dd705 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:51.216597383 +0000 UTC m=+59.913869238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls") pod "node-exporter-4zz9g" (UID: "35335482-699b-4fc9-890a-e07dec5dd705") : secret "node-exporter-tls" not found
Jul 11 03:49:50.716955 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.716955 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.716955 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.716955 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dtvx\" (UniqueName: \"kubernetes.io/projected/7b662590-c854-4eea-ab19-095510466106-kube-api-access-8dtvx\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.717206 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.716997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717206 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b662590-c854-4eea-ab19-095510466106-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.717206 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6rpj\" (UniqueName: \"kubernetes.io/projected/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-api-access-h6rpj\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.717206 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.717206 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.717535 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-sys\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717535 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b662590-c854-4eea-ab19-095510466106-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.717535 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-textfile\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717535 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-root\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717535 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-root\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717773 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:50.717562    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 11 03:49:50.717773 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:50.717611    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-tls podName:84edfff7-1ffa-47df-9ce8-b89fbd6c6368 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:51.217596331 +0000 UTC m=+59.914868175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-5kqjh" (UID: "84edfff7-1ffa-47df-9ce8-b89fbd6c6368") : secret "kube-state-metrics-tls" not found
Jul 11 03:49:50.717773 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35335482-699b-4fc9-890a-e07dec5dd705-metrics-client-ca\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717773 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-sys\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717773 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-wtmp\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.717773 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.718043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.717846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-wtmp\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.721813 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.721780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.721924 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.721781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.721924 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.721838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b662590-c854-4eea-ab19-095510466106-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.721924 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.721859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b662590-c854-4eea-ab19-095510466106-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.724843 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.724812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czlx4\" (UniqueName: \"kubernetes.io/projected/35335482-699b-4fc9-890a-e07dec5dd705-kube-api-access-czlx4\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:50.725112 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.725095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6rpj\" (UniqueName: \"kubernetes.io/projected/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-api-access-h6rpj\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:50.725228 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.725212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dtvx\" (UniqueName: \"kubernetes.io/projected/7b662590-c854-4eea-ab19-095510466106-kube-api-access-8dtvx\") pod \"openshift-state-metrics-84bd68b896-fcx85\" (UID: \"7b662590-c854-4eea-ab19-095510466106\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.845297 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.845254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"
Jul 11 03:49:50.974372 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:50.974226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85"]
Jul 11 03:49:50.976931 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:50.976909    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b662590_c854_4eea_ab19_095510466106.slice/crio-4d6710d2ccc696db2958625155e8c9aaf9022c829b107e4f719de8cb730cdcaa WatchSource:0}: Error finding container 4d6710d2ccc696db2958625155e8c9aaf9022c829b107e4f719de8cb730cdcaa: Status 404 returned error can't find the container with id 4d6710d2ccc696db2958625155e8c9aaf9022c829b107e4f719de8cb730cdcaa
Jul 11 03:49:51.175497 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.175416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85" event={"ID":"7b662590-c854-4eea-ab19-095510466106","Type":"ContainerStarted","Data":"ebff6218a727b7164f087657bc3161faad1a05e27ca03689c0062aeacc5e0be3"}
Jul 11 03:49:51.175497 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.175470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85" event={"ID":"7b662590-c854-4eea-ab19-095510466106","Type":"ContainerStarted","Data":"5355c4bdcfad44026813ef6326f4f908c74bcebfd9171a4b54cdd411f32c520a"}
Jul 11 03:49:51.175497 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.175491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85" event={"ID":"7b662590-c854-4eea-ab19-095510466106","Type":"ContainerStarted","Data":"4d6710d2ccc696db2958625155e8c9aaf9022c829b107e4f719de8cb730cdcaa"}
Jul 11 03:49:51.221972 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.221943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:51.222093 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.221989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:51.222153 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:51.222116    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 03:49:51.222194 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:49:51.222185    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls podName:35335482-699b-4fc9-890a-e07dec5dd705 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:52.222167012 +0000 UTC m=+60.919438855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls") pod "node-exporter-4zz9g" (UID: "35335482-699b-4fc9-890a-e07dec5dd705") : secret "node-exporter-tls" not found
Jul 11 03:49:51.224289 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.224259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84edfff7-1ffa-47df-9ce8-b89fbd6c6368-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5kqjh\" (UID: \"84edfff7-1ffa-47df-9ce8-b89fbd6c6368\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:51.459599 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.459517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"
Jul 11 03:49:51.588679 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:51.588641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5kqjh"]
Jul 11 03:49:51.591613 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:51.591589    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84edfff7_1ffa_47df_9ce8_b89fbd6c6368.slice/crio-c5a5ba752a56e1484b59c902803f77820b579e4adaaeef93ffab989a14a9d883 WatchSource:0}: Error finding container c5a5ba752a56e1484b59c902803f77820b579e4adaaeef93ffab989a14a9d883: Status 404 returned error can't find the container with id c5a5ba752a56e1484b59c902803f77820b579e4adaaeef93ffab989a14a9d883
Jul 11 03:49:52.180609 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:52.180568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh" event={"ID":"84edfff7-1ffa-47df-9ce8-b89fbd6c6368","Type":"ContainerStarted","Data":"c5a5ba752a56e1484b59c902803f77820b579e4adaaeef93ffab989a14a9d883"}
Jul 11 03:49:52.232911 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:52.232887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:52.235149 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:52.235125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35335482-699b-4fc9-890a-e07dec5dd705-node-exporter-tls\") pod \"node-exporter-4zz9g\" (UID: \"35335482-699b-4fc9-890a-e07dec5dd705\") " pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:52.356473 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:52.356441    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zqpj\""
Jul 11 03:49:52.364260 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:52.364239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4zz9g"
Jul 11 03:49:52.373399 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:52.373371    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35335482_699b_4fc9_890a_e07dec5dd705.slice/crio-cb2881301487ae3c15ffa4b64478f0bb8b73df3ac8df97d427ed45033c1ef539 WatchSource:0}: Error finding container cb2881301487ae3c15ffa4b64478f0bb8b73df3ac8df97d427ed45033c1ef539: Status 404 returned error can't find the container with id cb2881301487ae3c15ffa4b64478f0bb8b73df3ac8df97d427ed45033c1ef539
Jul 11 03:49:53.088578 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.088546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l5tn"
Jul 11 03:49:53.153549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.153515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bq4nj"
Jul 11 03:49:53.186660 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.186624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zz9g" event={"ID":"35335482-699b-4fc9-890a-e07dec5dd705","Type":"ContainerStarted","Data":"cb2881301487ae3c15ffa4b64478f0bb8b73df3ac8df97d427ed45033c1ef539"}
Jul 11 03:49:53.189006 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.188947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85" event={"ID":"7b662590-c854-4eea-ab19-095510466106","Type":"ContainerStarted","Data":"35dbca256eabe0d96ea05a3c51147809c27991f00f0083f27889727cf7ec8954"}
Jul 11 03:49:53.207953 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.207900    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fcx85" podStartSLOduration=2.07672978 podStartE2EDuration="3.207880039s" totalImagesPullingTime="1.131150259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:53.206780087 +0000 UTC m=+61.904051962" watchObservedRunningTime="2026-07-11 03:49:53.207880039 +0000 UTC m=+61.905151902"
Jul 11 03:49:53.514399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.513791    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6548744f4b-ffmfr"]
Jul 11 03:49:53.519023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.518980    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.522429 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.521832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kg5tl\""
Jul 11 03:49:53.522429 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.522039    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 11 03:49:53.522429 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.522070    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 11 03:49:53.522429 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.522293    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 11 03:49:53.522429 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.522366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 11 03:49:53.522741 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.522479    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 11 03:49:53.522903 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.522826    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-30hvegj6dutts\""
Jul 11 03:49:53.531579 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.531529    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6548744f4b-ffmfr"]
Jul 11 03:49:53.645706 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.645682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.645796 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.645744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e37fa09-7e2c-472f-b7e3-329aaab48897-metrics-client-ca\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.645867 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.645792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-tls\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.645922 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.645874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.645922 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.645899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpr5\" (UniqueName: \"kubernetes.io/projected/6e37fa09-7e2c-472f-b7e3-329aaab48897-kube-api-access-fbpr5\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.646015 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.645937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.646068 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.646032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-grpc-tls\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.646068 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.646059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.746797 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e37fa09-7e2c-472f-b7e3-329aaab48897-metrics-client-ca\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.746993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-tls\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.746993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.746993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpr5\" (UniqueName: \"kubernetes.io/projected/6e37fa09-7e2c-472f-b7e3-329aaab48897-kube-api-access-fbpr5\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.746993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.746993 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-grpc-tls\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.747298 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.746999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.747298 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.747067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.747752 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.747722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e37fa09-7e2c-472f-b7e3-329aaab48897-metrics-client-ca\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.750163 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.750131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.750289 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.750187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.750289 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.750206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-tls\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.750496 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.750474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-grpc-tls\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.750632 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.750606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.750632 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.750620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e37fa09-7e2c-472f-b7e3-329aaab48897-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.757568 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.757542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpr5\" (UniqueName: \"kubernetes.io/projected/6e37fa09-7e2c-472f-b7e3-329aaab48897-kube-api-access-fbpr5\") pod \"thanos-querier-6548744f4b-ffmfr\" (UID: \"6e37fa09-7e2c-472f-b7e3-329aaab48897\") " pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:53.934739 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:53.934638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:54.065213 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.065181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6548744f4b-ffmfr"]
Jul 11 03:49:54.068060 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:54.068035    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e37fa09_7e2c_472f_b7e3_329aaab48897.slice/crio-5fe0d95989eec2a48c47fe9ee9ec9d861897e5e2c6fbb0beed606b2567763819 WatchSource:0}: Error finding container 5fe0d95989eec2a48c47fe9ee9ec9d861897e5e2c6fbb0beed606b2567763819: Status 404 returned error can't find the container with id 5fe0d95989eec2a48c47fe9ee9ec9d861897e5e2c6fbb0beed606b2567763819
Jul 11 03:49:54.198425 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.198304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh" event={"ID":"84edfff7-1ffa-47df-9ce8-b89fbd6c6368","Type":"ContainerStarted","Data":"e1609a58783d3a3b457ed46b9faec6b56b73e8e6ab3cc45feefc37f84001c525"}
Jul 11 03:49:54.198425 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.198419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh" event={"ID":"84edfff7-1ffa-47df-9ce8-b89fbd6c6368","Type":"ContainerStarted","Data":"923a7fc4213e4ec191bad946dd3f37a1f7acf4d0b764e16a9af63bd91220f00b"}
Jul 11 03:49:54.198873 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.198449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh" event={"ID":"84edfff7-1ffa-47df-9ce8-b89fbd6c6368","Type":"ContainerStarted","Data":"97895a0ed8887e39a45026be19e7c016e85b8b1f9ce002894f53868519b04910"}
Jul 11 03:49:54.199955 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.199930    2580 generic.go:356] "Generic (PLEG): container finished" podID="35335482-699b-4fc9-890a-e07dec5dd705" containerID="e380fd3a044bbab43a5bfb11b1d983f9cb5c3efb5792c0727a74881f78642b2d" exitCode=0
Jul 11 03:49:54.200068 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.200002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zz9g" event={"ID":"35335482-699b-4fc9-890a-e07dec5dd705","Type":"ContainerDied","Data":"e380fd3a044bbab43a5bfb11b1d983f9cb5c3efb5792c0727a74881f78642b2d"}
Jul 11 03:49:54.201180 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.201154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"5fe0d95989eec2a48c47fe9ee9ec9d861897e5e2c6fbb0beed606b2567763819"}
Jul 11 03:49:54.215469 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.215420    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-5kqjh" podStartSLOduration=2.431235133 podStartE2EDuration="4.215403694s" totalImagesPullingTime="1.784168561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:54.21428803 +0000 UTC m=+62.911559931" watchObservedRunningTime="2026-07-11 03:49:54.215403694 +0000 UTC m=+62.912675556"
Jul 11 03:49:54.847543 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.847507    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56594db87b-dz5v4"]
Jul 11 03:49:54.849599 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.849579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.853081 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.853046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-68rvve7qd51bc\""
Jul 11 03:49:54.853081 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.853046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 11 03:49:54.853285 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.853094    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 11 03:49:54.853285 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.853123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 11 03:49:54.853285 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.853128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 11 03:49:54.853285 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.853176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5w74b\""
Jul 11 03:49:54.860350 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.860305    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56594db87b-dz5v4"]
Jul 11 03:49:54.959740 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-secret-metrics-server-tls\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.959908 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-secret-metrics-server-client-certs\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.959908 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c016e0fc-eb91-40db-9c76-ebf87ebc933d-audit-log\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.960043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c016e0fc-eb91-40db-9c76-ebf87ebc933d-metrics-server-audit-profiles\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.960043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c016e0fc-eb91-40db-9c76-ebf87ebc933d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.960043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-client-ca-bundle\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:54.960043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:54.959984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvqp\" (UniqueName: \"kubernetes.io/projected/c016e0fc-eb91-40db-9c76-ebf87ebc933d-kube-api-access-7bvqp\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.060930 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.060892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c016e0fc-eb91-40db-9c76-ebf87ebc933d-metrics-server-audit-profiles\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.060930 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.060938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c016e0fc-eb91-40db-9c76-ebf87ebc933d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.060962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-client-ca-bundle\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.061028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvqp\" (UniqueName: \"kubernetes.io/projected/c016e0fc-eb91-40db-9c76-ebf87ebc933d-kube-api-access-7bvqp\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.061113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-secret-metrics-server-tls\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061184 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.061140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-secret-metrics-server-client-certs\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061407 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.061193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c016e0fc-eb91-40db-9c76-ebf87ebc933d-audit-log\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061809 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.061760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c016e0fc-eb91-40db-9c76-ebf87ebc933d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.061809 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.061769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c016e0fc-eb91-40db-9c76-ebf87ebc933d-audit-log\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.062465 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.062443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c016e0fc-eb91-40db-9c76-ebf87ebc933d-metrics-server-audit-profiles\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.063774 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.063748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-client-ca-bundle\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.064226 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.064207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-secret-metrics-server-tls\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.064303 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.064225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c016e0fc-eb91-40db-9c76-ebf87ebc933d-secret-metrics-server-client-certs\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.069258 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.069227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvqp\" (UniqueName: \"kubernetes.io/projected/c016e0fc-eb91-40db-9c76-ebf87ebc933d-kube-api-access-7bvqp\") pod \"metrics-server-56594db87b-dz5v4\" (UID: \"c016e0fc-eb91-40db-9c76-ebf87ebc933d\") " pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.160563 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.160474    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:49:55.208938 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.208907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zz9g" event={"ID":"35335482-699b-4fc9-890a-e07dec5dd705","Type":"ContainerStarted","Data":"17f1487d0abce9f7d0f6e7103bd16bd76c9da3fe874b1e3916ee0f8ec092fb93"}
Jul 11 03:49:55.209411 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.208967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zz9g" event={"ID":"35335482-699b-4fc9-890a-e07dec5dd705","Type":"ContainerStarted","Data":"c6e759a4fcf9deb86959c64d95314fd9b6b209ba5a02f820d9b210ff0bdbbaae"}
Jul 11 03:49:55.318503 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.318434    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4zz9g" podStartSLOduration=4.224102605 podStartE2EDuration="5.318412895s" totalImagesPullingTime="1.003408091s" totalInitContainerRuntime="90.902199ms" isStatefulPod=true podCreationTimestamp="2026-07-11 03:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:55.229104923 +0000 UTC m=+63.926376806" watchObservedRunningTime="2026-07-11 03:49:55.318412895 +0000 UTC m=+64.015684756"
Jul 11 03:49:55.318757 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:55.318742    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56594db87b-dz5v4"]
Jul 11 03:49:55.321456 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:55.321420    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc016e0fc_eb91_40db_9c76_ebf87ebc933d.slice/crio-ceace9140349774e4f1b529bfd18a974cfe7d7e04a611be2c0027854caa003be WatchSource:0}: Error finding container ceace9140349774e4f1b529bfd18a974cfe7d7e04a611be2c0027854caa003be: Status 404 returned error can't find the container with id ceace9140349774e4f1b529bfd18a974cfe7d7e04a611be2c0027854caa003be
Jul 11 03:49:56.213190 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.213162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4" event={"ID":"c016e0fc-eb91-40db-9c76-ebf87ebc933d","Type":"ContainerStarted","Data":"ceace9140349774e4f1b529bfd18a974cfe7d7e04a611be2c0027854caa003be"}
Jul 11 03:49:56.474412 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.474290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:56.474412 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.474410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:56.474636 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.474473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:56.477401 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.477374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 03:49:56.478419 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.478391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 03:49:56.478535 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.478417    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 03:49:56.486905 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.486876    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 03:49:56.487706 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.487679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f332a94-9880-44f5-98a5-deee84e855a6-original-pull-secret\") pod \"global-pull-secret-syncer-wcqn5\" (UID: \"6f332a94-9880-44f5-98a5-deee84e855a6\") " pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:56.488056 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.488029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc53e74-81fc-4fa2-b0a9-b65bb79b679e-metrics-certs\") pod \"network-metrics-daemon-8srd5\" (UID: \"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e\") " pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:56.498112 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.498046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk6ck\" (UniqueName: \"kubernetes.io/projected/31cd7ae8-b2d0-478a-a5d5-60e325657cdc-kube-api-access-jk6ck\") pod \"network-check-target-tmbqw\" (UID: \"31cd7ae8-b2d0-478a-a5d5-60e325657cdc\") " pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:56.700913 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.700871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcqn5"
Jul 11 03:49:56.713434 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.713407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgqwh\""
Jul 11 03:49:56.719338 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.719295    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kfp2p\""
Jul 11 03:49:56.721189 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.721157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8srd5"
Jul 11 03:49:56.730006 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.729935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:49:56.767214 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.767108    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 03:49:56.772250 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.772219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.775444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.775099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 11 03:49:56.775444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.775099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 11 03:49:56.775444 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.775339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 11 03:49:56.775944 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.775751    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 11 03:49:56.775944 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.775800    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 11 03:49:56.775944 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.775885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 11 03:49:56.776668 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.776479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 11 03:49:56.777173 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.776960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 11 03:49:56.777173 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.776998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qtff8\""
Jul 11 03:49:56.777173 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.777006    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 11 03:49:56.777173 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.777096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 11 03:49:56.777453 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.777401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 11 03:49:56.777453 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.777408    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 11 03:49:56.777542 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.777508    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 11 03:49:56.777593 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.777507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c89ls5t01tale\""
Jul 11 03:49:56.779361 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.779340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 11 03:49:56.786967 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.786940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 03:49:56.848830 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.848799    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wcqn5"]
Jul 11 03:49:56.876920 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.876877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.876920 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.876920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877157 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.876949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877157 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.876976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877157 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmzt\" (UniqueName: \"kubernetes.io/projected/7457f081-b564-4f92-b98e-da8339c800d2-kube-api-access-pwmzt\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877157 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7457f081-b564-4f92-b98e-da8339c800d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877157 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877399 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877710 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-config\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877710 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7457f081-b564-4f92-b98e-da8339c800d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877710 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877710 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.877710 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.877546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.978987 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.978948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-config\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.978993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7457f081-b564-4f92-b98e-da8339c800d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmzt\" (UniqueName: \"kubernetes.io/projected/7457f081-b564-4f92-b98e-da8339c800d2-kube-api-access-pwmzt\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7457f081-b564-4f92-b98e-da8339c800d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.979549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.980092 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.979582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.980092 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.980011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.980212 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.980113    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.980346 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.980297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.980641 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.980617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.980906 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.980881    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.982600 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.981994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.982600 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.982290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.983233 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.983163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-config\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.983233 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.983171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7457f081-b564-4f92-b98e-da8339c800d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.983698 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.983674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.983785 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.983757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.983842 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.983801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.983946 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.983920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7457f081-b564-4f92-b98e-da8339c800d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.984634 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.984608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.984996 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.984971    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7457f081-b564-4f92-b98e-da8339c800d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.985112 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.985090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.985236 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.985218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.985640 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.985620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.985733 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.985715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7457f081-b564-4f92-b98e-da8339c800d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:56.994558 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:56.994531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmzt\" (UniqueName: \"kubernetes.io/projected/7457f081-b564-4f92-b98e-da8339c800d2-kube-api-access-pwmzt\") pod \"prometheus-k8s-0\" (UID: \"7457f081-b564-4f92-b98e-da8339c800d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:57.085905 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.085862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:49:57.120523 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:57.120480    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f332a94_9880_44f5_98a5_deee84e855a6.slice/crio-97c8c6d93bbd8ac7837bfa26a06a6a0c20e9ce67f2f13d35a3148e607f7893e0 WatchSource:0}: Error finding container 97c8c6d93bbd8ac7837bfa26a06a6a0c20e9ce67f2f13d35a3148e607f7893e0: Status 404 returned error can't find the container with id 97c8c6d93bbd8ac7837bfa26a06a6a0c20e9ce67f2f13d35a3148e607f7893e0
Jul 11 03:49:57.223177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.222891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"e458b9249ae298d051887e106806c609e3b721806afbf175566ea6772fa0a180"}
Jul 11 03:49:57.223177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.222977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"9267cfca9b09bb7a971d602726ad87d890e72d2dfa025e791af5ce3380a9bafc"}
Jul 11 03:49:57.223177 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.223020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"00bd53f4e4d2dfb837d02f38c59cff50fc186b72352beba77289e4aa06fe4553"}
Jul 11 03:49:57.225220 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.225162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wcqn5" event={"ID":"6f332a94-9880-44f5-98a5-deee84e855a6","Type":"ContainerStarted","Data":"97c8c6d93bbd8ac7837bfa26a06a6a0c20e9ce67f2f13d35a3148e607f7893e0"}
Jul 11 03:49:57.274778 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.274681    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8srd5"]
Jul 11 03:49:57.280418 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:57.280385    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc53e74_81fc_4fa2_b0a9_b65bb79b679e.slice/crio-af796f533b2d07a8273f9d31e8133cbaf128b5c15b5522a1f886e856f317b3f7 WatchSource:0}: Error finding container af796f533b2d07a8273f9d31e8133cbaf128b5c15b5522a1f886e856f317b3f7: Status 404 returned error can't find the container with id af796f533b2d07a8273f9d31e8133cbaf128b5c15b5522a1f886e856f317b3f7
Jul 11 03:49:57.297934 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.297888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tmbqw"]
Jul 11 03:49:57.300932 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:57.300909    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cd7ae8_b2d0_478a_a5d5_60e325657cdc.slice/crio-f344c51ddaa32d596614f8f8b74d742a00795233cc23257c1f782f48eec56766 WatchSource:0}: Error finding container f344c51ddaa32d596614f8f8b74d742a00795233cc23257c1f782f48eec56766: Status 404 returned error can't find the container with id f344c51ddaa32d596614f8f8b74d742a00795233cc23257c1f782f48eec56766
Jul 11 03:49:57.310871 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:57.310754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 11 03:49:57.313793 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:49:57.313764    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7457f081_b564_4f92_b98e_da8339c800d2.slice/crio-11ecbbf7318dd2b462528c743cb86887a72a4e10a31ef8d56a0946f59f17cd98 WatchSource:0}: Error finding container 11ecbbf7318dd2b462528c743cb86887a72a4e10a31ef8d56a0946f59f17cd98: Status 404 returned error can't find the container with id 11ecbbf7318dd2b462528c743cb86887a72a4e10a31ef8d56a0946f59f17cd98
Jul 11 03:49:58.136338 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.135518    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-746dcb8c78-vznmc"
Jul 11 03:49:58.232237 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.232199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4" event={"ID":"c016e0fc-eb91-40db-9c76-ebf87ebc933d","Type":"ContainerStarted","Data":"048f0351bcb3d7d0e2d22483e767ef80e92c346accb7bfe36ddefe4c82dfc8e8"}
Jul 11 03:49:58.234249 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.234165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tmbqw" event={"ID":"31cd7ae8-b2d0-478a-a5d5-60e325657cdc","Type":"ContainerStarted","Data":"f344c51ddaa32d596614f8f8b74d742a00795233cc23257c1f782f48eec56766"}
Jul 11 03:49:58.236715 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.236683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8srd5" event={"ID":"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e","Type":"ContainerStarted","Data":"af796f533b2d07a8273f9d31e8133cbaf128b5c15b5522a1f886e856f317b3f7"}
Jul 11 03:49:58.238720 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.238690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"11ecbbf7318dd2b462528c743cb86887a72a4e10a31ef8d56a0946f59f17cd98"}
Jul 11 03:49:58.243607 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.243511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"39fff6b32cb4f08da4ea5bc04355d48eb85db1f5a8aeed5299a1387d54d93961"}
Jul 11 03:49:58.243607 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.243591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"c47bc41e4d42592099e06c679ac830706f7d46f9b2e91ba67c4ca1e369d8a53a"}
Jul 11 03:49:58.243807 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.243630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" event={"ID":"6e37fa09-7e2c-472f-b7e3-329aaab48897","Type":"ContainerStarted","Data":"9b80eea5ed2dd981e079c5fe72c655cbeed7f480c71fb9e3382a24f9e59f386c"}
Jul 11 03:49:58.244167 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.243953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:49:58.250147 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.249966    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4" podStartSLOduration=2.422679274 podStartE2EDuration="4.249943524s" totalImagesPullingTime="1.82726425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:58.247623742 +0000 UTC m=+66.944895605" watchObservedRunningTime="2026-07-11 03:49:58.249943524 +0000 UTC m=+66.947215382"
Jul 11 03:49:58.266674 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:58.266608    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr" podStartSLOduration=1.920413806 podStartE2EDuration="5.266585196s" totalImagesPullingTime="3.34617139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:58.265726514 +0000 UTC m=+66.962998378" watchObservedRunningTime="2026-07-11 03:49:58.266585196 +0000 UTC m=+66.963857059"
Jul 11 03:49:59.251737 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:59.251651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8srd5" event={"ID":"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e","Type":"ContainerStarted","Data":"eb04553b963e813e6bb0bbf8dd5783cf2915ac4faecadc4dff0833ec121f55c0"}
Jul 11 03:49:59.251737 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:59.251723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8srd5" event={"ID":"cfc53e74-81fc-4fa2-b0a9-b65bb79b679e","Type":"ContainerStarted","Data":"39949070803df91b1ae1dd02e4ab8963acc96b913bf5d4b7dafdd23d9d37ad45"}
Jul 11 03:49:59.253409 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:59.253383    2580 generic.go:356] "Generic (PLEG): container finished" podID="7457f081-b564-4f92-b98e-da8339c800d2" containerID="13e7c8c36e6ae33259835143b9c2be28b391bb896a162a985deed6d3f217c8f4" exitCode=0
Jul 11 03:49:59.253539 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:59.253463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerDied","Data":"13e7c8c36e6ae33259835143b9c2be28b391bb896a162a985deed6d3f217c8f4"}
Jul 11 03:49:59.270027 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:49:59.269476    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8srd5" podStartSLOduration=65.752342832 podStartE2EDuration="1m7.269444204s" totalImagesPullingTime="1.517101372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:59.267749333 +0000 UTC m=+67.965021196" watchObservedRunningTime="2026-07-11 03:49:59.269444204 +0000 UTC m=+67.966716069"
Jul 11 03:50:04.260099 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.260070    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6548744f4b-ffmfr"
Jul 11 03:50:04.274070 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.274038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wcqn5" event={"ID":"6f332a94-9880-44f5-98a5-deee84e855a6","Type":"ContainerStarted","Data":"cd7986dfd139e9965d241534c26535239c0aff573106fa71ddcc7c2e50d5a4fb"}
Jul 11 03:50:04.275560 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.275532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tmbqw" event={"ID":"31cd7ae8-b2d0-478a-a5d5-60e325657cdc","Type":"ContainerStarted","Data":"e39f92cd217545e3ca5eba02ddbfbd96746e2df16f0c36991a2c716b8b47c85d"}
Jul 11 03:50:04.275677 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.275612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:50:04.278796 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.278776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"2921133248a5fad86657e87757d109efd4f61fff8b4ed5de2c226ca8ebc9bd5f"}
Jul 11 03:50:04.278899 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.278830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"794629ae1e741210b5a7bffcd2929c076f243a5048b4c4ec71e1df04ee307acb"}
Jul 11 03:50:04.278899 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.278867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"f405de08fde7d78370af0bca06f66d2c984f09579692ad1e1fb5dfd8f0cf8ee6"}
Jul 11 03:50:04.278899 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.278893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"7632892ee5114726509fc9c24788527ff72fc41cb18e3a5bce043bf7129ee7ce"}
Jul 11 03:50:04.278997 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.278915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"7cb3e8b1ecfe7f3ae150bd7b6b66d9753e56760c373c460fd1e7df27888b2cff"}
Jul 11 03:50:04.278997 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.278947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7457f081-b564-4f92-b98e-da8339c800d2","Type":"ContainerStarted","Data":"a04fcd75e96ef1122ee75f4354f7c775525ad53f8e7978032fe0cb058b98af1c"}
Jul 11 03:50:04.301041 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.300987    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wcqn5" podStartSLOduration=65.925241169 podStartE2EDuration="1m12.300971441s" totalImagesPullingTime="6.375730272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:04.299831851 +0000 UTC m=+72.997103738" watchObservedRunningTime="2026-07-11 03:50:04.300971441 +0000 UTC m=+72.998243302"
Jul 11 03:50:04.334334 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.331035    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.53058333 podStartE2EDuration="8.331010628s" totalImagesPullingTime="5.770457612s" totalInitContainerRuntime="29.969686ms" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:04.328747969 +0000 UTC m=+73.026019833" watchObservedRunningTime="2026-07-11 03:50:04.331010628 +0000 UTC m=+73.028282567"
Jul 11 03:50:04.346736 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:04.346545    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tmbqw" podStartSLOduration=66.149813221 podStartE2EDuration="1m12.346524439s" totalImagesPullingTime="6.196711218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:04.346276718 +0000 UTC m=+73.043548581" watchObservedRunningTime="2026-07-11 03:50:04.346524439 +0000 UTC m=+73.043796301"
Jul 11 03:50:07.086952 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:07.086908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:50:15.161374 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:15.161109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:50:15.161374 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:15.161171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:50:35.166446 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:35.166411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:50:35.170387 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:35.170361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56594db87b-dz5v4"
Jul 11 03:50:35.285589 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:35.285559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tmbqw"
Jul 11 03:50:57.086145 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:57.086107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:50:57.105221 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:57.105192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:50:57.493125 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:50:57.493052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 11 03:52:42.172662 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.172629    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"]
Jul 11 03:52:42.175016 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.174999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.178138 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.178108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 11 03:52:42.179198 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.179170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 11 03:52:42.179341 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.179222    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 11 03:52:42.179341 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.179283    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:52:42.179564 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.179543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 11 03:52:42.179645 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.179598    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fmr67\""
Jul 11 03:52:42.186080 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.186057    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"]
Jul 11 03:52:42.288106 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.288079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868mt\" (UniqueName: \"kubernetes.io/projected/fec3e105-d00d-4ec2-9049-7256946a5d61-kube-api-access-868mt\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.288239 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.288117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fec3e105-d00d-4ec2-9049-7256946a5d61-manager-config\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.288239 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.288182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec3e105-d00d-4ec2-9049-7256946a5d61-cert\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.288239 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.288223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fec3e105-d00d-4ec2-9049-7256946a5d61-metrics-cert\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.389394 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.389356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fec3e105-d00d-4ec2-9049-7256946a5d61-metrics-cert\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.389497 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.389411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-868mt\" (UniqueName: \"kubernetes.io/projected/fec3e105-d00d-4ec2-9049-7256946a5d61-kube-api-access-868mt\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.389497 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.389438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fec3e105-d00d-4ec2-9049-7256946a5d61-manager-config\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.389582 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.389561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec3e105-d00d-4ec2-9049-7256946a5d61-cert\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.390019 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.389993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fec3e105-d00d-4ec2-9049-7256946a5d61-manager-config\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.391807 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.391789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fec3e105-d00d-4ec2-9049-7256946a5d61-metrics-cert\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.391919 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.391899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec3e105-d00d-4ec2-9049-7256946a5d61-cert\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.400032 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.400011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-868mt\" (UniqueName: \"kubernetes.io/projected/fec3e105-d00d-4ec2-9049-7256946a5d61-kube-api-access-868mt\") pod \"lws-controller-manager-84fcd84596-7n7lz\" (UID: \"fec3e105-d00d-4ec2-9049-7256946a5d61\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.489525 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.489447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:42.621013 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.620987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"]
Jul 11 03:52:42.622250 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:52:42.622218    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec3e105_d00d_4ec2_9049_7256946a5d61.slice/crio-c9740dfc37db1b0ddf38889a934ef5d357b4476049293df83cc33c7c72441537 WatchSource:0}: Error finding container c9740dfc37db1b0ddf38889a934ef5d357b4476049293df83cc33c7c72441537: Status 404 returned error can't find the container with id c9740dfc37db1b0ddf38889a934ef5d357b4476049293df83cc33c7c72441537
Jul 11 03:52:42.634816 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.634794    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"]
Jul 11 03:52:42.637531 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.637517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.639875 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.639854    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 11 03:52:42.640133 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.640116    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 11 03:52:42.640256 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.640150    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 11 03:52:42.640256 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.640194    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 11 03:52:42.640256 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.640151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-frqbb\""
Jul 11 03:52:42.652813 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.652777    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"]
Jul 11 03:52:42.793668 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.793650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/effd8fd2-a382-4a26-b418-a5ef814983d1-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.793792 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.793680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2q5n\" (UniqueName: \"kubernetes.io/projected/effd8fd2-a382-4a26-b418-a5ef814983d1-kube-api-access-w2q5n\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.793792 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.793704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/effd8fd2-a382-4a26-b418-a5ef814983d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.793869 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.793796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/effd8fd2-a382-4a26-b418-a5ef814983d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.793869 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.793846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/effd8fd2-a382-4a26-b418-a5ef814983d1-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.857165 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.857132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz" event={"ID":"fec3e105-d00d-4ec2-9049-7256946a5d61","Type":"ContainerStarted","Data":"c9740dfc37db1b0ddf38889a934ef5d357b4476049293df83cc33c7c72441537"}
Jul 11 03:52:42.894599 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.894563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2q5n\" (UniqueName: \"kubernetes.io/projected/effd8fd2-a382-4a26-b418-a5ef814983d1-kube-api-access-w2q5n\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.894755 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.894610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/effd8fd2-a382-4a26-b418-a5ef814983d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.894755 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.894663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/effd8fd2-a382-4a26-b418-a5ef814983d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.894755 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.894709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/effd8fd2-a382-4a26-b418-a5ef814983d1-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.894911 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.894776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/effd8fd2-a382-4a26-b418-a5ef814983d1-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.895188 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.895166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/effd8fd2-a382-4a26-b418-a5ef814983d1-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.897043 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.897007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/effd8fd2-a382-4a26-b418-a5ef814983d1-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.897152 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.897135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/effd8fd2-a382-4a26-b418-a5ef814983d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.897198 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.897154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/effd8fd2-a382-4a26-b418-a5ef814983d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.904804 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.904786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2q5n\" (UniqueName: \"kubernetes.io/projected/effd8fd2-a382-4a26-b418-a5ef814983d1-kube-api-access-w2q5n\") pod \"opendatahub-operator-controller-manager-84f9769f6c-fgsth\" (UID: \"effd8fd2-a382-4a26-b418-a5ef814983d1\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:42.947718 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:42.947688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:43.076379 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:43.076288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"]
Jul 11 03:52:43.080336 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:52:43.080290    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffd8fd2_a382_4a26_b418_a5ef814983d1.slice/crio-8af8cf2de72a5c56ab74940f495d356ddb5e59d8efdaadd64f6da5ef5b17df0c WatchSource:0}: Error finding container 8af8cf2de72a5c56ab74940f495d356ddb5e59d8efdaadd64f6da5ef5b17df0c: Status 404 returned error can't find the container with id 8af8cf2de72a5c56ab74940f495d356ddb5e59d8efdaadd64f6da5ef5b17df0c
Jul 11 03:52:43.864660 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:43.864623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth" event={"ID":"effd8fd2-a382-4a26-b418-a5ef814983d1","Type":"ContainerStarted","Data":"8af8cf2de72a5c56ab74940f495d356ddb5e59d8efdaadd64f6da5ef5b17df0c"}
Jul 11 03:52:47.887141 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:47.887100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz" event={"ID":"fec3e105-d00d-4ec2-9049-7256946a5d61","Type":"ContainerStarted","Data":"56587a420663682a15c2284ddb9d29ee6e41fcb25b72f1788b7fd8888fe8d02d"}
Jul 11 03:52:47.887585 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:47.887229    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:52:47.888773 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:47.888751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth" event={"ID":"effd8fd2-a382-4a26-b418-a5ef814983d1","Type":"ContainerStarted","Data":"ea75d22ea29cb5375a2f21c8647bc118fc28b0a8fd6887e987cb24f625b65f47"}
Jul 11 03:52:47.903740 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:47.903694    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz" podStartSLOduration=1.589112343 podStartE2EDuration="5.903680475s" totalImagesPullingTime="4.314568132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:47.902591244 +0000 UTC m=+236.599863106" watchObservedRunningTime="2026-07-11 03:52:47.903680475 +0000 UTC m=+236.600952336"
Jul 11 03:52:48.894301 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:48.894267    2580 generic.go:356] "Generic (PLEG): container finished" podID="effd8fd2-a382-4a26-b418-a5ef814983d1" containerID="ea75d22ea29cb5375a2f21c8647bc118fc28b0a8fd6887e987cb24f625b65f47" exitCode=0
Jul 11 03:52:48.894743 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:48.894359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth" event={"ID":"effd8fd2-a382-4a26-b418-a5ef814983d1","Type":"ContainerDied","Data":"ea75d22ea29cb5375a2f21c8647bc118fc28b0a8fd6887e987cb24f625b65f47"}
Jul 11 03:52:49.899609 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:49.899572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth" event={"ID":"effd8fd2-a382-4a26-b418-a5ef814983d1","Type":"ContainerStarted","Data":"da70efd5e1c3fba945f0ba4bb012032e04da621e04d3bdc75725ee5e15d09ec3"}
Jul 11 03:52:49.900023 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:49.899687    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:52:49.920569 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:49.920517    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth" podStartSLOduration=2.693162494 podStartE2EDuration="7.920498109s" totalImagesPullingTime="4.210252605s" totalInitContainerRuntime="1.01708301s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:49.919757638 +0000 UTC m=+238.617029500" watchObservedRunningTime="2026-07-11 03:52:49.920498109 +0000 UTC m=+238.617769972"
Jul 11 03:52:58.897357 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:52:58.897301    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-7n7lz"
Jul 11 03:53:00.906117 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:00.906088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-fgsth"
Jul 11 03:53:08.103117 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.103084    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"]
Jul 11 03:53:08.116408 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.116371    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"]
Jul 11 03:53:08.116562 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.116470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.118808 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.118777    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 11 03:53:08.118955 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.118782    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5t74l\""
Jul 11 03:53:08.119835 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.119811    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 11 03:53:08.119943 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.119917    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 03:53:08.120054 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.120039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 03:53:08.204055 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.204017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02146b9e-e659-4160-be7c-076221038c5c-tls-certs\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.204055 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.204054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77ng\" (UniqueName: \"kubernetes.io/projected/02146b9e-e659-4160-be7c-076221038c5c-kube-api-access-v77ng\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.204290 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.204113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02146b9e-e659-4160-be7c-076221038c5c-tmp\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.305598 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.305562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02146b9e-e659-4160-be7c-076221038c5c-tls-certs\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.305598 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.305600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77ng\" (UniqueName: \"kubernetes.io/projected/02146b9e-e659-4160-be7c-076221038c5c-kube-api-access-v77ng\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.305772 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.305628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02146b9e-e659-4160-be7c-076221038c5c-tmp\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.307749 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.307722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02146b9e-e659-4160-be7c-076221038c5c-tmp\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.307979 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.307957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02146b9e-e659-4160-be7c-076221038c5c-tls-certs\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.313009 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.312980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77ng\" (UniqueName: \"kubernetes.io/projected/02146b9e-e659-4160-be7c-076221038c5c-kube-api-access-v77ng\") pod \"kube-auth-proxy-7b7c6c587f-6kht2\" (UID: \"02146b9e-e659-4160-be7c-076221038c5c\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.428174 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.428089    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"
Jul 11 03:53:08.572799 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.572769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2"]
Jul 11 03:53:08.576688 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:53:08.576657    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02146b9e_e659_4160_be7c_076221038c5c.slice/crio-698fd40a6c8c8283d816a19c11b9890c49fbf5115df07afcd79d0d769248d576 WatchSource:0}: Error finding container 698fd40a6c8c8283d816a19c11b9890c49fbf5115df07afcd79d0d769248d576: Status 404 returned error can't find the container with id 698fd40a6c8c8283d816a19c11b9890c49fbf5115df07afcd79d0d769248d576
Jul 11 03:53:08.973526 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:08.973493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2" event={"ID":"02146b9e-e659-4160-be7c-076221038c5c","Type":"ContainerStarted","Data":"698fd40a6c8c8283d816a19c11b9890c49fbf5115df07afcd79d0d769248d576"}
Jul 11 03:53:11.987234 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:11.987196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2" event={"ID":"02146b9e-e659-4160-be7c-076221038c5c","Type":"ContainerStarted","Data":"85f95ef2a6489f21c08f3b52799eef2520704b857d1d924fed59677d69e66332"}
Jul 11 03:53:12.002947 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:12.002894    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-6kht2" podStartSLOduration=1.487539039 podStartE2EDuration="4.002879032s" totalImagesPullingTime="2.515339993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:12.001844709 +0000 UTC m=+260.699116571" watchObservedRunningTime="2026-07-11 03:53:12.002879032 +0000 UTC m=+260.700150928"
Jul 11 03:53:17.690996 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.690908    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"]
Jul 11 03:53:17.694476 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.694457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.700337 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.699617    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 11 03:53:17.700337 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.699900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-c6j9g\""
Jul 11 03:53:17.741833 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.741765    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"]
Jul 11 03:53:17.744917 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.744893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:17.746936 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.746910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"]
Jul 11 03:53:17.752825 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.752799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 11 03:53:17.753038 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.752996    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-h5k65\""
Jul 11 03:53:17.777667 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.777635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"]
Jul 11 03:53:17.792845 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.792813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c98ns\" (UniqueName: \"kubernetes.io/projected/15c9e339-0713-4c70-baca-cf1c09d159a6-kube-api-access-c98ns\") pod \"kserve-controller-manager-d6f4b65b8-ffgjn\" (UID: \"15c9e339-0713-4c70-baca-cf1c09d159a6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.793008 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.792856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c9e339-0713-4c70-baca-cf1c09d159a6-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffgjn\" (UID: \"15c9e339-0713-4c70-baca-cf1c09d159a6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.894192 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.894149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwcd7\" (UniqueName: \"kubernetes.io/projected/1f75c234-f833-4192-be7c-5721434bc219-kube-api-access-wwcd7\") pod \"llmisvc-controller-manager-777c6bd7d5-xz7cj\" (UID: \"1f75c234-f833-4192-be7c-5721434bc219\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:17.894420 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.894208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f75c234-f833-4192-be7c-5721434bc219-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xz7cj\" (UID: \"1f75c234-f833-4192-be7c-5721434bc219\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:17.894420 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.894278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98ns\" (UniqueName: \"kubernetes.io/projected/15c9e339-0713-4c70-baca-cf1c09d159a6-kube-api-access-c98ns\") pod \"kserve-controller-manager-d6f4b65b8-ffgjn\" (UID: \"15c9e339-0713-4c70-baca-cf1c09d159a6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.894420 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.894358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c9e339-0713-4c70-baca-cf1c09d159a6-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffgjn\" (UID: \"15c9e339-0713-4c70-baca-cf1c09d159a6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.896763 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.896737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c9e339-0713-4c70-baca-cf1c09d159a6-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffgjn\" (UID: \"15c9e339-0713-4c70-baca-cf1c09d159a6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.902920 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.902888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c98ns\" (UniqueName: \"kubernetes.io/projected/15c9e339-0713-4c70-baca-cf1c09d159a6-kube-api-access-c98ns\") pod \"kserve-controller-manager-d6f4b65b8-ffgjn\" (UID: \"15c9e339-0713-4c70-baca-cf1c09d159a6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:17.995587 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.995488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwcd7\" (UniqueName: \"kubernetes.io/projected/1f75c234-f833-4192-be7c-5721434bc219-kube-api-access-wwcd7\") pod \"llmisvc-controller-manager-777c6bd7d5-xz7cj\" (UID: \"1f75c234-f833-4192-be7c-5721434bc219\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:17.995587 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.995537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f75c234-f833-4192-be7c-5721434bc219-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xz7cj\" (UID: \"1f75c234-f833-4192-be7c-5721434bc219\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:17.997963 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:17.997941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f75c234-f833-4192-be7c-5721434bc219-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xz7cj\" (UID: \"1f75c234-f833-4192-be7c-5721434bc219\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:18.002698 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:18.002675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwcd7\" (UniqueName: \"kubernetes.io/projected/1f75c234-f833-4192-be7c-5721434bc219-kube-api-access-wwcd7\") pod \"llmisvc-controller-manager-777c6bd7d5-xz7cj\" (UID: \"1f75c234-f833-4192-be7c-5721434bc219\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:18.007728 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:18.007711    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:18.056815 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:18.056787    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:18.148455 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:18.148411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"]
Jul 11 03:53:18.151071 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:53:18.151039    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c9e339_0713_4c70_baca_cf1c09d159a6.slice/crio-be5300660175e24d36411bd32aa980dbf243c6e273cf240b07b14f060bc31749 WatchSource:0}: Error finding container be5300660175e24d36411bd32aa980dbf243c6e273cf240b07b14f060bc31749: Status 404 returned error can't find the container with id be5300660175e24d36411bd32aa980dbf243c6e273cf240b07b14f060bc31749
Jul 11 03:53:18.194585 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:18.194561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"]
Jul 11 03:53:18.196988 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:53:18.196963    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f75c234_f833_4192_be7c_5721434bc219.slice/crio-8854ac3cbb1b3b5ea786728c54e4f095f9697d7fa0b42caf3f5e210e5b4c1d4f WatchSource:0}: Error finding container 8854ac3cbb1b3b5ea786728c54e4f095f9697d7fa0b42caf3f5e210e5b4c1d4f: Status 404 returned error can't find the container with id 8854ac3cbb1b3b5ea786728c54e4f095f9697d7fa0b42caf3f5e210e5b4c1d4f
Jul 11 03:53:19.018156 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:19.018065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn" event={"ID":"15c9e339-0713-4c70-baca-cf1c09d159a6","Type":"ContainerStarted","Data":"be5300660175e24d36411bd32aa980dbf243c6e273cf240b07b14f060bc31749"}
Jul 11 03:53:19.021676 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:19.021637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj" event={"ID":"1f75c234-f833-4192-be7c-5721434bc219","Type":"ContainerStarted","Data":"8854ac3cbb1b3b5ea786728c54e4f095f9697d7fa0b42caf3f5e210e5b4c1d4f"}
Jul 11 03:53:22.038027 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:22.037995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn" event={"ID":"15c9e339-0713-4c70-baca-cf1c09d159a6","Type":"ContainerStarted","Data":"619019d6fddb563635149839bad398d60d03d07923da3442dd6de3e9f8ef969d"}
Jul 11 03:53:22.038462 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:22.038090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:53:22.039598 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:22.039571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj" event={"ID":"1f75c234-f833-4192-be7c-5721434bc219","Type":"ContainerStarted","Data":"849b5d1ac67e8a8c0808dec84020036cf8b18d999ef79195e6c8fcbcfc020238"}
Jul 11 03:53:22.039727 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:22.039709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:22.068833 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:22.068788    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn" podStartSLOduration=2.135868297 podStartE2EDuration="5.068776429s" totalImagesPullingTime="2.932908132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:22.067337349 +0000 UTC m=+270.764609205" watchObservedRunningTime="2026-07-11 03:53:22.068776429 +0000 UTC m=+270.766048306"
Jul 11 03:53:22.095897 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:22.095856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj" podStartSLOduration=2.204788645 podStartE2EDuration="5.095843163s" totalImagesPullingTime="2.891054518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:22.093892243 +0000 UTC m=+270.791164104" watchObservedRunningTime="2026-07-11 03:53:22.095843163 +0000 UTC m=+270.793115021"
Jul 11 03:53:51.647909 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:51.647881    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:53:51.652938 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:51.652911    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:53:51.655687 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:51.655665    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 11 03:53:53.046452 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:53.046424    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xz7cj"
Jul 11 03:53:53.049372 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:53:53.049353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffgjn"
Jul 11 03:54:56.805629 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.805549    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"]
Jul 11 03:54:56.808730 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.808712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:56.810979 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.810954    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 03:54:56.811507 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.811489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 11 03:54:56.812342 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.812301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 11 03:54:56.812484 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.812380    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccxv2\""
Jul 11 03:54:56.812484 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.812304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 03:54:56.814843 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.814812    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"]
Jul 11 03:54:56.966608 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.966557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:56.966608 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.966612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:56.966829 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:56.966702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlmth\" (UniqueName: \"kubernetes.io/projected/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-kube-api-access-hlmth\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.067897 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.067789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.067897 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.067847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.067897 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.067896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlmth\" (UniqueName: \"kubernetes.io/projected/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-kube-api-access-hlmth\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.068582 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.068557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.070440 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.070413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.075748 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.075725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlmth\" (UniqueName: \"kubernetes.io/projected/b59874ff-1611-4a4a-a40b-ecef8e9e59d0-kube-api-access-hlmth\") pod \"kuadrant-console-plugin-66b5774985-4wqdt\" (UID: \"b59874ff-1611-4a4a-a40b-ecef8e9e59d0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.125114 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.125072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"
Jul 11 03:54:57.255258 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.255212    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt"]
Jul 11 03:54:57.258142 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:54:57.258111    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb59874ff_1611_4a4a_a40b_ecef8e9e59d0.slice/crio-f8dcab08b58710121a6489a0a7bc88433b38e7b41a637b6737a464800f235678 WatchSource:0}: Error finding container f8dcab08b58710121a6489a0a7bc88433b38e7b41a637b6737a464800f235678: Status 404 returned error can't find the container with id f8dcab08b58710121a6489a0a7bc88433b38e7b41a637b6737a464800f235678
Jul 11 03:54:57.259549 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.259532    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:54:57.441477 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:54:57.441388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt" event={"ID":"b59874ff-1611-4a4a-a40b-ecef8e9e59d0","Type":"ContainerStarted","Data":"f8dcab08b58710121a6489a0a7bc88433b38e7b41a637b6737a464800f235678"}
Jul 11 03:55:20.559571 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:20.559530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt" event={"ID":"b59874ff-1611-4a4a-a40b-ecef8e9e59d0","Type":"ContainerStarted","Data":"ee60e1e2b840ad41bffa9767ad2fd0bd08a716f3f21d75fea4343a7bf6c6239d"}
Jul 11 03:55:20.576560 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:20.576502    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4wqdt" podStartSLOduration=2.027929958 podStartE2EDuration="24.576482989s" totalImagesPullingTime="22.548553031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:20.575870673 +0000 UTC m=+389.273142535" watchObservedRunningTime="2026-07-11 03:55:20.576482989 +0000 UTC m=+389.273754851"
Jul 11 03:55:51.730832 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.730797    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:55:51.769715 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.769686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:55:51.769877 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.769777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:51.769877 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.769790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:55:51.771994 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.771967    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 11 03:55:51.870417 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.870377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrrdf\" (UniqueName: \"kubernetes.io/projected/e0f0d0a0-6179-453b-bc8c-57fef4439f66-kube-api-access-vrrdf\") pod \"limitador-limitador-54d6d988d5-gjq75\" (UID: \"e0f0d0a0-6179-453b-bc8c-57fef4439f66\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:51.870598 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.870434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e0f0d0a0-6179-453b-bc8c-57fef4439f66-config-file\") pod \"limitador-limitador-54d6d988d5-gjq75\" (UID: \"e0f0d0a0-6179-453b-bc8c-57fef4439f66\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:51.971860 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.971814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrrdf\" (UniqueName: \"kubernetes.io/projected/e0f0d0a0-6179-453b-bc8c-57fef4439f66-kube-api-access-vrrdf\") pod \"limitador-limitador-54d6d988d5-gjq75\" (UID: \"e0f0d0a0-6179-453b-bc8c-57fef4439f66\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:51.972006 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.971886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e0f0d0a0-6179-453b-bc8c-57fef4439f66-config-file\") pod \"limitador-limitador-54d6d988d5-gjq75\" (UID: \"e0f0d0a0-6179-453b-bc8c-57fef4439f66\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:51.972537 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.972520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e0f0d0a0-6179-453b-bc8c-57fef4439f66-config-file\") pod \"limitador-limitador-54d6d988d5-gjq75\" (UID: \"e0f0d0a0-6179-453b-bc8c-57fef4439f66\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:51.979372 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:51.979343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrrdf\" (UniqueName: \"kubernetes.io/projected/e0f0d0a0-6179-453b-bc8c-57fef4439f66-kube-api-access-vrrdf\") pod \"limitador-limitador-54d6d988d5-gjq75\" (UID: \"e0f0d0a0-6179-453b-bc8c-57fef4439f66\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:52.079193 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:52.079152    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:52.207387 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:52.207269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:55:52.209978 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:55:52.209953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f0d0a0_6179_453b_bc8c_57fef4439f66.slice/crio-3176de9afdd389975d58779ceb7ccca3d89354919c90903fba37503664510db2 WatchSource:0}: Error finding container 3176de9afdd389975d58779ceb7ccca3d89354919c90903fba37503664510db2: Status 404 returned error can't find the container with id 3176de9afdd389975d58779ceb7ccca3d89354919c90903fba37503664510db2
Jul 11 03:55:52.702015 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:52.701972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75" event={"ID":"e0f0d0a0-6179-453b-bc8c-57fef4439f66","Type":"ContainerStarted","Data":"3176de9afdd389975d58779ceb7ccca3d89354919c90903fba37503664510db2"}
Jul 11 03:55:54.714846 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:54.714807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75" event={"ID":"e0f0d0a0-6179-453b-bc8c-57fef4439f66","Type":"ContainerStarted","Data":"0dc9bebd877f2b6b59760bda4071d1416941f81ca5df90f381a167bab9af3daf"}
Jul 11 03:55:54.715211 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:54.714953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:55:54.729418 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:55:54.729374    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75" podStartSLOduration=1.3657114369999999 podStartE2EDuration="3.729358586s" totalImagesPullingTime="2.363647149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:54.728882974 +0000 UTC m=+423.426154837" watchObservedRunningTime="2026-07-11 03:55:54.729358586 +0000 UTC m=+423.426630447"
Jul 11 03:56:05.720402 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:05.720364    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjq75"
Jul 11 03:56:22.055573 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.055494    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5lp"]
Jul 11 03:56:22.058193 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.058171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:22.060846 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.060817    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9nlfg\""
Jul 11 03:56:22.065536 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.065504    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5lp"]
Jul 11 03:56:22.134897 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.134854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvcp6\" (UniqueName: \"kubernetes.io/projected/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c-kube-api-access-qvcp6\") pod \"authorino-5d4b67c446-6n5lp\" (UID: \"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c\") " pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:22.235541 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.235506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvcp6\" (UniqueName: \"kubernetes.io/projected/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c-kube-api-access-qvcp6\") pod \"authorino-5d4b67c446-6n5lp\" (UID: \"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c\") " pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:22.242970 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.242938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvcp6\" (UniqueName: \"kubernetes.io/projected/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c-kube-api-access-qvcp6\") pod \"authorino-5d4b67c446-6n5lp\" (UID: \"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c\") " pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:22.287911 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.287872    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5lp"]
Jul 11 03:56:22.288136 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.288125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:22.422941 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.422914    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5lp"]
Jul 11 03:56:22.425318 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:56:22.425270    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a5db2a9_956c_4ef0_a9b7_e1ce2ea2479c.slice/crio-f1fb63202f3c5c524a13aec76dd065300b693dfb5bbe9895c9e7b02e1b1b8888 WatchSource:0}: Error finding container f1fb63202f3c5c524a13aec76dd065300b693dfb5bbe9895c9e7b02e1b1b8888: Status 404 returned error can't find the container with id f1fb63202f3c5c524a13aec76dd065300b693dfb5bbe9895c9e7b02e1b1b8888
Jul 11 03:56:22.836338 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:22.836271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5lp" event={"ID":"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c","Type":"ContainerStarted","Data":"f1fb63202f3c5c524a13aec76dd065300b693dfb5bbe9895c9e7b02e1b1b8888"}
Jul 11 03:56:25.852691 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:25.852657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5lp" event={"ID":"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c","Type":"ContainerStarted","Data":"388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b"}
Jul 11 03:56:25.853145 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:25.852749    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6n5lp" podUID="2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" containerName="authorino" containerID="cri-o://388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b" gracePeriod=30
Jul 11 03:56:25.868677 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:25.868621    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6n5lp" podStartSLOduration=0.884486356 podStartE2EDuration="3.868601266s" totalImagesPullingTime="2.98411491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:56:25.866820852 +0000 UTC m=+454.564092715" watchObservedRunningTime="2026-07-11 03:56:25.868601266 +0000 UTC m=+454.565873129"
Jul 11 03:56:26.103957 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.103892    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:26.273436 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.273395    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvcp6\" (UniqueName: \"kubernetes.io/projected/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c-kube-api-access-qvcp6\") pod \"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c\" (UID: \"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c\") "
Jul 11 03:56:26.275616 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.275585    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c-kube-api-access-qvcp6" (OuterVolumeSpecName: "kube-api-access-qvcp6") pod "2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" (UID: "2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c"). InnerVolumeSpecName "kube-api-access-qvcp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:56:26.374373 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.374259    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvcp6\" (UniqueName: \"kubernetes.io/projected/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c-kube-api-access-qvcp6\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 03:56:26.858573 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.858535    2580 generic.go:356] "Generic (PLEG): container finished" podID="2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" containerID="388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b" exitCode=0
Jul 11 03:56:26.858976 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.858588    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5lp"
Jul 11 03:56:26.858976 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.858613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5lp" event={"ID":"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c","Type":"ContainerDied","Data":"388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b"}
Jul 11 03:56:26.858976 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.858655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5lp" event={"ID":"2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c","Type":"ContainerDied","Data":"f1fb63202f3c5c524a13aec76dd065300b693dfb5bbe9895c9e7b02e1b1b8888"}
Jul 11 03:56:26.858976 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.858673    2580 scope.go:117] "RemoveContainer" containerID="388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b"
Jul 11 03:56:26.867259 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.867228    2580 scope.go:117] "RemoveContainer" containerID="388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b"
Jul 11 03:56:26.867588 ip-10-0-134-138 kubenswrapper[2580]: E0711 03:56:26.867569    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b\": container with ID starting with 388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b not found: ID does not exist" containerID="388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b"
Jul 11 03:56:26.867646 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.867598    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b"} err="failed to get container status \"388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b\": rpc error: code = NotFound desc = could not find container \"388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b\": container with ID starting with 388115434b0856599c18cfb18ee84610ea6f1eb0f3c0fa03573dd346add9b17b not found: ID does not exist"
Jul 11 03:56:26.882906 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.882863    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5lp"]
Jul 11 03:56:26.884634 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:26.884615    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5lp"]
Jul 11 03:56:27.788590 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:56:27.788555    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" path="/var/lib/kubelet/pods/2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c/volumes"
Jul 11 03:57:07.594634 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:57:07.594598    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:57:25.973515 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:57:25.973482    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:57:39.252754 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:57:39.252715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:57:52.561467 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:57:52.561380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:57:59.752576 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:57:59.752532    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:58:21.683658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.683614    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"]
Jul 11 03:58:21.684252 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.684164    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" containerName="authorino"
Jul 11 03:58:21.684252 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.684185    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" containerName="authorino"
Jul 11 03:58:21.684400 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.684265    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a5db2a9-956c-4ef0-a9b7-e1ce2ea2479c" containerName="authorino"
Jul 11 03:58:21.687284 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.687261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.690793 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.690753    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 11 03:58:21.690793 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.690757    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lnw2c\""
Jul 11 03:58:21.690793 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.690785    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 11 03:58:21.691051 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.690853    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 11 03:58:21.696418 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.696396    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"]
Jul 11 03:58:21.779118 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.779077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.779295 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.779130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.779295 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.779151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv5nj\" (UniqueName: \"kubernetes.io/projected/3f274c34-d029-4a61-abb6-5068b21ab906-kube-api-access-cv5nj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.779295 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.779209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f274c34-d029-4a61-abb6-5068b21ab906-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.779295 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.779232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.779295 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.779254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880129 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880298 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880298 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv5nj\" (UniqueName: \"kubernetes.io/projected/3f274c34-d029-4a61-abb6-5068b21ab906-kube-api-access-cv5nj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880464 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f274c34-d029-4a61-abb6-5068b21ab906-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880530 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880581 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880581 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880681 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.880962 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.880937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.882727 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.882702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f274c34-d029-4a61-abb6-5068b21ab906-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.882922 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.882907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f274c34-d029-4a61-abb6-5068b21ab906-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.887633 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.887610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv5nj\" (UniqueName: \"kubernetes.io/projected/3f274c34-d029-4a61-abb6-5068b21ab906-kube-api-access-cv5nj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hhdqw\" (UID: \"3f274c34-d029-4a61-abb6-5068b21ab906\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:21.998432 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:21.998337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:22.137943 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:22.133583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"]
Jul 11 03:58:22.373055 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:22.373012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw" event={"ID":"3f274c34-d029-4a61-abb6-5068b21ab906","Type":"ContainerStarted","Data":"972476867eeec6fe8277f3a4eed32824c71ea041a60a9e83cc9e8ea54387ce41"}
Jul 11 03:58:23.378499 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:23.378457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw" event={"ID":"3f274c34-d029-4a61-abb6-5068b21ab906","Type":"ContainerStarted","Data":"40ca227e56703efb58a3fc10d2d31fb80feb6b87e65fc7e72ee145ce39a20b7c"}
Jul 11 03:58:23.394777 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:23.394674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw" podStartSLOduration=1.398842214 podStartE2EDuration="2.394656825s" totalImagesPullingTime="995.814611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:58:23.394080672 +0000 UTC m=+572.091352555" watchObservedRunningTime="2026-07-11 03:58:23.394656825 +0000 UTC m=+572.091928687"
Jul 11 03:58:23.859330 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:23.859287    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:58:27.575277 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.575240    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"]
Jul 11 03:58:27.579243 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.579222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.581461 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.581442    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 11 03:58:27.585968 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.585944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"]
Jul 11 03:58:27.629795 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.629761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.629795 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.629800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d1a99d-91d5-4348-bef8-4640a5c40951-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.630040 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.629826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.630040 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.629915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.630040 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.629952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/a4d1a99d-91d5-4348-bef8-4640a5c40951-kube-api-access-488gc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.630140 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.630066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731362 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731551 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731551 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d1a99d-91d5-4348-bef8-4640a5c40951-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731551 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731551 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731551 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/a4d1a99d-91d5-4348-bef8-4640a5c40951-kube-api-access-488gc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731843 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.731905 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.731859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.732137 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.732116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.733885 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.733860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4d1a99d-91d5-4348-bef8-4640a5c40951-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.734127 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.734100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d1a99d-91d5-4348-bef8-4640a5c40951-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.738720 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.738696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/a4d1a99d-91d5-4348-bef8-4640a5c40951-kube-api-access-488gc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt\" (UID: \"a4d1a99d-91d5-4348-bef8-4640a5c40951\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:27.889266 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:27.889161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:28.024332 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:28.024286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"]
Jul 11 03:58:28.026386 ip-10-0-134-138 kubenswrapper[2580]: W0711 03:58:28.026356    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4d1a99d_91d5_4348_bef8_4640a5c40951.slice/crio-25837b247c37df0a0aecc2542733a83fc53d66c16db7081b85d5f2c52820d9c3 WatchSource:0}: Error finding container 25837b247c37df0a0aecc2542733a83fc53d66c16db7081b85d5f2c52820d9c3: Status 404 returned error can't find the container with id 25837b247c37df0a0aecc2542733a83fc53d66c16db7081b85d5f2c52820d9c3
Jul 11 03:58:28.401555 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:28.401518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt" event={"ID":"a4d1a99d-91d5-4348-bef8-4640a5c40951","Type":"ContainerStarted","Data":"b2ca975940a65c9b736e23db64f718927b9152d2933757be62fef44dd61b37a2"}
Jul 11 03:58:28.401555 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:28.401561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt" event={"ID":"a4d1a99d-91d5-4348-bef8-4640a5c40951","Type":"ContainerStarted","Data":"25837b247c37df0a0aecc2542733a83fc53d66c16db7081b85d5f2c52820d9c3"}
Jul 11 03:58:28.419129 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:28.419069    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt" podStartSLOduration=1.247400375 podStartE2EDuration="1.41905134s" totalImagesPullingTime="171.650965ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:58:28.417456207 +0000 UTC m=+577.114728070" watchObservedRunningTime="2026-07-11 03:58:28.41905134 +0000 UTC m=+577.116323180"
Jul 11 03:58:30.759022 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:30.758990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 03:58:31.998912 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:31.998870    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:31.999436 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:31.998952    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:32.011658 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:32.011631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:32.431224 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:32.431195    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hhdqw"
Jul 11 03:58:37.889902 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:37.889864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:37.890425 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:37.890126    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:37.902853 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:37.902826    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:38.457379 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:38.457353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt"
Jul 11 03:58:51.678167 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:51.678139    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 03:58:51.679259 ip-10-0-134-138 kubenswrapper[2580]: I0711 03:58:51.679237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:00:07.564107 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:00:07.564067    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:00:17.154106 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:00:17.154069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:00:29.254615 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:00:29.254583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:00:37.555152 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:00:37.555118    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:00:48.854798 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:00:48.854722    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:01:14.666178 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:01:14.666142    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:01:27.052212 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:01:27.052179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:01:58.949107 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:01:58.949070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:02:09.250808 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:02:09.250769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:02:21.757612 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:02:21.757515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:02:31.448401 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:02:31.448362    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:02:42.756239 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:02:42.756205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:02:52.955706 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:02:52.955664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:03:04.358679 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:03:04.358641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:03:15.155781 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:03:15.155749    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:03:39.863345 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:03:39.863295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:03:51.704917 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:03:51.704838    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:03:51.705472 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:03:51.705267    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:03:52.250649 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:03:52.250613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:04:13.761514 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:04:13.761478    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:04:25.760153 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:04:25.760119    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:04:42.754429 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:04:42.754390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:04:52.359861 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:04:52.359827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:05:02.654622 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:05:02.654590    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:05:12.951916 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:05:12.951880    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:05:27.454293 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:05:27.454260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:07:09.966729 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:07:09.966697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:07:23.163582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:07:23.163545    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:07:32.357661 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:07:32.357620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:07:45.052752 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:07:45.052718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:07:57.147701 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:07:57.147662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:08:07.056703 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:07.056671    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:08:15.950581 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:15.950504    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:08:26.464255 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:26.464218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:08:36.555148 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:36.555114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:08:46.055982 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:46.055947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:08:51.734749 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:51.734723    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:08:51.735744 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:51.735725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:08:58.953505 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:08:58.953474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:09:18.861768 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:09:18.861732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:09:28.860085 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:09:28.860051    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:09:38.853131 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:09:38.853095    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:09:49.953846 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:09:49.953766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:09:56.954050 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:09:56.954008    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:10:22.253606 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:10:22.253576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:10:32.055364 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:10:32.055330    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:10:40.255812 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:10:40.255776    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:10:49.952406 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:10:49.952368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:10:59.651577 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:10:59.651540    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:11:13.558615 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:11:13.558536    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:11:23.450751 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:11:23.450710    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:11:33.161450 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:11:33.161416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:11:49.053848 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:11:49.053816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:12:02.554725 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:12:02.554687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:12:10.857382 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:12:10.857342    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:12:24.056825 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:12:24.056786    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:12:37.353537 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:12:37.353491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:12:48.859040 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:12:48.858961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:13:01.357060 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:13:01.357019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:13:10.468295 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:13:10.468259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:13:23.955745 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:13:23.955712    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:13:35.454604 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:13:35.454568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:13:51.761955 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:13:51.761928    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:13:51.764394 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:13:51.764375    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:14:30.349276 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:14:30.349240    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:14:49.356953 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:14:49.356917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:15:51.053974 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:15:51.053897    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:16:04.357296 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:16:04.357254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:17:19.648868 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:17:19.648783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:17:36.351738 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:17:36.351697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:18:51.054302 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:18:51.054263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:18:51.788133 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:18:51.788102    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:18:51.791979 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:18:51.791953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:20:26.350586 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:20:26.350502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:20:35.652171 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:20:35.652134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:20:46.749803 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:20:46.749761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:21:05.750445 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:05.750411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:21:43.199743 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:43.199705    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:21:50.974323 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.974282    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"]
Jul 11 04:21:50.977967 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.977946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:50.981608 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.981570    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c9f692c9\"/\"kube-root-ca.crt\""
Jul 11 04:21:50.981608 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.981599    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c9f692c9\"/\"openshift-service-ca.crt\""
Jul 11 04:21:50.981826 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.981619    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c9f692c9\"/\"default-dockercfg-4n7nn\""
Jul 11 04:21:50.981826 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.981598    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c9f692c9\"/\"e2e-lifecycle-model-c9f692c9-kserve-self-signed-certs\""
Jul 11 04:21:50.987050 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:50.987030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"]
Jul 11 04:21:51.137241 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.137201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-home\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.137241 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.137246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jrrj\" (UniqueName: \"kubernetes.io/projected/fbc6fb05-cd34-48a4-af1a-e4696f50a663-kube-api-access-5jrrj\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.137482 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.137265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-dshm\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.137482 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.137291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tmp-dir\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.137482 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.137354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-model-cache\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.137482 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.137373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tls-certs\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238173 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-home\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238173 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jrrj\" (UniqueName: \"kubernetes.io/projected/fbc6fb05-cd34-48a4-af1a-e4696f50a663-kube-api-access-5jrrj\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238173 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-dshm\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238496 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tmp-dir\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238496 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-model-cache\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238496 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tls-certs\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238644 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-home\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238765 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tmp-dir\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.238953 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.238885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-model-cache\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.240614 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.240593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-dshm\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.241087 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.241066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tls-certs\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.247410 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.247386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jrrj\" (UniqueName: \"kubernetes.io/projected/fbc6fb05-cd34-48a4-af1a-e4696f50a663-kube-api-access-5jrrj\") pod \"e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") " pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.287868 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.287832    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:21:51.417214 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.417191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"]
Jul 11 04:21:51.419257 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:21:51.419232    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbc6fb05_cd34_48a4_af1a_e4696f50a663.slice/crio-d24f641f3cbc6bfe5df5c62a0beb5a875aa8e793936209d5adbd0e0bbea2d053 WatchSource:0}: Error finding container d24f641f3cbc6bfe5df5c62a0beb5a875aa8e793936209d5adbd0e0bbea2d053: Status 404 returned error can't find the container with id d24f641f3cbc6bfe5df5c62a0beb5a875aa8e793936209d5adbd0e0bbea2d053
Jul 11 04:21:51.531668 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.531568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x" event={"ID":"fbc6fb05-cd34-48a4-af1a-e4696f50a663","Type":"ContainerStarted","Data":"a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6"}
Jul 11 04:21:51.531668 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.531611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x" event={"ID":"fbc6fb05-cd34-48a4-af1a-e4696f50a663","Type":"ContainerStarted","Data":"d24f641f3cbc6bfe5df5c62a0beb5a875aa8e793936209d5adbd0e0bbea2d053"}
Jul 11 04:21:51.547654 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:51.547601    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x" podStartSLOduration=1.547585786 podStartE2EDuration="1.547585786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:21:51.545891937 +0000 UTC m=+1980.243163801" watchObservedRunningTime="2026-07-11 04:21:51.547585786 +0000 UTC m=+1980.244857648"
Jul 11 04:21:53.847396 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:21:53.847362    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:22:01.288651 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:01.288613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:22:01.289145 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:01.288709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:22:01.301957 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:01.301932    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:22:01.586275 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:01.586248    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:22:09.852636 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:09.852601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:22:27.055619 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:27.055584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:22:32.947028 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:32.946991    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"]
Jul 11 04:22:47.967691 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:47.967634    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x" podUID="fbc6fb05-cd34-48a4-af1a-e4696f50a663" containerName="main" containerID="cri-o://a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6" gracePeriod=45
Jul 11 04:22:48.219656 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.219600    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:22:48.249680 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.249650    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tls-certs\") pod \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") "
Jul 11 04:22:48.249680 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.249687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-model-cache\") pod \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") "
Jul 11 04:22:48.249909 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.249724    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jrrj\" (UniqueName: \"kubernetes.io/projected/fbc6fb05-cd34-48a4-af1a-e4696f50a663-kube-api-access-5jrrj\") pod \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") "
Jul 11 04:22:48.249909 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.249743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tmp-dir\") pod \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") "
Jul 11 04:22:48.249909 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.249772    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-home\") pod \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") "
Jul 11 04:22:48.249909 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.249809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-dshm\") pod \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\" (UID: \"fbc6fb05-cd34-48a4-af1a-e4696f50a663\") "
Jul 11 04:22:48.250112 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.250060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbc6fb05-cd34-48a4-af1a-e4696f50a663" (UID: "fbc6fb05-cd34-48a4-af1a-e4696f50a663"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:22:48.250279 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.250252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-home" (OuterVolumeSpecName: "home") pod "fbc6fb05-cd34-48a4-af1a-e4696f50a663" (UID: "fbc6fb05-cd34-48a4-af1a-e4696f50a663"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:22:48.250430 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.250362    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbc6fb05-cd34-48a4-af1a-e4696f50a663" (UID: "fbc6fb05-cd34-48a4-af1a-e4696f50a663"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:22:48.252088 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.252066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-dshm" (OuterVolumeSpecName: "dshm") pod "fbc6fb05-cd34-48a4-af1a-e4696f50a663" (UID: "fbc6fb05-cd34-48a4-af1a-e4696f50a663"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:22:48.252170 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.252097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbc6fb05-cd34-48a4-af1a-e4696f50a663" (UID: "fbc6fb05-cd34-48a4-af1a-e4696f50a663"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:22:48.252290 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.252272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc6fb05-cd34-48a4-af1a-e4696f50a663-kube-api-access-5jrrj" (OuterVolumeSpecName: "kube-api-access-5jrrj") pod "fbc6fb05-cd34-48a4-af1a-e4696f50a663" (UID: "fbc6fb05-cd34-48a4-af1a-e4696f50a663"). InnerVolumeSpecName "kube-api-access-5jrrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:22:48.350477 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.350445    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:22:48.350477 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.350472    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:22:48.350477 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.350482    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:22:48.350704 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.350490    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jrrj\" (UniqueName: \"kubernetes.io/projected/fbc6fb05-cd34-48a4-af1a-e4696f50a663-kube-api-access-5jrrj\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:22:48.350704 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.350499    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:22:48.350704 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.350508    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbc6fb05-cd34-48a4-af1a-e4696f50a663-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:22:48.777956 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.777922    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbc6fb05-cd34-48a4-af1a-e4696f50a663" containerID="a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6" exitCode=0
Jul 11 04:22:48.778134 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.777964    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"
Jul 11 04:22:48.778134 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.778001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x" event={"ID":"fbc6fb05-cd34-48a4-af1a-e4696f50a663","Type":"ContainerDied","Data":"a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6"}
Jul 11 04:22:48.778134 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.778041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x" event={"ID":"fbc6fb05-cd34-48a4-af1a-e4696f50a663","Type":"ContainerDied","Data":"d24f641f3cbc6bfe5df5c62a0beb5a875aa8e793936209d5adbd0e0bbea2d053"}
Jul 11 04:22:48.778134 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.778060    2580 scope.go:117] "RemoveContainer" containerID="a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6"
Jul 11 04:22:48.787047 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.787024    2580 scope.go:117] "RemoveContainer" containerID="a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6"
Jul 11 04:22:48.787299 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:22:48.787280    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6\": container with ID starting with a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6 not found: ID does not exist" containerID="a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6"
Jul 11 04:22:48.787391 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.787330    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6"} err="failed to get container status \"a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6\": rpc error: code = NotFound desc = could not find container \"a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6\": container with ID starting with a75665fd7e4190f450800c611efe25d5b1e9422ca7cf5c5f7ac78e715dd515b6 not found: ID does not exist"
Jul 11 04:22:48.802542 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.799932    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"]
Jul 11 04:22:48.805489 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:48.805466    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c9f692c9/e2e-lifecycle-model-c9f692c9-kserve-dccf8698c-v8b4x"]
Jul 11 04:22:49.788186 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:22:49.788149    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbc6fb05-cd34-48a4-af1a-e4696f50a663" path="/var/lib/kubelet/pods/fbc6fb05-cd34-48a4-af1a-e4696f50a663/volumes"
Jul 11 04:23:34.260344 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:23:34.260238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:23:48.951207 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:23:48.951168    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:23:51.813622 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:23:51.813591    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:23:51.819090 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:23:51.819067    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:24:34.851963 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:34.851928    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:24:47.456507 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:47.456424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:24:55.080474 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.080438    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"]
Jul 11 04:24:55.080930 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.080793    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc6fb05-cd34-48a4-af1a-e4696f50a663" containerName="main"
Jul 11 04:24:55.080930 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.080804    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc6fb05-cd34-48a4-af1a-e4696f50a663" containerName="main"
Jul 11 04:24:55.080930 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.080876    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc6fb05-cd34-48a4-af1a-e4696f50a663" containerName="main"
Jul 11 04:24:55.083880 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.083858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.086238 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.086214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-93c505\"/\"kube-root-ca.crt\""
Jul 11 04:24:55.087463 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.087444    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-93c505\"/\"test-model-93c505-kserve-self-signed-certs\""
Jul 11 04:24:55.087463 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.087453    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-93c505\"/\"default-dockercfg-jdsw9\""
Jul 11 04:24:55.087622 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.087453    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-93c505\"/\"openshift-service-ca.crt\""
Jul 11 04:24:55.092968 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.092948    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"]
Jul 11 04:24:55.132191 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.132153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwt98\" (UniqueName: \"kubernetes.io/projected/790158c1-92e6-4993-8d1a-89b17b34e9ac-kube-api-access-cwt98\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.132364 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.132204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-tmp-dir\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.132364 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.132284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/790158c1-92e6-4993-8d1a-89b17b34e9ac-tls-certs\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.132364 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.132359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-dshm\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.132484 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.132407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-home\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.132484 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.132449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-model-cache\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.232889 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.232836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwt98\" (UniqueName: \"kubernetes.io/projected/790158c1-92e6-4993-8d1a-89b17b34e9ac-kube-api-access-cwt98\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233069 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.232904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-tmp-dir\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233069 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.232954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/790158c1-92e6-4993-8d1a-89b17b34e9ac-tls-certs\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233069 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.232991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-dshm\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233069 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.233026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-home\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233069 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.233057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-model-cache\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233433 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.233407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-tmp-dir\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233517 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.233487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-model-cache\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.233577 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.233532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-home\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.235385 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.235358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-dshm\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.235679 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.235645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/790158c1-92e6-4993-8d1a-89b17b34e9ac-tls-certs\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.240478 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.240455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwt98\" (UniqueName: \"kubernetes.io/projected/790158c1-92e6-4993-8d1a-89b17b34e9ac-kube-api-access-cwt98\") pod \"test-model-93c505-kserve-68b94d65cf-9dckd\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") " pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.392934 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.392854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:24:55.520568 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:55.520533    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"]
Jul 11 04:24:55.522951 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:24:55.522924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod790158c1_92e6_4993_8d1a_89b17b34e9ac.slice/crio-62b593bcf728254973af39d47d48947d34cf2c1e71695ffcd6885f1fb463a9b4 WatchSource:0}: Error finding container 62b593bcf728254973af39d47d48947d34cf2c1e71695ffcd6885f1fb463a9b4: Status 404 returned error can't find the container with id 62b593bcf728254973af39d47d48947d34cf2c1e71695ffcd6885f1fb463a9b4
Jul 11 04:24:56.338074 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:56.338037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd" event={"ID":"790158c1-92e6-4993-8d1a-89b17b34e9ac","Type":"ContainerStarted","Data":"e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6"}
Jul 11 04:24:56.338074 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:56.338077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd" event={"ID":"790158c1-92e6-4993-8d1a-89b17b34e9ac","Type":"ContainerStarted","Data":"62b593bcf728254973af39d47d48947d34cf2c1e71695ffcd6885f1fb463a9b4"}
Jul 11 04:24:56.363014 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:24:56.362968    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd" podStartSLOduration=1.362952913 podStartE2EDuration="1.362952913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:24:56.36198692 +0000 UTC m=+2165.059258781" watchObservedRunningTime="2026-07-11 04:24:56.362952913 +0000 UTC m=+2165.060224774"
Jul 11 04:25:00.658252 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:00.658217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:25:05.393436 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:05.393406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:25:05.393885 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:05.393450    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:25:05.406027 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:05.406002    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:25:06.393495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:06.393467    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:25:16.181856 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.181824    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"]
Jul 11 04:25:16.185112 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.185090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.189101 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.189077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6c0c56\"/\"openshift-service-ca.crt\""
Jul 11 04:25:16.189221 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.189080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6c0c56\"/\"kube-root-ca.crt\""
Jul 11 04:25:16.189221 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.189110    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6c0c56\"/\"default-dockercfg-9fdst\""
Jul 11 04:25:16.189221 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.189127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6c0c56\"/\"test-model-6c0c56-kserve-self-signed-certs\""
Jul 11 04:25:16.194515 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.194495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"]
Jul 11 04:25:16.331638 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.331600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp57l\" (UniqueName: \"kubernetes.io/projected/a27771d6-7aef-47cb-bb75-962abb863843-kube-api-access-zp57l\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.331828 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.331658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-dshm\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.331828 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.331684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-home\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.331828 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.331733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-model-cache\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.331938 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.331825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-tmp-dir\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.331938 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.331853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27771d6-7aef-47cb-bb75-962abb863843-tls-certs\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433032 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.432931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp57l\" (UniqueName: \"kubernetes.io/projected/a27771d6-7aef-47cb-bb75-962abb863843-kube-api-access-zp57l\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433032 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.432999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-dshm\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433239 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-home\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433239 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-model-cache\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433239 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-tmp-dir\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433419 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27771d6-7aef-47cb-bb75-962abb863843-tls-certs\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433571 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-tmp-dir\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433629 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-model-cache\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.433629 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.433610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-home\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.435381 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.435357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-dshm\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.435637 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.435619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27771d6-7aef-47cb-bb75-962abb863843-tls-certs\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.441165 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.441140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp57l\" (UniqueName: \"kubernetes.io/projected/a27771d6-7aef-47cb-bb75-962abb863843-kube-api-access-zp57l\") pod \"test-model-6c0c56-kserve-674fcc5947-dz6sq\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") " pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.494597 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.494570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:16.625642 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:16.625618    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"]
Jul 11 04:25:16.627999 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:25:16.627957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda27771d6_7aef_47cb_bb75_962abb863843.slice/crio-e1a44c25228338e3f8830d510706e4a9411981300310a106f120f300028a6086 WatchSource:0}: Error finding container e1a44c25228338e3f8830d510706e4a9411981300310a106f120f300028a6086: Status 404 returned error can't find the container with id e1a44c25228338e3f8830d510706e4a9411981300310a106f120f300028a6086
Jul 11 04:25:17.440598 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:17.440563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq" event={"ID":"a27771d6-7aef-47cb-bb75-962abb863843","Type":"ContainerStarted","Data":"77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3"}
Jul 11 04:25:17.440970 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:17.440610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq" event={"ID":"a27771d6-7aef-47cb-bb75-962abb863843","Type":"ContainerStarted","Data":"e1a44c25228338e3f8830d510706e4a9411981300310a106f120f300028a6086"}
Jul 11 04:25:17.456768 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:17.456719    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq" podStartSLOduration=1.4567037520000001 podStartE2EDuration="1.456703752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:25:17.455708605 +0000 UTC m=+2186.152980467" watchObservedRunningTime="2026-07-11 04:25:17.456703752 +0000 UTC m=+2186.153975624"
Jul 11 04:25:22.056484 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:22.056450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:25:26.495377 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:26.495246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:26.495377 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:26.495293    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:26.509660 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:26.509635    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:27.503767 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:27.503738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:33.614038 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:33.614000    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"]
Jul 11 04:25:34.618907 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:34.618874    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"]
Jul 11 04:25:40.464157 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:40.464121    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:25:48.636649 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:48.636604    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd" podUID="790158c1-92e6-4993-8d1a-89b17b34e9ac" containerName="main" containerID="cri-o://e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6" gracePeriod=45
Jul 11 04:25:48.891997 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:48.891935    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:25:49.038507 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038475    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-home\") pod \"790158c1-92e6-4993-8d1a-89b17b34e9ac\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") "
Jul 11 04:25:49.038507 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038513    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-model-cache\") pod \"790158c1-92e6-4993-8d1a-89b17b34e9ac\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") "
Jul 11 04:25:49.038714 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038558    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-tmp-dir\") pod \"790158c1-92e6-4993-8d1a-89b17b34e9ac\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") "
Jul 11 04:25:49.038714 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/790158c1-92e6-4993-8d1a-89b17b34e9ac-tls-certs\") pod \"790158c1-92e6-4993-8d1a-89b17b34e9ac\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") "
Jul 11 04:25:49.038714 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038689    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwt98\" (UniqueName: \"kubernetes.io/projected/790158c1-92e6-4993-8d1a-89b17b34e9ac-kube-api-access-cwt98\") pod \"790158c1-92e6-4993-8d1a-89b17b34e9ac\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") "
Jul 11 04:25:49.038870 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038717    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-dshm\") pod \"790158c1-92e6-4993-8d1a-89b17b34e9ac\" (UID: \"790158c1-92e6-4993-8d1a-89b17b34e9ac\") "
Jul 11 04:25:49.038870 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-home" (OuterVolumeSpecName: "home") pod "790158c1-92e6-4993-8d1a-89b17b34e9ac" (UID: "790158c1-92e6-4993-8d1a-89b17b34e9ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:49.038870 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "790158c1-92e6-4993-8d1a-89b17b34e9ac" (UID: "790158c1-92e6-4993-8d1a-89b17b34e9ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:49.039020 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.038849    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "790158c1-92e6-4993-8d1a-89b17b34e9ac" (UID: "790158c1-92e6-4993-8d1a-89b17b34e9ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:49.039071 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.039018    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:49.039071 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.039039    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:49.039132 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.039076    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:49.040958 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.040934    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-dshm" (OuterVolumeSpecName: "dshm") pod "790158c1-92e6-4993-8d1a-89b17b34e9ac" (UID: "790158c1-92e6-4993-8d1a-89b17b34e9ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:49.041054 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.040973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790158c1-92e6-4993-8d1a-89b17b34e9ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "790158c1-92e6-4993-8d1a-89b17b34e9ac" (UID: "790158c1-92e6-4993-8d1a-89b17b34e9ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:25:49.041103 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.041069    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790158c1-92e6-4993-8d1a-89b17b34e9ac-kube-api-access-cwt98" (OuterVolumeSpecName: "kube-api-access-cwt98") pod "790158c1-92e6-4993-8d1a-89b17b34e9ac" (UID: "790158c1-92e6-4993-8d1a-89b17b34e9ac"). InnerVolumeSpecName "kube-api-access-cwt98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:25:49.139564 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.139531    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwt98\" (UniqueName: \"kubernetes.io/projected/790158c1-92e6-4993-8d1a-89b17b34e9ac-kube-api-access-cwt98\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:49.139564 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.139559    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/790158c1-92e6-4993-8d1a-89b17b34e9ac-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:49.139564 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.139570    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/790158c1-92e6-4993-8d1a-89b17b34e9ac-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:49.591854 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.591819    2580 generic.go:356] "Generic (PLEG): container finished" podID="790158c1-92e6-4993-8d1a-89b17b34e9ac" containerID="e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6" exitCode=0
Jul 11 04:25:49.591854 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.591860    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"
Jul 11 04:25:49.592103 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.591880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd" event={"ID":"790158c1-92e6-4993-8d1a-89b17b34e9ac","Type":"ContainerDied","Data":"e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6"}
Jul 11 04:25:49.592103 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.591917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd" event={"ID":"790158c1-92e6-4993-8d1a-89b17b34e9ac","Type":"ContainerDied","Data":"62b593bcf728254973af39d47d48947d34cf2c1e71695ffcd6885f1fb463a9b4"}
Jul 11 04:25:49.592103 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.591940    2580 scope.go:117] "RemoveContainer" containerID="e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6"
Jul 11 04:25:49.600845 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.600825    2580 scope.go:117] "RemoveContainer" containerID="e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6"
Jul 11 04:25:49.601124 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:25:49.601105    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6\": container with ID starting with e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6 not found: ID does not exist" containerID="e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6"
Jul 11 04:25:49.601183 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.601134    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6"} err="failed to get container status \"e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6\": rpc error: code = NotFound desc = could not find container \"e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6\": container with ID starting with e6e7dfc17227f17e3256a723f196bd6f946d530986fa00465f526af8acc020c6 not found: ID does not exist"
Jul 11 04:25:49.612059 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.612031    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"]
Jul 11 04:25:49.614795 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.614771    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-93c505/test-model-93c505-kserve-68b94d65cf-9dckd"]
Jul 11 04:25:49.643035 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.642984    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq" podUID="a27771d6-7aef-47cb-bb75-962abb863843" containerName="main" containerID="cri-o://77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3" gracePeriod=45
Jul 11 04:25:49.789839 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.789810    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790158c1-92e6-4993-8d1a-89b17b34e9ac" path="/var/lib/kubelet/pods/790158c1-92e6-4993-8d1a-89b17b34e9ac/volumes"
Jul 11 04:25:49.888215 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:49.888191    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:50.045922 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.045889    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-home\") pod \"a27771d6-7aef-47cb-bb75-962abb863843\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") "
Jul 11 04:25:50.046110 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.045941    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp57l\" (UniqueName: \"kubernetes.io/projected/a27771d6-7aef-47cb-bb75-962abb863843-kube-api-access-zp57l\") pod \"a27771d6-7aef-47cb-bb75-962abb863843\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") "
Jul 11 04:25:50.046110 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.045979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27771d6-7aef-47cb-bb75-962abb863843-tls-certs\") pod \"a27771d6-7aef-47cb-bb75-962abb863843\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") "
Jul 11 04:25:50.046110 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046028    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-tmp-dir\") pod \"a27771d6-7aef-47cb-bb75-962abb863843\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") "
Jul 11 04:25:50.046110 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046044    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-model-cache\") pod \"a27771d6-7aef-47cb-bb75-962abb863843\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") "
Jul 11 04:25:50.046110 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046077    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-dshm\") pod \"a27771d6-7aef-47cb-bb75-962abb863843\" (UID: \"a27771d6-7aef-47cb-bb75-962abb863843\") "
Jul 11 04:25:50.046394 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-home" (OuterVolumeSpecName: "home") pod "a27771d6-7aef-47cb-bb75-962abb863843" (UID: "a27771d6-7aef-47cb-bb75-962abb863843"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:50.046394 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a27771d6-7aef-47cb-bb75-962abb863843" (UID: "a27771d6-7aef-47cb-bb75-962abb863843"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:50.046394 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-model-cache" (OuterVolumeSpecName: "model-cache") pod "a27771d6-7aef-47cb-bb75-962abb863843" (UID: "a27771d6-7aef-47cb-bb75-962abb863843"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:50.046394 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.046378    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:50.048286 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.048263    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-dshm" (OuterVolumeSpecName: "dshm") pod "a27771d6-7aef-47cb-bb75-962abb863843" (UID: "a27771d6-7aef-47cb-bb75-962abb863843"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:25:50.048410 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.048389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a27771d6-7aef-47cb-bb75-962abb863843-kube-api-access-zp57l" (OuterVolumeSpecName: "kube-api-access-zp57l") pod "a27771d6-7aef-47cb-bb75-962abb863843" (UID: "a27771d6-7aef-47cb-bb75-962abb863843"). InnerVolumeSpecName "kube-api-access-zp57l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:25:50.048454 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.048438    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a27771d6-7aef-47cb-bb75-962abb863843-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a27771d6-7aef-47cb-bb75-962abb863843" (UID: "a27771d6-7aef-47cb-bb75-962abb863843"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:25:50.147732 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.147647    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27771d6-7aef-47cb-bb75-962abb863843-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:50.147732 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.147676    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:50.147732 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.147684    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:50.147732 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.147692    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27771d6-7aef-47cb-bb75-962abb863843-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:50.147732 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.147700    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp57l\" (UniqueName: \"kubernetes.io/projected/a27771d6-7aef-47cb-bb75-962abb863843-kube-api-access-zp57l\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:25:50.598823 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.598790    2580 generic.go:356] "Generic (PLEG): container finished" podID="a27771d6-7aef-47cb-bb75-962abb863843" containerID="77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3" exitCode=0
Jul 11 04:25:50.599005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.598830    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"
Jul 11 04:25:50.599005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.598845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq" event={"ID":"a27771d6-7aef-47cb-bb75-962abb863843","Type":"ContainerDied","Data":"77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3"}
Jul 11 04:25:50.599005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.598878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq" event={"ID":"a27771d6-7aef-47cb-bb75-962abb863843","Type":"ContainerDied","Data":"e1a44c25228338e3f8830d510706e4a9411981300310a106f120f300028a6086"}
Jul 11 04:25:50.599005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.598897    2580 scope.go:117] "RemoveContainer" containerID="77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3"
Jul 11 04:25:50.607596 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.607576    2580 scope.go:117] "RemoveContainer" containerID="77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3"
Jul 11 04:25:50.607834 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:25:50.607819    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3\": container with ID starting with 77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3 not found: ID does not exist" containerID="77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3"
Jul 11 04:25:50.607883 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.607841    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3"} err="failed to get container status \"77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3\": rpc error: code = NotFound desc = could not find container \"77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3\": container with ID starting with 77e77bf9118ca80ccec753ca044419a9379d4c5b37537dc7dfe3d8cc892e96f3 not found: ID does not exist"
Jul 11 04:25:50.618763 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.618735    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"]
Jul 11 04:25:50.621729 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:50.621705    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6c0c56/test-model-6c0c56-kserve-674fcc5947-dz6sq"]
Jul 11 04:25:51.788609 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:51.788571    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a27771d6-7aef-47cb-bb75-962abb863843" path="/var/lib/kubelet/pods/a27771d6-7aef-47cb-bb75-962abb863843/volumes"
Jul 11 04:25:53.856206 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:25:53.856159    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:26:14.657298 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:26:14.657214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:26:35.756137 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:26:35.756101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:26:45.963838 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:26:45.963805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:27:06.658704 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:27:06.658666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:27:30.754423 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:27:30.754393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:27:52.350234 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:27:52.350197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:28:04.056488 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:04.056450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:28:20.493934 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.493900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"]
Jul 11 04:28:20.494480 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.494459    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27771d6-7aef-47cb-bb75-962abb863843" containerName="main"
Jul 11 04:28:20.494564 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.494483    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27771d6-7aef-47cb-bb75-962abb863843" containerName="main"
Jul 11 04:28:20.494564 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.494521    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790158c1-92e6-4993-8d1a-89b17b34e9ac" containerName="main"
Jul 11 04:28:20.494564 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.494530    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="790158c1-92e6-4993-8d1a-89b17b34e9ac" containerName="main"
Jul 11 04:28:20.494769 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.494634    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="790158c1-92e6-4993-8d1a-89b17b34e9ac" containerName="main"
Jul 11 04:28:20.494769 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.494648    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27771d6-7aef-47cb-bb75-962abb863843" containerName="main"
Jul 11 04:28:20.497749 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.497729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.501113 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.501092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"default-dockercfg-s5vh7\""
Jul 11 04:28:20.501113 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.501112    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"kube-root-ca.crt\""
Jul 11 04:28:20.501278 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.501092    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"openshift-service-ca.crt\""
Jul 11 04:28:20.501278 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.501097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"auth-test-model-3055d9-kserve-self-signed-certs\""
Jul 11 04:28:20.505678 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.505658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"]
Jul 11 04:28:20.685983 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.685949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-home\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.686154 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.686013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-dshm\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.686154 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.686057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmwk\" (UniqueName: \"kubernetes.io/projected/d87c5d17-c67f-467c-b928-4ea5bcfdd199-kube-api-access-twmwk\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.686154 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.686093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tmp-dir\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.686154 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.686132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tls-certs\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.686154 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.686154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-model-cache\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787459 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tmp-dir\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787459 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tls-certs\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787459 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-model-cache\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787718 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-home\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787718 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-dshm\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787718 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmwk\" (UniqueName: \"kubernetes.io/projected/d87c5d17-c67f-467c-b928-4ea5bcfdd199-kube-api-access-twmwk\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787859 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tmp-dir\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787915 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-home\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.787972 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.787952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-model-cache\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.789781 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.789758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-dshm\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.790060 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.790042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tls-certs\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.794945 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.794922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmwk\" (UniqueName: \"kubernetes.io/projected/d87c5d17-c67f-467c-b928-4ea5bcfdd199-kube-api-access-twmwk\") pod \"auth-test-model-3055d9-kserve-58b8b97547-v5pr2\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") " pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.806609 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.806588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:20.934161 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:20.934112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"]
Jul 11 04:28:20.937173 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:28:20.937146    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd87c5d17_c67f_467c_b928_4ea5bcfdd199.slice/crio-4eb342b9543e275dc6467398e01636b7410b9f76b5fddb065bdb7c0e2588846a WatchSource:0}: Error finding container 4eb342b9543e275dc6467398e01636b7410b9f76b5fddb065bdb7c0e2588846a: Status 404 returned error can't find the container with id 4eb342b9543e275dc6467398e01636b7410b9f76b5fddb065bdb7c0e2588846a
Jul 11 04:28:21.261179 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:21.261140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2" event={"ID":"d87c5d17-c67f-467c-b928-4ea5bcfdd199","Type":"ContainerStarted","Data":"3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2"}
Jul 11 04:28:21.261179 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:21.261185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2" event={"ID":"d87c5d17-c67f-467c-b928-4ea5bcfdd199","Type":"ContainerStarted","Data":"4eb342b9543e275dc6467398e01636b7410b9f76b5fddb065bdb7c0e2588846a"}
Jul 11 04:28:21.276836 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:21.276786    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2" podStartSLOduration=1.276770954 podStartE2EDuration="1.276770954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:28:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:28:21.275675798 +0000 UTC m=+2369.972947661" watchObservedRunningTime="2026-07-11 04:28:21.276770954 +0000 UTC m=+2369.974042815"
Jul 11 04:28:24.050463 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:24.050422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:28:30.807462 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:30.807416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:30.807962 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:30.807500    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:30.819883 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:30.819860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:31.315220 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:31.315189    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:28:43.489665 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.489628    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"]
Jul 11 04:28:43.493266 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.493246    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.495585 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.495536    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"default-dockercfg-c4xsn\""
Jul 11 04:28:43.497081 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.497060    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"openshift-service-ca.crt\""
Jul 11 04:28:43.497202 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.497182    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"auth-test-model-eefca5-kserve-self-signed-certs\""
Jul 11 04:28:43.497268 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.497220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"kube-root-ca.crt\""
Jul 11 04:28:43.501757 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.501736    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"]
Jul 11 04:28:43.584771 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.584731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-model-cache\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.584967 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.584779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe6294-da68-4e18-8c0c-8e5e12137a76-tls-certs\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.584967 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.584895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-dshm\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.584967 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.584928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-home\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.585104 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.584998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-tmp-dir\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.585104 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.585029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxx8q\" (UniqueName: \"kubernetes.io/projected/57fe6294-da68-4e18-8c0c-8e5e12137a76-kube-api-access-gxx8q\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.685889 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.685847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-dshm\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.685889 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.685893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-home\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686127 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.685937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-tmp-dir\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686127 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.685967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxx8q\" (UniqueName: \"kubernetes.io/projected/57fe6294-da68-4e18-8c0c-8e5e12137a76-kube-api-access-gxx8q\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686127 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.686018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-model-cache\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686127 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.686047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe6294-da68-4e18-8c0c-8e5e12137a76-tls-certs\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686460 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.686430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-home\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686601 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.686505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-tmp-dir\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.686601 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.686552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-model-cache\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.688304 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.688281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-dshm\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.688563 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.688546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe6294-da68-4e18-8c0c-8e5e12137a76-tls-certs\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.694274 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.694250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxx8q\" (UniqueName: \"kubernetes.io/projected/57fe6294-da68-4e18-8c0c-8e5e12137a76-kube-api-access-gxx8q\") pod \"auth-test-model-eefca5-kserve-6b6b884967-smdxm\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") " pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.803882 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.803854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:43.929803 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:43.929774    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"]
Jul 11 04:28:43.933438 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:28:43.933406    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57fe6294_da68_4e18_8c0c_8e5e12137a76.slice/crio-e937e412fee23cc544ba1d8e0af17ac3b4db8adb45e631ab32057b22d1d11b28 WatchSource:0}: Error finding container e937e412fee23cc544ba1d8e0af17ac3b4db8adb45e631ab32057b22d1d11b28: Status 404 returned error can't find the container with id e937e412fee23cc544ba1d8e0af17ac3b4db8adb45e631ab32057b22d1d11b28
Jul 11 04:28:44.366702 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:44.366669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm" event={"ID":"57fe6294-da68-4e18-8c0c-8e5e12137a76","Type":"ContainerStarted","Data":"2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01"}
Jul 11 04:28:44.366702 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:44.366708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm" event={"ID":"57fe6294-da68-4e18-8c0c-8e5e12137a76","Type":"ContainerStarted","Data":"e937e412fee23cc544ba1d8e0af17ac3b4db8adb45e631ab32057b22d1d11b28"}
Jul 11 04:28:47.352835 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:47.352779    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm" podStartSLOduration=4.352760776 podStartE2EDuration="4.352760776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:28:44.38207792 +0000 UTC m=+2393.079349784" watchObservedRunningTime="2026-07-11 04:28:47.352760776 +0000 UTC m=+2396.050032638"
Jul 11 04:28:47.353213 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:47.353068    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:28:51.841378 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:51.841351    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:28:51.847011 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:51.846988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:28:53.804889 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:53.804850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:53.805345 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:53.805160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:53.817623 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:53.817595    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:28:54.422561 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:28:54.422532    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:29:01.453674 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:29:01.453641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:29:18.555076 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:29:18.554996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:29:33.355162 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:29:33.355123    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:29:48.149667 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:29:48.149631    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:30:05.957855 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:30:05.957811    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:30:20.655013 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:30:20.654973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:30:36.751348 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:30:36.751297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:30:51.175361 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:30:51.175264    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"]
Jul 11 04:30:51.987188 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:30:51.987155    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"]
Jul 11 04:30:55.454460 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:30:55.454428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:31:06.196566 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.196504    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2" podUID="d87c5d17-c67f-467c-b928-4ea5bcfdd199" containerName="main" containerID="cri-o://3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2" gracePeriod=45
Jul 11 04:31:06.451453 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.451398    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:31:06.505749 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505717    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tmp-dir\") pod \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") "
Jul 11 04:31:06.505936 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-model-cache\") pod \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") "
Jul 11 04:31:06.505936 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-home\") pod \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") "
Jul 11 04:31:06.505936 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505876    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tls-certs\") pod \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") "
Jul 11 04:31:06.505936 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twmwk\" (UniqueName: \"kubernetes.io/projected/d87c5d17-c67f-467c-b928-4ea5bcfdd199-kube-api-access-twmwk\") pod \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") "
Jul 11 04:31:06.506138 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-dshm\") pod \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\" (UID: \"d87c5d17-c67f-467c-b928-4ea5bcfdd199\") "
Jul 11 04:31:06.506138 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.505998    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d87c5d17-c67f-467c-b928-4ea5bcfdd199" (UID: "d87c5d17-c67f-467c-b928-4ea5bcfdd199"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:06.506138 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.506089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-model-cache" (OuterVolumeSpecName: "model-cache") pod "d87c5d17-c67f-467c-b928-4ea5bcfdd199" (UID: "d87c5d17-c67f-467c-b928-4ea5bcfdd199"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:06.506292 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.506134    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-home" (OuterVolumeSpecName: "home") pod "d87c5d17-c67f-467c-b928-4ea5bcfdd199" (UID: "d87c5d17-c67f-467c-b928-4ea5bcfdd199"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:06.506292 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.506267    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:06.506292 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.506287    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:06.506472 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.506299    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:06.508206 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.508177    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d87c5d17-c67f-467c-b928-4ea5bcfdd199" (UID: "d87c5d17-c67f-467c-b928-4ea5bcfdd199"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:31:06.508451 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.508434    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87c5d17-c67f-467c-b928-4ea5bcfdd199-kube-api-access-twmwk" (OuterVolumeSpecName: "kube-api-access-twmwk") pod "d87c5d17-c67f-467c-b928-4ea5bcfdd199" (UID: "d87c5d17-c67f-467c-b928-4ea5bcfdd199"). InnerVolumeSpecName "kube-api-access-twmwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:31:06.508936 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.508919    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-dshm" (OuterVolumeSpecName: "dshm") pod "d87c5d17-c67f-467c-b928-4ea5bcfdd199" (UID: "d87c5d17-c67f-467c-b928-4ea5bcfdd199"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:06.607276 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.607241    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87c5d17-c67f-467c-b928-4ea5bcfdd199-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:06.607276 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.607272    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twmwk\" (UniqueName: \"kubernetes.io/projected/d87c5d17-c67f-467c-b928-4ea5bcfdd199-kube-api-access-twmwk\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:06.607276 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.607282    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d87c5d17-c67f-467c-b928-4ea5bcfdd199-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:06.997397 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.997357    2580 generic.go:356] "Generic (PLEG): container finished" podID="d87c5d17-c67f-467c-b928-4ea5bcfdd199" containerID="3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2" exitCode=0
Jul 11 04:31:06.997597 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.997424    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"
Jul 11 04:31:06.997597 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.997437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2" event={"ID":"d87c5d17-c67f-467c-b928-4ea5bcfdd199","Type":"ContainerDied","Data":"3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2"}
Jul 11 04:31:06.997597 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.997483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2" event={"ID":"d87c5d17-c67f-467c-b928-4ea5bcfdd199","Type":"ContainerDied","Data":"4eb342b9543e275dc6467398e01636b7410b9f76b5fddb065bdb7c0e2588846a"}
Jul 11 04:31:06.997597 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:06.997501    2580 scope.go:117] "RemoveContainer" containerID="3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2"
Jul 11 04:31:07.006460 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.006443    2580 scope.go:117] "RemoveContainer" containerID="3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2"
Jul 11 04:31:07.006699 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:31:07.006679    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2\": container with ID starting with 3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2 not found: ID does not exist" containerID="3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2"
Jul 11 04:31:07.006761 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.006707    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2"} err="failed to get container status \"3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2\": rpc error: code = NotFound desc = could not find container \"3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2\": container with ID starting with 3560e56d9aefa1c3d5d13b3bc9fb16a96be0d2f3150c2c9d9042e7310e20cba2 not found: ID does not exist"
Jul 11 04:31:07.007661 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.007643    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm" podUID="57fe6294-da68-4e18-8c0c-8e5e12137a76" containerName="main" containerID="cri-o://2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01" gracePeriod=45
Jul 11 04:31:07.018207 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.018187    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"]
Jul 11 04:31:07.019635 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.019616    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/auth-test-model-3055d9-kserve-58b8b97547-v5pr2"]
Jul 11 04:31:07.253774 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.253713    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:31:07.313834 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.313807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-tmp-dir\") pod \"57fe6294-da68-4e18-8c0c-8e5e12137a76\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") "
Jul 11 04:31:07.313985 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.313839    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe6294-da68-4e18-8c0c-8e5e12137a76-tls-certs\") pod \"57fe6294-da68-4e18-8c0c-8e5e12137a76\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") "
Jul 11 04:31:07.313985 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.313863    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-home\") pod \"57fe6294-da68-4e18-8c0c-8e5e12137a76\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") "
Jul 11 04:31:07.313985 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.313896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxx8q\" (UniqueName: \"kubernetes.io/projected/57fe6294-da68-4e18-8c0c-8e5e12137a76-kube-api-access-gxx8q\") pod \"57fe6294-da68-4e18-8c0c-8e5e12137a76\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") "
Jul 11 04:31:07.313985 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.313934    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-dshm\") pod \"57fe6294-da68-4e18-8c0c-8e5e12137a76\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") "
Jul 11 04:31:07.314189 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314132    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-home" (OuterVolumeSpecName: "home") pod "57fe6294-da68-4e18-8c0c-8e5e12137a76" (UID: "57fe6294-da68-4e18-8c0c-8e5e12137a76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:07.314189 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314146    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57fe6294-da68-4e18-8c0c-8e5e12137a76" (UID: "57fe6294-da68-4e18-8c0c-8e5e12137a76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:07.314189 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314158    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-model-cache\") pod \"57fe6294-da68-4e18-8c0c-8e5e12137a76\" (UID: \"57fe6294-da68-4e18-8c0c-8e5e12137a76\") "
Jul 11 04:31:07.314468 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314443    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-model-cache" (OuterVolumeSpecName: "model-cache") pod "57fe6294-da68-4e18-8c0c-8e5e12137a76" (UID: "57fe6294-da68-4e18-8c0c-8e5e12137a76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:07.314582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314500    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:07.314582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314511    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:07.314582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.314521    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:07.316164 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.316139    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57fe6294-da68-4e18-8c0c-8e5e12137a76-kube-api-access-gxx8q" (OuterVolumeSpecName: "kube-api-access-gxx8q") pod "57fe6294-da68-4e18-8c0c-8e5e12137a76" (UID: "57fe6294-da68-4e18-8c0c-8e5e12137a76"). InnerVolumeSpecName "kube-api-access-gxx8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:31:07.316437 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.316420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57fe6294-da68-4e18-8c0c-8e5e12137a76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57fe6294-da68-4e18-8c0c-8e5e12137a76" (UID: "57fe6294-da68-4e18-8c0c-8e5e12137a76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:31:07.316515 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.316435    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-dshm" (OuterVolumeSpecName: "dshm") pod "57fe6294-da68-4e18-8c0c-8e5e12137a76" (UID: "57fe6294-da68-4e18-8c0c-8e5e12137a76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:31:07.415076 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.415034    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxx8q\" (UniqueName: \"kubernetes.io/projected/57fe6294-da68-4e18-8c0c-8e5e12137a76-kube-api-access-gxx8q\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:07.415076 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.415065    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe6294-da68-4e18-8c0c-8e5e12137a76-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:07.415076 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.415080    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe6294-da68-4e18-8c0c-8e5e12137a76-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:31:07.787886 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:07.787852    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d87c5d17-c67f-467c-b928-4ea5bcfdd199" path="/var/lib/kubelet/pods/d87c5d17-c67f-467c-b928-4ea5bcfdd199/volumes"
Jul 11 04:31:08.003624 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.003586    2580 generic.go:356] "Generic (PLEG): container finished" podID="57fe6294-da68-4e18-8c0c-8e5e12137a76" containerID="2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01" exitCode=0
Jul 11 04:31:08.003788 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.003632    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"
Jul 11 04:31:08.003788 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.003673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm" event={"ID":"57fe6294-da68-4e18-8c0c-8e5e12137a76","Type":"ContainerDied","Data":"2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01"}
Jul 11 04:31:08.003788 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.003717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm" event={"ID":"57fe6294-da68-4e18-8c0c-8e5e12137a76","Type":"ContainerDied","Data":"e937e412fee23cc544ba1d8e0af17ac3b4db8adb45e631ab32057b22d1d11b28"}
Jul 11 04:31:08.003788 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.003735    2580 scope.go:117] "RemoveContainer" containerID="2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01"
Jul 11 04:31:08.011859 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.011839    2580 scope.go:117] "RemoveContainer" containerID="2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01"
Jul 11 04:31:08.012135 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:31:08.012116    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01\": container with ID starting with 2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01 not found: ID does not exist" containerID="2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01"
Jul 11 04:31:08.012186 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.012143    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01"} err="failed to get container status \"2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01\": rpc error: code = NotFound desc = could not find container \"2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01\": container with ID starting with 2ae8a6dd1c5864597ea12d1e6422379c3a142eded7058910b33fe832436e4f01 not found: ID does not exist"
Jul 11 04:31:08.019589 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.019563    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"]
Jul 11 04:31:08.025200 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:08.025181    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/auth-test-model-eefca5-kserve-6b6b884967-smdxm"]
Jul 11 04:31:09.788241 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:09.788210    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57fe6294-da68-4e18-8c0c-8e5e12137a76" path="/var/lib/kubelet/pods/57fe6294-da68-4e18-8c0c-8e5e12137a76/volumes"
Jul 11 04:31:11.750387 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:11.750353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:31:57.385074 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"]
Jul 11 04:31:57.385600 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57fe6294-da68-4e18-8c0c-8e5e12137a76" containerName="main"
Jul 11 04:31:57.385600 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385407    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="57fe6294-da68-4e18-8c0c-8e5e12137a76" containerName="main"
Jul 11 04:31:57.385600 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385421    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87c5d17-c67f-467c-b928-4ea5bcfdd199" containerName="main"
Jul 11 04:31:57.385600 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385427    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87c5d17-c67f-467c-b928-4ea5bcfdd199" containerName="main"
Jul 11 04:31:57.385600 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385484    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="57fe6294-da68-4e18-8c0c-8e5e12137a76" containerName="main"
Jul 11 04:31:57.385600 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.385496    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87c5d17-c67f-467c-b928-4ea5bcfdd199" containerName="main"
Jul 11 04:31:57.389919 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.389893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.392284 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.392259    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"default-dockercfg-c4xsn\""
Jul 11 04:31:57.392395 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.392262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"openshift-service-ca.crt\""
Jul 11 04:31:57.393274 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.393255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"sub-test-model-eefca5-kserve-self-signed-certs\""
Jul 11 04:31:57.393420 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.393320    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"kube-root-ca.crt\""
Jul 11 04:31:57.399498 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.399477    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"]
Jul 11 04:31:57.441216 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.441186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvwg\" (UniqueName: \"kubernetes.io/projected/959492f4-e5a4-4b17-af59-80475dc2980f-kube-api-access-spvwg\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.441495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.441233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-home\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.441495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.441252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-dshm\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.441495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.441302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-model-cache\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.441495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.441409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959492f4-e5a4-4b17-af59-80475dc2980f-tls-certs\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.441495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.441470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-tmp-dir\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.542491 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.542456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959492f4-e5a4-4b17-af59-80475dc2980f-tls-certs\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.542491 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.542492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-tmp-dir\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.542705 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.542543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvwg\" (UniqueName: \"kubernetes.io/projected/959492f4-e5a4-4b17-af59-80475dc2980f-kube-api-access-spvwg\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.542705 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.542578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-home\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.542705 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.542601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-dshm\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.542705 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.542650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-model-cache\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.543069 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.543038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-home\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.543236 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.543092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-tmp-dir\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.543236 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.543148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-model-cache\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.544938 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.544913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-dshm\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.545041 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.544987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959492f4-e5a4-4b17-af59-80475dc2980f-tls-certs\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.549194 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.549177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvwg\" (UniqueName: \"kubernetes.io/projected/959492f4-e5a4-4b17-af59-80475dc2980f-kube-api-access-spvwg\") pod \"sub-test-model-eefca5-kserve-55dd5cf857-frglm\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") " pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.699503 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.699410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:31:57.834064 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:57.834036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"]
Jul 11 04:31:57.836575 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:31:57.836545    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod959492f4_e5a4_4b17_af59_80475dc2980f.slice/crio-3e49e177e63151b536e688082d6336939aa2240d079519d6b515cd2dd665771c WatchSource:0}: Error finding container 3e49e177e63151b536e688082d6336939aa2240d079519d6b515cd2dd665771c: Status 404 returned error can't find the container with id 3e49e177e63151b536e688082d6336939aa2240d079519d6b515cd2dd665771c
Jul 11 04:31:58.227717 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:58.227675    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm" event={"ID":"959492f4-e5a4-4b17-af59-80475dc2980f","Type":"ContainerStarted","Data":"32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0"}
Jul 11 04:31:58.227911 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:58.227731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm" event={"ID":"959492f4-e5a4-4b17-af59-80475dc2980f","Type":"ContainerStarted","Data":"3e49e177e63151b536e688082d6336939aa2240d079519d6b515cd2dd665771c"}
Jul 11 04:31:58.252812 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:31:58.252727    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm" podStartSLOduration=1.252702301 podStartE2EDuration="1.252702301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:31:58.249029385 +0000 UTC m=+2586.946301247" watchObservedRunningTime="2026-07-11 04:31:58.252702301 +0000 UTC m=+2586.949974164"
Jul 11 04:32:01.761061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:01.761028    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:32:07.700174 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:07.700139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:32:07.700611 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:07.700190    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:32:07.712305 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:07.712282    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:32:08.287445 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:08.287417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:32:17.254353 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:17.254238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:32:34.564371 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:34.564332    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"]
Jul 11 04:32:39.052191 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:39.052159    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:32:49.584795 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.584755    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm" podUID="959492f4-e5a4-4b17-af59-80475dc2980f" containerName="main" containerID="cri-o://32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0" gracePeriod=45
Jul 11 04:32:49.781460 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.781414    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"]
Jul 11 04:32:49.785398 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.785358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.788056 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.787925    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"kube-root-ca.crt\""
Jul 11 04:32:49.788457 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.788076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"default-dockercfg-s5vh7\""
Jul 11 04:32:49.789008 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.788861    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"openshift-service-ca.crt\""
Jul 11 04:32:49.789008 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.788891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"rate-test-model-3055d9-kserve-self-signed-certs\""
Jul 11 04:32:49.795022 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.794393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"]
Jul 11 04:32:49.843653 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.843591    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:32:49.926607 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959492f4-e5a4-4b17-af59-80475dc2980f-tls-certs\") pod \"959492f4-e5a4-4b17-af59-80475dc2980f\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") "
Jul 11 04:32:49.926796 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926660    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-model-cache\") pod \"959492f4-e5a4-4b17-af59-80475dc2980f\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") "
Jul 11 04:32:49.926796 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926727    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-dshm\") pod \"959492f4-e5a4-4b17-af59-80475dc2980f\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") "
Jul 11 04:32:49.926796 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spvwg\" (UniqueName: \"kubernetes.io/projected/959492f4-e5a4-4b17-af59-80475dc2980f-kube-api-access-spvwg\") pod \"959492f4-e5a4-4b17-af59-80475dc2980f\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") "
Jul 11 04:32:49.926796 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-home\") pod \"959492f4-e5a4-4b17-af59-80475dc2980f\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") "
Jul 11 04:32:49.927014 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-tmp-dir\") pod \"959492f4-e5a4-4b17-af59-80475dc2980f\" (UID: \"959492f4-e5a4-4b17-af59-80475dc2980f\") "
Jul 11 04:32:49.927014 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926910    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-model-cache" (OuterVolumeSpecName: "model-cache") pod "959492f4-e5a4-4b17-af59-80475dc2980f" (UID: "959492f4-e5a4-4b17-af59-80475dc2980f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.927014 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.926957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-dshm\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.927167 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-home" (OuterVolumeSpecName: "home") pod "959492f4-e5a4-4b17-af59-80475dc2980f" (UID: "959492f4-e5a4-4b17-af59-80475dc2980f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.927167 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-home\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.927261 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "959492f4-e5a4-4b17-af59-80475dc2980f" (UID: "959492f4-e5a4-4b17-af59-80475dc2980f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.927261 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-tmp-dir\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.927383 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-model-cache\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.927383 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8f0ed5-14aa-437b-a00a-49c08a001929-tls-certs\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.927474 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g6pt\" (UniqueName: \"kubernetes.io/projected/bf8f0ed5-14aa-437b-a00a-49c08a001929-kube-api-access-6g6pt\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:49.927548 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927494    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.927548 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927512    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.927548 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.927524    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.928989 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.928964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-dshm" (OuterVolumeSpecName: "dshm") pod "959492f4-e5a4-4b17-af59-80475dc2980f" (UID: "959492f4-e5a4-4b17-af59-80475dc2980f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.929324 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.929280    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959492f4-e5a4-4b17-af59-80475dc2980f-kube-api-access-spvwg" (OuterVolumeSpecName: "kube-api-access-spvwg") pod "959492f4-e5a4-4b17-af59-80475dc2980f" (UID: "959492f4-e5a4-4b17-af59-80475dc2980f"). InnerVolumeSpecName "kube-api-access-spvwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:32:49.929324 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:49.929296    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959492f4-e5a4-4b17-af59-80475dc2980f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "959492f4-e5a4-4b17-af59-80475dc2980f" (UID: "959492f4-e5a4-4b17-af59-80475dc2980f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:32:50.027979 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.027942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-home\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.027979 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.027992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-tmp-dir\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028238 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-model-cache\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028238 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8f0ed5-14aa-437b-a00a-49c08a001929-tls-certs\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028238 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g6pt\" (UniqueName: \"kubernetes.io/projected/bf8f0ed5-14aa-437b-a00a-49c08a001929-kube-api-access-6g6pt\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028238 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-dshm\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028540 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-tmp-dir\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028540 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028490    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959492f4-e5a4-4b17-af59-80475dc2980f-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:32:50.028540 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028514    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spvwg\" (UniqueName: \"kubernetes.io/projected/959492f4-e5a4-4b17-af59-80475dc2980f-kube-api-access-spvwg\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:32:50.028540 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-home\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028540 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-model-cache\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.028795 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.028530    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959492f4-e5a4-4b17-af59-80475dc2980f-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:32:50.030695 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.030665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-dshm\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.030961 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.030939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8f0ed5-14aa-437b-a00a-49c08a001929-tls-certs\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.035809 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.035789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g6pt\" (UniqueName: \"kubernetes.io/projected/bf8f0ed5-14aa-437b-a00a-49c08a001929-kube-api-access-6g6pt\") pod \"rate-test-model-3055d9-kserve-6f875d6795-qj2br\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") " pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.098741 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.098653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:32:50.232721 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.232698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"]
Jul 11 04:32:50.235339 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:32:50.235298    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf8f0ed5_14aa_437b_a00a_49c08a001929.slice/crio-4ec75cd88c6130dc53787e860aacb2994dcde4a18bcf0be2e65dc04172614779 WatchSource:0}: Error finding container 4ec75cd88c6130dc53787e860aacb2994dcde4a18bcf0be2e65dc04172614779: Status 404 returned error can't find the container with id 4ec75cd88c6130dc53787e860aacb2994dcde4a18bcf0be2e65dc04172614779
Jul 11 04:32:50.461335 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.461233    2580 generic.go:356] "Generic (PLEG): container finished" podID="959492f4-e5a4-4b17-af59-80475dc2980f" containerID="32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0" exitCode=0
Jul 11 04:32:50.461335 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.461285    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"
Jul 11 04:32:50.461575 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.461348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm" event={"ID":"959492f4-e5a4-4b17-af59-80475dc2980f","Type":"ContainerDied","Data":"32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0"}
Jul 11 04:32:50.461575 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.461388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm" event={"ID":"959492f4-e5a4-4b17-af59-80475dc2980f","Type":"ContainerDied","Data":"3e49e177e63151b536e688082d6336939aa2240d079519d6b515cd2dd665771c"}
Jul 11 04:32:50.462346 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.461409    2580 scope.go:117] "RemoveContainer" containerID="32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0"
Jul 11 04:32:50.463153 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.463086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br" event={"ID":"bf8f0ed5-14aa-437b-a00a-49c08a001929","Type":"ContainerStarted","Data":"635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d"}
Jul 11 04:32:50.463256 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.463155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br" event={"ID":"bf8f0ed5-14aa-437b-a00a-49c08a001929","Type":"ContainerStarted","Data":"4ec75cd88c6130dc53787e860aacb2994dcde4a18bcf0be2e65dc04172614779"}
Jul 11 04:32:50.471599 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.471582    2580 scope.go:117] "RemoveContainer" containerID="32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0"
Jul 11 04:32:50.471820 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:32:50.471802    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0\": container with ID starting with 32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0 not found: ID does not exist" containerID="32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0"
Jul 11 04:32:50.471867 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.471826    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0"} err="failed to get container status \"32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0\": rpc error: code = NotFound desc = could not find container \"32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0\": container with ID starting with 32b47f8934a7be40b7844273633fd45b1ef6a2037e716195b739e090379370c0 not found: ID does not exist"
Jul 11 04:32:50.481696 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.481656    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br" podStartSLOduration=1.481644018 podStartE2EDuration="1.481644018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:32:50.479733819 +0000 UTC m=+2639.177005682" watchObservedRunningTime="2026-07-11 04:32:50.481644018 +0000 UTC m=+2639.178915880"
Jul 11 04:32:50.492673 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.492650    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"]
Jul 11 04:32:50.495786 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:50.495762    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/sub-test-model-eefca5-kserve-55dd5cf857-frglm"]
Jul 11 04:32:51.788566 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:51.788532    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959492f4-e5a4-4b17-af59-80475dc2980f" path="/var/lib/kubelet/pods/959492f4-e5a4-4b17-af59-80475dc2980f/volumes"
Jul 11 04:32:55.458674 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:32:55.458635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:33:00.098791 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:00.098757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:33:00.099124 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:00.098828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:33:00.111181 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:00.111158    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:33:00.518933 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:00.518842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:33:05.679061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.679031    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"]
Jul 11 04:33:05.679582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.679437    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959492f4-e5a4-4b17-af59-80475dc2980f" containerName="main"
Jul 11 04:33:05.679582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.679453    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="959492f4-e5a4-4b17-af59-80475dc2980f" containerName="main"
Jul 11 04:33:05.679582 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.679510    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="959492f4-e5a4-4b17-af59-80475dc2980f" containerName="main"
Jul 11 04:33:05.682506 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.682489    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.685065 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.685046    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"openshift-service-ca.crt\""
Jul 11 04:33:05.686158 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.686141    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"kube-root-ca.crt\""
Jul 11 04:33:05.686265 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.686163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"default-dockercfg-c4xsn\""
Jul 11 04:33:05.686265 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.686258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-eefca5\"/\"rate-test-model-eefca5-kserve-self-signed-certs\""
Jul 11 04:33:05.690238 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.690217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"]
Jul 11 04:33:05.771787 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.771757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-model-cache\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.771958 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.771810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46946caa-1965-48c1-9652-d4725308caee-tls-certs\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.771958 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.771848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmz7\" (UniqueName: \"kubernetes.io/projected/46946caa-1965-48c1-9652-d4725308caee-kube-api-access-6mmz7\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.771958 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.771887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-home\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.772059 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.771954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-tmp-dir\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.772098 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.772054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-dshm\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873080 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-model-cache\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873268 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46946caa-1965-48c1-9652-d4725308caee-tls-certs\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873268 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmz7\" (UniqueName: \"kubernetes.io/projected/46946caa-1965-48c1-9652-d4725308caee-kube-api-access-6mmz7\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873268 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-home\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873268 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-tmp-dir\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873268 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-dshm\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873583 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-model-cache\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873583 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-home\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.873678 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.873609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-tmp-dir\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.875490 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.875474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-dshm\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.875894 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.875873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46946caa-1965-48c1-9652-d4725308caee-tls-certs\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.881138 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.881116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmz7\" (UniqueName: \"kubernetes.io/projected/46946caa-1965-48c1-9652-d4725308caee-kube-api-access-6mmz7\") pod \"rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") " pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:05.993175 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:05.993098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:06.120533 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:06.120429    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"]
Jul 11 04:33:06.123239 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:33:06.123211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46946caa_1965_48c1_9652_d4725308caee.slice/crio-f1eb502319e5a7c47901007fb8d1ee4da92fcc9ffbed958ac850ed92a1daedd4 WatchSource:0}: Error finding container f1eb502319e5a7c47901007fb8d1ee4da92fcc9ffbed958ac850ed92a1daedd4: Status 404 returned error can't find the container with id f1eb502319e5a7c47901007fb8d1ee4da92fcc9ffbed958ac850ed92a1daedd4
Jul 11 04:33:06.535779 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:06.535744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r" event={"ID":"46946caa-1965-48c1-9652-d4725308caee","Type":"ContainerStarted","Data":"203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b"}
Jul 11 04:33:06.535779 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:06.535789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r" event={"ID":"46946caa-1965-48c1-9652-d4725308caee","Type":"ContainerStarted","Data":"f1eb502319e5a7c47901007fb8d1ee4da92fcc9ffbed958ac850ed92a1daedd4"}
Jul 11 04:33:06.553628 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:06.553571    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r" podStartSLOduration=1.5535543779999998 podStartE2EDuration="1.553554378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:33:06.552396311 +0000 UTC m=+2655.249668173" watchObservedRunningTime="2026-07-11 04:33:06.553554378 +0000 UTC m=+2655.250826274"
Jul 11 04:33:13.550631 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:13.550589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:33:15.993532 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:15.993487    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:15.993532 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:15.993541    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:16.006232 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:16.006197    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:16.592200 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:16.592175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:33:32.457542 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:32.457506    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:33:50.460241 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:50.460152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:33:51.868499 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:51.868469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:33:51.877140 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:51.877113    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l5tn_ecbdffa3-52ad-4b41-9f5d-73e94cd82788/ovn-acl-logging/0.log"
Jul 11 04:33:54.861174 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:54.861142    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"]
Jul 11 04:33:55.791067 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:55.791040    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"]
Jul 11 04:33:56.749802 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.749772    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7783-140586032249776"]
Jul 11 04:33:56.753343 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.753298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:33:56.755967 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.755945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-47b7r\""
Jul 11 04:33:56.758905 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.758883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032249776"]
Jul 11 04:33:56.832775 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.832729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6l9l\" (UniqueName: \"kubernetes.io/projected/d17ad6b1-39b6-49ff-b148-a49ce37dc819-kube-api-access-j6l9l\") pod \"test-curl-7783-140586032249776\" (UID: \"d17ad6b1-39b6-49ff-b148-a49ce37dc819\") " pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:33:56.933647 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.933613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6l9l\" (UniqueName: \"kubernetes.io/projected/d17ad6b1-39b6-49ff-b148-a49ce37dc819-kube-api-access-j6l9l\") pod \"test-curl-7783-140586032249776\" (UID: \"d17ad6b1-39b6-49ff-b148-a49ce37dc819\") " pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:33:56.940986 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:56.940957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6l9l\" (UniqueName: \"kubernetes.io/projected/d17ad6b1-39b6-49ff-b148-a49ce37dc819-kube-api-access-j6l9l\") pod \"test-curl-7783-140586032249776\" (UID: \"d17ad6b1-39b6-49ff-b148-a49ce37dc819\") " pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:33:57.063612 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:57.063583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:33:57.194648 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:57.194617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032249776"]
Jul 11 04:33:57.196918 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:33:57.196885    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd17ad6b1_39b6_49ff_b148_a49ce37dc819.slice/crio-31259b46dc858d33f80ea9785719d6f41936e7189ad3069e31a90ca97a59d802 WatchSource:0}: Error finding container 31259b46dc858d33f80ea9785719d6f41936e7189ad3069e31a90ca97a59d802: Status 404 returned error can't find the container with id 31259b46dc858d33f80ea9785719d6f41936e7189ad3069e31a90ca97a59d802
Jul 11 04:33:57.198247 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:57.198229    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 04:33:57.760079 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:57.760038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032249776" event={"ID":"d17ad6b1-39b6-49ff-b148-a49ce37dc819","Type":"ContainerStarted","Data":"31259b46dc858d33f80ea9785719d6f41936e7189ad3069e31a90ca97a59d802"}
Jul 11 04:33:58.766682 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:58.766651    2580 generic.go:356] "Generic (PLEG): container finished" podID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" containerID="e6734f7fc81d5ee58bde3e96f7d410344920dceaf429cd6f6b7afde9a76a6922" exitCode=0
Jul 11 04:33:58.767050 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:58.766729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032249776" event={"ID":"d17ad6b1-39b6-49ff-b148-a49ce37dc819","Type":"ContainerDied","Data":"e6734f7fc81d5ee58bde3e96f7d410344920dceaf429cd6f6b7afde9a76a6922"}
Jul 11 04:33:59.905526 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:59.905500    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:33:59.937925 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:59.937894    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7783-140586032249776_d17ad6b1-39b6-49ff-b148-a49ce37dc819/test-curl-7783-140586032249776/0.log"
Jul 11 04:33:59.960571 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:59.960541    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7783-140586032249776"]
Jul 11 04:33:59.962762 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:59.962734    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6l9l\" (UniqueName: \"kubernetes.io/projected/d17ad6b1-39b6-49ff-b148-a49ce37dc819-kube-api-access-j6l9l\") pod \"d17ad6b1-39b6-49ff-b148-a49ce37dc819\" (UID: \"d17ad6b1-39b6-49ff-b148-a49ce37dc819\") "
Jul 11 04:33:59.963332 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:59.963295    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7783-140586032249776"]
Jul 11 04:33:59.964943 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:33:59.964924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17ad6b1-39b6-49ff-b148-a49ce37dc819-kube-api-access-j6l9l" (OuterVolumeSpecName: "kube-api-access-j6l9l") pod "d17ad6b1-39b6-49ff-b148-a49ce37dc819" (UID: "d17ad6b1-39b6-49ff-b148-a49ce37dc819"). InnerVolumeSpecName "kube-api-access-j6l9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:00.063932 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.063904    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6l9l\" (UniqueName: \"kubernetes.io/projected/d17ad6b1-39b6-49ff-b148-a49ce37dc819-kube-api-access-j6l9l\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:00.083219 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.083191    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7783-140586032250160"]
Jul 11 04:34:00.083629 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.083612    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" containerName="test-curl-7783-140586032249776"
Jul 11 04:34:00.083712 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.083632    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" containerName="test-curl-7783-140586032249776"
Jul 11 04:34:00.083766 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.083747    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" containerName="test-curl-7783-140586032249776"
Jul 11 04:34:00.086748 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.086728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:00.089507 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.089486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032250160"]
Jul 11 04:34:00.164846 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.164810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sp8w\" (UniqueName: \"kubernetes.io/projected/1ea953f8-7945-4c6c-9eda-83c4c9f41304-kube-api-access-6sp8w\") pod \"test-curl-7783-140586032250160\" (UID: \"1ea953f8-7945-4c6c-9eda-83c4c9f41304\") " pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:00.265753 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.265708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sp8w\" (UniqueName: \"kubernetes.io/projected/1ea953f8-7945-4c6c-9eda-83c4c9f41304-kube-api-access-6sp8w\") pod \"test-curl-7783-140586032250160\" (UID: \"1ea953f8-7945-4c6c-9eda-83c4c9f41304\") " pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:00.273515 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.273490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sp8w\" (UniqueName: \"kubernetes.io/projected/1ea953f8-7945-4c6c-9eda-83c4c9f41304-kube-api-access-6sp8w\") pod \"test-curl-7783-140586032250160\" (UID: \"1ea953f8-7945-4c6c-9eda-83c4c9f41304\") " pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:00.396804 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.396713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:00.523107 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.523082    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032250160"]
Jul 11 04:34:00.524875 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:34:00.524850    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ea953f8_7945_4c6c_9eda_83c4c9f41304.slice/crio-61626bbc149271d985aba86e6fa4e4ca73bc69ab819df24d77f144e3940e48f0 WatchSource:0}: Error finding container 61626bbc149271d985aba86e6fa4e4ca73bc69ab819df24d77f144e3940e48f0: Status 404 returned error can't find the container with id 61626bbc149271d985aba86e6fa4e4ca73bc69ab819df24d77f144e3940e48f0
Jul 11 04:34:00.778019 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.777940    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:34:00.778019 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.777978    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31259b46dc858d33f80ea9785719d6f41936e7189ad3069e31a90ca97a59d802"
Jul 11 04:34:00.779068 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:00.779039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032250160" event={"ID":"1ea953f8-7945-4c6c-9eda-83c4c9f41304","Type":"ContainerStarted","Data":"61626bbc149271d985aba86e6fa4e4ca73bc69ab819df24d77f144e3940e48f0"}
Jul 11 04:34:00.788284 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:34:00.788260    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-140586032249776\" is forbidden: User \"system:node:ip-10-0-134-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-138.ec2.internal' and this object" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:34:01.786459 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:01.786426    2580 generic.go:356] "Generic (PLEG): container finished" podID="1ea953f8-7945-4c6c-9eda-83c4c9f41304" containerID="6a72d6ab234f69ed8c8da78cb48fec53365c237e5904bc15194bb69eb820701c" exitCode=0
Jul 11 04:34:01.786945 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:34:01.786920    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-140586032249776\" is forbidden: User \"system:node:ip-10-0-134-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-138.ec2.internal' and this object" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:34:01.789302 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:01.789274    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" path="/var/lib/kubelet/pods/d17ad6b1-39b6-49ff-b148-a49ce37dc819/volumes"
Jul 11 04:34:01.789583 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:01.789565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032250160" event={"ID":"1ea953f8-7945-4c6c-9eda-83c4c9f41304","Type":"ContainerDied","Data":"6a72d6ab234f69ed8c8da78cb48fec53365c237e5904bc15194bb69eb820701c"}
Jul 11 04:34:01.801216 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:34:01.801184    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-140586032249776\" is forbidden: User \"system:node:ip-10-0-134-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-138.ec2.internal' and this object" podUID="d17ad6b1-39b6-49ff-b148-a49ce37dc819" pod="openshift-ingress/test-curl-7783-140586032249776"
Jul 11 04:34:02.928435 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:02.928411    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:02.945850 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:02.945829    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7783-140586032250160_1ea953f8-7945-4c6c-9eda-83c4c9f41304/test-curl-7783-140586032250160/0.log"
Jul 11 04:34:02.968552 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:02.968528    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7783-140586032250160"]
Jul 11 04:34:02.970604 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:02.970581    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7783-140586032250160"]
Jul 11 04:34:02.988061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:02.988041    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sp8w\" (UniqueName: \"kubernetes.io/projected/1ea953f8-7945-4c6c-9eda-83c4c9f41304-kube-api-access-6sp8w\") pod \"1ea953f8-7945-4c6c-9eda-83c4c9f41304\" (UID: \"1ea953f8-7945-4c6c-9eda-83c4c9f41304\") "
Jul 11 04:34:02.990029 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:02.990009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea953f8-7945-4c6c-9eda-83c4c9f41304-kube-api-access-6sp8w" (OuterVolumeSpecName: "kube-api-access-6sp8w") pod "1ea953f8-7945-4c6c-9eda-83c4c9f41304" (UID: "1ea953f8-7945-4c6c-9eda-83c4c9f41304"). InnerVolumeSpecName "kube-api-access-6sp8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:03.089413 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.089341    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sp8w\" (UniqueName: \"kubernetes.io/projected/1ea953f8-7945-4c6c-9eda-83c4c9f41304-kube-api-access-6sp8w\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:03.123180 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.123152    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:03.123559 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.123543    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea953f8-7945-4c6c-9eda-83c4c9f41304" containerName="test-curl-7783-140586032250160"
Jul 11 04:34:03.123649 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.123561    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea953f8-7945-4c6c-9eda-83c4c9f41304" containerName="test-curl-7783-140586032250160"
Jul 11 04:34:03.123703 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.123656    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea953f8-7945-4c6c-9eda-83c4c9f41304" containerName="test-curl-7783-140586032250160"
Jul 11 04:34:03.126589 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.126571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:03.132031 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.132009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:03.190525 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.190486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr85j\" (UniqueName: \"kubernetes.io/projected/43c2e271-2868-4143-9f93-16ae98c80f3c-kube-api-access-mr85j\") pod \"test-curl-7783-140586032472544\" (UID: \"43c2e271-2868-4143-9f93-16ae98c80f3c\") " pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:03.291644 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.291614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr85j\" (UniqueName: \"kubernetes.io/projected/43c2e271-2868-4143-9f93-16ae98c80f3c-kube-api-access-mr85j\") pod \"test-curl-7783-140586032472544\" (UID: \"43c2e271-2868-4143-9f93-16ae98c80f3c\") " pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:03.299118 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.299097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr85j\" (UniqueName: \"kubernetes.io/projected/43c2e271-2868-4143-9f93-16ae98c80f3c-kube-api-access-mr85j\") pod \"test-curl-7783-140586032472544\" (UID: \"43c2e271-2868-4143-9f93-16ae98c80f3c\") " pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:03.436937 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.436861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:03.561715 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.561689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:03.563910 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:34:03.563878    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43c2e271_2868_4143_9f93_16ae98c80f3c.slice/crio-b92c4f871572272e39c706aa024feffdaf0105a0ceac10cc61183e9a5e71bea3 WatchSource:0}: Error finding container b92c4f871572272e39c706aa024feffdaf0105a0ceac10cc61183e9a5e71bea3: Status 404 returned error can't find the container with id b92c4f871572272e39c706aa024feffdaf0105a0ceac10cc61183e9a5e71bea3
Jul 11 04:34:03.788198 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.788118    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea953f8-7945-4c6c-9eda-83c4c9f41304" path="/var/lib/kubelet/pods/1ea953f8-7945-4c6c-9eda-83c4c9f41304/volumes"
Jul 11 04:34:03.796403 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.796363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032472544" event={"ID":"43c2e271-2868-4143-9f93-16ae98c80f3c","Type":"ContainerStarted","Data":"b92c4f871572272e39c706aa024feffdaf0105a0ceac10cc61183e9a5e71bea3"}
Jul 11 04:34:03.797698 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.797681    2580 scope.go:117] "RemoveContainer" containerID="6a72d6ab234f69ed8c8da78cb48fec53365c237e5904bc15194bb69eb820701c"
Jul 11 04:34:03.797698 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:03.797690    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032250160"
Jul 11 04:34:04.803942 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:04.803907    2580 generic.go:356] "Generic (PLEG): container finished" podID="43c2e271-2868-4143-9f93-16ae98c80f3c" containerID="bf4260c443797385780f8f78cb6b82a1fa21b5bf1828af42f24521f8cf08ef6a" exitCode=0
Jul 11 04:34:04.804391 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:04.803998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032472544" event={"ID":"43c2e271-2868-4143-9f93-16ae98c80f3c","Type":"ContainerDied","Data":"bf4260c443797385780f8f78cb6b82a1fa21b5bf1828af42f24521f8cf08ef6a"}
Jul 11 04:34:05.945293 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:05.945271    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:05.962962 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:05.962933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7783-140586032472544_43c2e271-2868-4143-9f93-16ae98c80f3c/test-curl-7783-140586032472544/0.log"
Jul 11 04:34:05.984641 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:05.984614    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:05.988278 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:05.988244    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:06.015715 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.015678    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr85j\" (UniqueName: \"kubernetes.io/projected/43c2e271-2868-4143-9f93-16ae98c80f3c-kube-api-access-mr85j\") pod \"43c2e271-2868-4143-9f93-16ae98c80f3c\" (UID: \"43c2e271-2868-4143-9f93-16ae98c80f3c\") "
Jul 11 04:34:06.017894 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.017865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c2e271-2868-4143-9f93-16ae98c80f3c-kube-api-access-mr85j" (OuterVolumeSpecName: "kube-api-access-mr85j") pod "43c2e271-2868-4143-9f93-16ae98c80f3c" (UID: "43c2e271-2868-4143-9f93-16ae98c80f3c"). InnerVolumeSpecName "kube-api-access-mr85j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:06.106716 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.106635    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:06.106987 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.106975    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c2e271-2868-4143-9f93-16ae98c80f3c" containerName="test-curl-7783-140586032472544"
Jul 11 04:34:06.107028 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.106988    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c2e271-2868-4143-9f93-16ae98c80f3c" containerName="test-curl-7783-140586032472544"
Jul 11 04:34:06.107065 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.107051    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c2e271-2868-4143-9f93-16ae98c80f3c" containerName="test-curl-7783-140586032472544"
Jul 11 04:34:06.109883 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.109865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:06.116980 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.116810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:06.116980 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.116811    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr85j\" (UniqueName: \"kubernetes.io/projected/43c2e271-2868-4143-9f93-16ae98c80f3c-kube-api-access-mr85j\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:06.217695 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.217655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jz5\" (UniqueName: \"kubernetes.io/projected/a2a5bcab-4ef1-4912-b642-6e66826c1f21-kube-api-access-r2jz5\") pod \"test-curl-7783-140586032472544\" (UID: \"a2a5bcab-4ef1-4912-b642-6e66826c1f21\") " pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:06.319075 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.319037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jz5\" (UniqueName: \"kubernetes.io/projected/a2a5bcab-4ef1-4912-b642-6e66826c1f21-kube-api-access-r2jz5\") pod \"test-curl-7783-140586032472544\" (UID: \"a2a5bcab-4ef1-4912-b642-6e66826c1f21\") " pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:06.326415 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.326382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jz5\" (UniqueName: \"kubernetes.io/projected/a2a5bcab-4ef1-4912-b642-6e66826c1f21-kube-api-access-r2jz5\") pod \"test-curl-7783-140586032472544\" (UID: \"a2a5bcab-4ef1-4912-b642-6e66826c1f21\") " pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:06.420179 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.420098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:06.549043 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.549023    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:06.550944 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:34:06.550913    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2a5bcab_4ef1_4912_b642_6e66826c1f21.slice/crio-083904adde214f75668700aed35be8ff2a9e6e89162b262566ee8e9d7d336f89 WatchSource:0}: Error finding container 083904adde214f75668700aed35be8ff2a9e6e89162b262566ee8e9d7d336f89: Status 404 returned error can't find the container with id 083904adde214f75668700aed35be8ff2a9e6e89162b262566ee8e9d7d336f89
Jul 11 04:34:06.814899 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.814867    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:06.815070 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.814919    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b92c4f871572272e39c706aa024feffdaf0105a0ceac10cc61183e9a5e71bea3"
Jul 11 04:34:06.816158 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.816136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032472544" event={"ID":"a2a5bcab-4ef1-4912-b642-6e66826c1f21","Type":"ContainerStarted","Data":"083904adde214f75668700aed35be8ff2a9e6e89162b262566ee8e9d7d336f89"}
Jul 11 04:34:06.826445 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:06.826413    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7783-140586032472544" oldPodUID="43c2e271-2868-4143-9f93-16ae98c80f3c" podUID="a2a5bcab-4ef1-4912-b642-6e66826c1f21"
Jul 11 04:34:07.788264 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:07.788226    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c2e271-2868-4143-9f93-16ae98c80f3c" path="/var/lib/kubelet/pods/43c2e271-2868-4143-9f93-16ae98c80f3c/volumes"
Jul 11 04:34:07.821559 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:07.821530    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a5bcab-4ef1-4912-b642-6e66826c1f21" containerID="534fc51ce03683fccbe357b262182aea73eda2441a3271f01f8ebb88fee91952" exitCode=0
Jul 11 04:34:07.821704 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:07.821615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032472544" event={"ID":"a2a5bcab-4ef1-4912-b642-6e66826c1f21","Type":"ContainerDied","Data":"534fc51ce03683fccbe357b262182aea73eda2441a3271f01f8ebb88fee91952"}
Jul 11 04:34:07.952628 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:07.952588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:34:08.964878 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:08.964852    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:08.982671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:08.982643    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7783-140586032472544_a2a5bcab-4ef1-4912-b642-6e66826c1f21/test-curl-7783-140586032472544/0.log"
Jul 11 04:34:09.003891 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.003856    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:09.007376 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.007351    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7783-140586032472544"]
Jul 11 04:34:09.043967 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.043937    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jz5\" (UniqueName: \"kubernetes.io/projected/a2a5bcab-4ef1-4912-b642-6e66826c1f21-kube-api-access-r2jz5\") pod \"a2a5bcab-4ef1-4912-b642-6e66826c1f21\" (UID: \"a2a5bcab-4ef1-4912-b642-6e66826c1f21\") "
Jul 11 04:34:09.046116 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.046089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a5bcab-4ef1-4912-b642-6e66826c1f21-kube-api-access-r2jz5" (OuterVolumeSpecName: "kube-api-access-r2jz5") pod "a2a5bcab-4ef1-4912-b642-6e66826c1f21" (UID: "a2a5bcab-4ef1-4912-b642-6e66826c1f21"). InnerVolumeSpecName "kube-api-access-r2jz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:09.144821 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.144737    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jz5\" (UniqueName: \"kubernetes.io/projected/a2a5bcab-4ef1-4912-b642-6e66826c1f21-kube-api-access-r2jz5\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:09.787976 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.787941    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a5bcab-4ef1-4912-b642-6e66826c1f21" path="/var/lib/kubelet/pods/a2a5bcab-4ef1-4912-b642-6e66826c1f21/volumes"
Jul 11 04:34:09.831601 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.831572    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032472544"
Jul 11 04:34:09.831739 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.831625    2580 scope.go:117] "RemoveContainer" containerID="534fc51ce03683fccbe357b262182aea73eda2441a3271f01f8ebb88fee91952"
Jul 11 04:34:09.881293 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:09.881259    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br" podUID="bf8f0ed5-14aa-437b-a00a-49c08a001929" containerName="main" containerID="cri-o://635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d" gracePeriod=45
Jul 11 04:34:10.136129 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.136104    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:34:10.253658 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253626    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8f0ed5-14aa-437b-a00a-49c08a001929-tls-certs\") pod \"bf8f0ed5-14aa-437b-a00a-49c08a001929\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") "
Jul 11 04:34:10.253808 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253695    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-model-cache\") pod \"bf8f0ed5-14aa-437b-a00a-49c08a001929\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") "
Jul 11 04:34:10.253808 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g6pt\" (UniqueName: \"kubernetes.io/projected/bf8f0ed5-14aa-437b-a00a-49c08a001929-kube-api-access-6g6pt\") pod \"bf8f0ed5-14aa-437b-a00a-49c08a001929\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") "
Jul 11 04:34:10.253989 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253818    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-home\") pod \"bf8f0ed5-14aa-437b-a00a-49c08a001929\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") "
Jul 11 04:34:10.253989 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253895    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-dshm\") pod \"bf8f0ed5-14aa-437b-a00a-49c08a001929\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") "
Jul 11 04:34:10.253989 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-tmp-dir\") pod \"bf8f0ed5-14aa-437b-a00a-49c08a001929\" (UID: \"bf8f0ed5-14aa-437b-a00a-49c08a001929\") "
Jul 11 04:34:10.254149 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.253998    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf8f0ed5-14aa-437b-a00a-49c08a001929" (UID: "bf8f0ed5-14aa-437b-a00a-49c08a001929"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:10.254149 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.254057    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-home" (OuterVolumeSpecName: "home") pod "bf8f0ed5-14aa-437b-a00a-49c08a001929" (UID: "bf8f0ed5-14aa-437b-a00a-49c08a001929"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:10.254288 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.254247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf8f0ed5-14aa-437b-a00a-49c08a001929" (UID: "bf8f0ed5-14aa-437b-a00a-49c08a001929"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:10.254288 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.254266    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:10.254495 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.254302    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:10.255889 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.255857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf8f0ed5-14aa-437b-a00a-49c08a001929-kube-api-access-6g6pt" (OuterVolumeSpecName: "kube-api-access-6g6pt") pod "bf8f0ed5-14aa-437b-a00a-49c08a001929" (UID: "bf8f0ed5-14aa-437b-a00a-49c08a001929"). InnerVolumeSpecName "kube-api-access-6g6pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:10.256004 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.255911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-dshm" (OuterVolumeSpecName: "dshm") pod "bf8f0ed5-14aa-437b-a00a-49c08a001929" (UID: "bf8f0ed5-14aa-437b-a00a-49c08a001929"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:10.256004 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.255934    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf8f0ed5-14aa-437b-a00a-49c08a001929-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf8f0ed5-14aa-437b-a00a-49c08a001929" (UID: "bf8f0ed5-14aa-437b-a00a-49c08a001929"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:34:10.355571 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.355510    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8f0ed5-14aa-437b-a00a-49c08a001929-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:10.355571 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.355531    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g6pt\" (UniqueName: \"kubernetes.io/projected/bf8f0ed5-14aa-437b-a00a-49c08a001929-kube-api-access-6g6pt\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:10.355571 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.355543    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:10.355571 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.355552    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8f0ed5-14aa-437b-a00a-49c08a001929-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:10.812631 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.812585    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r" podUID="46946caa-1965-48c1-9652-d4725308caee" containerName="main" containerID="cri-o://203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b" gracePeriod=45
Jul 11 04:34:10.838824 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.838797    2580 generic.go:356] "Generic (PLEG): container finished" podID="bf8f0ed5-14aa-437b-a00a-49c08a001929" containerID="635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d" exitCode=0
Jul 11 04:34:10.838950 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.838847    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"
Jul 11 04:34:10.838950 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.838878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br" event={"ID":"bf8f0ed5-14aa-437b-a00a-49c08a001929","Type":"ContainerDied","Data":"635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d"}
Jul 11 04:34:10.838950 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.838926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br" event={"ID":"bf8f0ed5-14aa-437b-a00a-49c08a001929","Type":"ContainerDied","Data":"4ec75cd88c6130dc53787e860aacb2994dcde4a18bcf0be2e65dc04172614779"}
Jul 11 04:34:10.839078 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.838951    2580 scope.go:117] "RemoveContainer" containerID="635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d"
Jul 11 04:34:10.884959 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.884921    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"]
Jul 11 04:34:10.888081 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.888057    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/rate-test-model-3055d9-kserve-6f875d6795-qj2br"]
Jul 11 04:34:10.923107 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.923085    2580 scope.go:117] "RemoveContainer" containerID="635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d"
Jul 11 04:34:10.923444 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:34:10.923425    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d\": container with ID starting with 635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d not found: ID does not exist" containerID="635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d"
Jul 11 04:34:10.923516 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:10.923453    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d"} err="failed to get container status \"635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d\": rpc error: code = NotFound desc = could not find container \"635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d\": container with ID starting with 635cf03c59982c66028dfc9cab09b5da4bd2c205981e977dbfaa0407a28ecf4d not found: ID does not exist"
Jul 11 04:34:11.078632 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.078608    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:34:11.164196 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mmz7\" (UniqueName: \"kubernetes.io/projected/46946caa-1965-48c1-9652-d4725308caee-kube-api-access-6mmz7\") pod \"46946caa-1965-48c1-9652-d4725308caee\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") "
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164213    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-tmp-dir\") pod \"46946caa-1965-48c1-9652-d4725308caee\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") "
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-home\") pod \"46946caa-1965-48c1-9652-d4725308caee\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") "
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-dshm\") pod \"46946caa-1965-48c1-9652-d4725308caee\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") "
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164368    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-model-cache\") pod \"46946caa-1965-48c1-9652-d4725308caee\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") "
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164423    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46946caa-1965-48c1-9652-d4725308caee-tls-certs\") pod \"46946caa-1965-48c1-9652-d4725308caee\" (UID: \"46946caa-1965-48c1-9652-d4725308caee\") "
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164512    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46946caa-1965-48c1-9652-d4725308caee" (UID: "46946caa-1965-48c1-9652-d4725308caee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164528    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-home" (OuterVolumeSpecName: "home") pod "46946caa-1965-48c1-9652-d4725308caee" (UID: "46946caa-1965-48c1-9652-d4725308caee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:11.164671 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164627    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-model-cache" (OuterVolumeSpecName: "model-cache") pod "46946caa-1965-48c1-9652-d4725308caee" (UID: "46946caa-1965-48c1-9652-d4725308caee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:11.165005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164778    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-home\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:11.165005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164791    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-model-cache\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:11.165005 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.164802    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-tmp-dir\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:11.166386 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.166356    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46946caa-1965-48c1-9652-d4725308caee-kube-api-access-6mmz7" (OuterVolumeSpecName: "kube-api-access-6mmz7") pod "46946caa-1965-48c1-9652-d4725308caee" (UID: "46946caa-1965-48c1-9652-d4725308caee"). InnerVolumeSpecName "kube-api-access-6mmz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:11.166496 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.166411    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-dshm" (OuterVolumeSpecName: "dshm") pod "46946caa-1965-48c1-9652-d4725308caee" (UID: "46946caa-1965-48c1-9652-d4725308caee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:11.166496 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.166423    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46946caa-1965-48c1-9652-d4725308caee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46946caa-1965-48c1-9652-d4725308caee" (UID: "46946caa-1965-48c1-9652-d4725308caee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:34:11.265379 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.265300    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46946caa-1965-48c1-9652-d4725308caee-dshm\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:11.265379 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.265361    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46946caa-1965-48c1-9652-d4725308caee-tls-certs\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:11.265379 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.265373    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mmz7\" (UniqueName: \"kubernetes.io/projected/46946caa-1965-48c1-9652-d4725308caee-kube-api-access-6mmz7\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:11.789197 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.789163    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf8f0ed5-14aa-437b-a00a-49c08a001929" path="/var/lib/kubelet/pods/bf8f0ed5-14aa-437b-a00a-49c08a001929/volumes"
Jul 11 04:34:11.845398 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.845368    2580 generic.go:356] "Generic (PLEG): container finished" podID="46946caa-1965-48c1-9652-d4725308caee" containerID="203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b" exitCode=0
Jul 11 04:34:11.845537 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.845429    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"
Jul 11 04:34:11.845537 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.845446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r" event={"ID":"46946caa-1965-48c1-9652-d4725308caee","Type":"ContainerDied","Data":"203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b"}
Jul 11 04:34:11.845537 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.845486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r" event={"ID":"46946caa-1965-48c1-9652-d4725308caee","Type":"ContainerDied","Data":"f1eb502319e5a7c47901007fb8d1ee4da92fcc9ffbed958ac850ed92a1daedd4"}
Jul 11 04:34:11.845537 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.845508    2580 scope.go:117] "RemoveContainer" containerID="203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b"
Jul 11 04:34:11.853985 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.853970    2580 scope.go:117] "RemoveContainer" containerID="203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b"
Jul 11 04:34:11.854267 ip-10-0-134-138 kubenswrapper[2580]: E0711 04:34:11.854247    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b\": container with ID starting with 203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b not found: ID does not exist" containerID="203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b"
Jul 11 04:34:11.854343 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.854274    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b"} err="failed to get container status \"203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b\": rpc error: code = NotFound desc = could not find container \"203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b\": container with ID starting with 203a6ebafcbdce492fcc36f654c376d996d48f77de0fa7a5c9c380a25428335b not found: ID does not exist"
Jul 11 04:34:11.859861 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.859842    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"]
Jul 11 04:34:11.863324 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:11.863287    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-eefca5/rate-test-model-eefca5-kserve-75fc9fbdcf-9p94r"]
Jul 11 04:34:12.354701 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.354670    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:12.355061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.354998    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf8f0ed5-14aa-437b-a00a-49c08a001929" containerName="main"
Jul 11 04:34:12.355061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355009    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf8f0ed5-14aa-437b-a00a-49c08a001929" containerName="main"
Jul 11 04:34:12.355061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355021    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46946caa-1965-48c1-9652-d4725308caee" containerName="main"
Jul 11 04:34:12.355061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355026    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="46946caa-1965-48c1-9652-d4725308caee" containerName="main"
Jul 11 04:34:12.355061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355043    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a5bcab-4ef1-4912-b642-6e66826c1f21" containerName="test-curl-7783-140586032472544"
Jul 11 04:34:12.355061 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355049    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a5bcab-4ef1-4912-b642-6e66826c1f21" containerName="test-curl-7783-140586032472544"
Jul 11 04:34:12.355302 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355098    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="46946caa-1965-48c1-9652-d4725308caee" containerName="main"
Jul 11 04:34:12.355302 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355108    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a5bcab-4ef1-4912-b642-6e66826c1f21" containerName="test-curl-7783-140586032472544"
Jul 11 04:34:12.355302 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.355114    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf8f0ed5-14aa-437b-a00a-49c08a001929" containerName="main"
Jul 11 04:34:12.359394 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.359368    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:12.360917 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.360893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:12.361678 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.361660    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-47b7r\""
Jul 11 04:34:12.475890 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.475851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4fc\" (UniqueName: \"kubernetes.io/projected/950fb5d2-13a7-4cad-8698-b8a1fc46ac48-kube-api-access-4v4fc\") pod \"test-curl-7783-140586032473552\" (UID: \"950fb5d2-13a7-4cad-8698-b8a1fc46ac48\") " pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:12.577287 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.577249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4fc\" (UniqueName: \"kubernetes.io/projected/950fb5d2-13a7-4cad-8698-b8a1fc46ac48-kube-api-access-4v4fc\") pod \"test-curl-7783-140586032473552\" (UID: \"950fb5d2-13a7-4cad-8698-b8a1fc46ac48\") " pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:12.585031 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.585010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4fc\" (UniqueName: \"kubernetes.io/projected/950fb5d2-13a7-4cad-8698-b8a1fc46ac48-kube-api-access-4v4fc\") pod \"test-curl-7783-140586032473552\" (UID: \"950fb5d2-13a7-4cad-8698-b8a1fc46ac48\") " pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:12.669172 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.669083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:12.797130 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.797098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:12.800182 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:34:12.800156    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod950fb5d2_13a7_4cad_8698_b8a1fc46ac48.slice/crio-346175291eb670a2b6879bf6f7a0e37a5986d2620eb89300880fd9da18c24b17 WatchSource:0}: Error finding container 346175291eb670a2b6879bf6f7a0e37a5986d2620eb89300880fd9da18c24b17: Status 404 returned error can't find the container with id 346175291eb670a2b6879bf6f7a0e37a5986d2620eb89300880fd9da18c24b17
Jul 11 04:34:12.853058 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:12.853031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032473552" event={"ID":"950fb5d2-13a7-4cad-8698-b8a1fc46ac48","Type":"ContainerStarted","Data":"346175291eb670a2b6879bf6f7a0e37a5986d2620eb89300880fd9da18c24b17"}
Jul 11 04:34:13.789075 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:13.789040    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46946caa-1965-48c1-9652-d4725308caee" path="/var/lib/kubelet/pods/46946caa-1965-48c1-9652-d4725308caee/volumes"
Jul 11 04:34:13.859945 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:13.859853    2580 generic.go:356] "Generic (PLEG): container finished" podID="950fb5d2-13a7-4cad-8698-b8a1fc46ac48" containerID="5ba710e615cf12c05a3550a82bb2a212f202e55aeb3d25ff78847a660275625b" exitCode=0
Jul 11 04:34:13.860098 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:13.859939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032473552" event={"ID":"950fb5d2-13a7-4cad-8698-b8a1fc46ac48","Type":"ContainerDied","Data":"5ba710e615cf12c05a3550a82bb2a212f202e55aeb3d25ff78847a660275625b"}
Jul 11 04:34:14.994006 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:14.993979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:15.011674 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.011644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7783-140586032473552_950fb5d2-13a7-4cad-8698-b8a1fc46ac48/test-curl-7783-140586032473552/0.log"
Jul 11 04:34:15.034163 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.034132    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:15.037079 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.037057    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:15.098789 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.098761    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v4fc\" (UniqueName: \"kubernetes.io/projected/950fb5d2-13a7-4cad-8698-b8a1fc46ac48-kube-api-access-4v4fc\") pod \"950fb5d2-13a7-4cad-8698-b8a1fc46ac48\" (UID: \"950fb5d2-13a7-4cad-8698-b8a1fc46ac48\") "
Jul 11 04:34:15.100831 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.100806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950fb5d2-13a7-4cad-8698-b8a1fc46ac48-kube-api-access-4v4fc" (OuterVolumeSpecName: "kube-api-access-4v4fc") pod "950fb5d2-13a7-4cad-8698-b8a1fc46ac48" (UID: "950fb5d2-13a7-4cad-8698-b8a1fc46ac48"). InnerVolumeSpecName "kube-api-access-4v4fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:15.200161 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.200082    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v4fc\" (UniqueName: \"kubernetes.io/projected/950fb5d2-13a7-4cad-8698-b8a1fc46ac48-kube-api-access-4v4fc\") on node \"ip-10-0-134-138.ec2.internal\" DevicePath \"\""
Jul 11 04:34:15.788960 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.788924    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="950fb5d2-13a7-4cad-8698-b8a1fc46ac48" path="/var/lib/kubelet/pods/950fb5d2-13a7-4cad-8698-b8a1fc46ac48/volumes"
Jul 11 04:34:15.870529 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.870499    2580 scope.go:117] "RemoveContainer" containerID="5ba710e615cf12c05a3550a82bb2a212f202e55aeb3d25ff78847a660275625b"
Jul 11 04:34:15.870529 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:15.870522    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:28.854934 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:28.854894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:34:54.558961 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:34:54.558920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjq75"]
Jul 11 04:35:12.468575 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:12.468543    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ffgjn_15c9e339-0713-4c70-baca-cf1c09d159a6/manager/0.log"
Jul 11 04:35:12.586195 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:12.586161    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xz7cj_1f75c234-f833-4192-be7c-5721434bc219/manager/0.log"
Jul 11 04:35:13.321544 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:13.321464    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-fgsth_effd8fd2-a382-4a26-b418-a5ef814983d1/copy-manifests/0.log"
Jul 11 04:35:13.330975 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:13.330950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-fgsth_effd8fd2-a382-4a26-b418-a5ef814983d1/manager/0.log"
Jul 11 04:35:17.070375 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:17.070344    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4wqdt_b59874ff-1611-4a4a-a40b-ecef8e9e59d0/kuadrant-console-plugin/0.log"
Jul 11 04:35:17.418033 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:17.417948    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gjq75_e0f0d0a0-6179-453b-bc8c-57fef4439f66/limitador/0.log"
Jul 11 04:35:18.105177 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:18.105144    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-6kht2_02146b9e-e659-4160-be7c-076221038c5c/kube-auth-proxy/0.log"
Jul 11 04:35:19.508438 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:19.508396    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hhdqw_3f274c34-d029-4a61-abb6-5068b21ab906/main/0.log"
Jul 11 04:35:19.618270 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:19.618243    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vp7qt_a4d1a99d-91d5-4348-bef8-4640a5c40951/main/0.log"
Jul 11 04:35:23.936249 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.936214    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qpcdf/must-gather-9zmj7"]
Jul 11 04:35:23.936646 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.936590    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950fb5d2-13a7-4cad-8698-b8a1fc46ac48" containerName="test-curl-7783-140586032473552"
Jul 11 04:35:23.936646 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.936602    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="950fb5d2-13a7-4cad-8698-b8a1fc46ac48" containerName="test-curl-7783-140586032473552"
Jul 11 04:35:23.936717 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.936674    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="950fb5d2-13a7-4cad-8698-b8a1fc46ac48" containerName="test-curl-7783-140586032473552"
Jul 11 04:35:23.939506 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.939482    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:23.941555 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.941534    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qpcdf\"/\"default-dockercfg-hxr4v\""
Jul 11 04:35:23.941659 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.941591    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpcdf\"/\"openshift-service-ca.crt\""
Jul 11 04:35:23.941739 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.941721    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpcdf\"/\"kube-root-ca.crt\""
Jul 11 04:35:23.949021 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:23.948991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/must-gather-9zmj7"]
Jul 11 04:35:24.115978 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.115942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqz2n\" (UniqueName: \"kubernetes.io/projected/000cbb84-04d9-45a7-88e2-c1c09338c422-kube-api-access-tqz2n\") pod \"must-gather-9zmj7\" (UID: \"000cbb84-04d9-45a7-88e2-c1c09338c422\") " pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.115978 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.115986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/000cbb84-04d9-45a7-88e2-c1c09338c422-must-gather-output\") pod \"must-gather-9zmj7\" (UID: \"000cbb84-04d9-45a7-88e2-c1c09338c422\") " pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.217161 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.217066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/000cbb84-04d9-45a7-88e2-c1c09338c422-must-gather-output\") pod \"must-gather-9zmj7\" (UID: \"000cbb84-04d9-45a7-88e2-c1c09338c422\") " pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.217355 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.217199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqz2n\" (UniqueName: \"kubernetes.io/projected/000cbb84-04d9-45a7-88e2-c1c09338c422-kube-api-access-tqz2n\") pod \"must-gather-9zmj7\" (UID: \"000cbb84-04d9-45a7-88e2-c1c09338c422\") " pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.217497 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.217480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/000cbb84-04d9-45a7-88e2-c1c09338c422-must-gather-output\") pod \"must-gather-9zmj7\" (UID: \"000cbb84-04d9-45a7-88e2-c1c09338c422\") " pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.226249 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.226219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqz2n\" (UniqueName: \"kubernetes.io/projected/000cbb84-04d9-45a7-88e2-c1c09338c422-kube-api-access-tqz2n\") pod \"must-gather-9zmj7\" (UID: \"000cbb84-04d9-45a7-88e2-c1c09338c422\") " pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.249298 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.249259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/must-gather-9zmj7"
Jul 11 04:35:24.389371 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:24.387915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/must-gather-9zmj7"]
Jul 11 04:35:25.174911 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:25.174881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/must-gather-9zmj7" event={"ID":"000cbb84-04d9-45a7-88e2-c1c09338c422","Type":"ContainerStarted","Data":"39dfe796dcec8909e81dea7dc013dca1bacd39a802bd6d1ad4237c182497358b"}
Jul 11 04:35:26.184542 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:26.184500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/must-gather-9zmj7" event={"ID":"000cbb84-04d9-45a7-88e2-c1c09338c422","Type":"ContainerStarted","Data":"07ac7cb467dc880865e0adeebb6b1346641665e013966799e9c51f0df720c8f4"}
Jul 11 04:35:26.185003 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:26.184556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/must-gather-9zmj7" event={"ID":"000cbb84-04d9-45a7-88e2-c1c09338c422","Type":"ContainerStarted","Data":"59c8a522dfbfbfdbbf423f3f3ec58a0e2c16f9ef11ed8ed3f8e7a77178a537c6"}
Jul 11 04:35:26.201365 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:26.201276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qpcdf/must-gather-9zmj7" podStartSLOduration=2.461819691 podStartE2EDuration="3.201252363s" totalImagesPullingTime="739.432672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:35:26.198076214 +0000 UTC m=+2794.895348077" watchObservedRunningTime="2026-07-11 04:35:26.201252363 +0000 UTC m=+2794.898524228"
Jul 11 04:35:26.715709 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:26.715680    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wcqn5_6f332a94-9880-44f5-98a5-deee84e855a6/global-pull-secret-syncer/0.log"
Jul 11 04:35:26.796256 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:26.796228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qc88h_c4acd2da-c938-47ef-bbc3-b14ef64a07d3/konnectivity-agent/0.log"
Jul 11 04:35:26.843583 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:26.843546    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-138.ec2.internal_f0229b4e6d3ad7be1121dd1ab53b129a/haproxy/0.log"
Jul 11 04:35:31.763368 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:31.763259    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4wqdt_b59874ff-1611-4a4a-a40b-ecef8e9e59d0/kuadrant-console-plugin/0.log"
Jul 11 04:35:31.938428 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:31.938373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gjq75_e0f0d0a0-6179-453b-bc8c-57fef4439f66/limitador/0.log"
Jul 11 04:35:34.010623 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.010546    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5kqjh_84edfff7-1ffa-47df-9ce8-b89fbd6c6368/kube-state-metrics/0.log"
Jul 11 04:35:34.031245 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.031211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5kqjh_84edfff7-1ffa-47df-9ce8-b89fbd6c6368/kube-rbac-proxy-main/0.log"
Jul 11 04:35:34.053233 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.053205    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5kqjh_84edfff7-1ffa-47df-9ce8-b89fbd6c6368/kube-rbac-proxy-self/0.log"
Jul 11 04:35:34.105786 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.105752    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56594db87b-dz5v4_c016e0fc-eb91-40db-9c76-ebf87ebc933d/metrics-server/0.log"
Jul 11 04:35:34.234764 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.234735    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4zz9g_35335482-699b-4fc9-890a-e07dec5dd705/node-exporter/0.log"
Jul 11 04:35:34.255295 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.255257    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4zz9g_35335482-699b-4fc9-890a-e07dec5dd705/kube-rbac-proxy/0.log"
Jul 11 04:35:34.286053 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.285961    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4zz9g_35335482-699b-4fc9-890a-e07dec5dd705/init-textfile/0.log"
Jul 11 04:35:34.382948 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.382915    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fcx85_7b662590-c854-4eea-ab19-095510466106/kube-rbac-proxy-main/0.log"
Jul 11 04:35:34.402097 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.402072    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fcx85_7b662590-c854-4eea-ab19-095510466106/kube-rbac-proxy-self/0.log"
Jul 11 04:35:34.422972 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.422931    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fcx85_7b662590-c854-4eea-ab19-095510466106/openshift-state-metrics/0.log"
Jul 11 04:35:34.475927 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.475901    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/prometheus/0.log"
Jul 11 04:35:34.495030 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.494992    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/config-reloader/0.log"
Jul 11 04:35:34.514721 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.514651    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/thanos-sidecar/0.log"
Jul 11 04:35:34.534645 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.534576    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/kube-rbac-proxy-web/0.log"
Jul 11 04:35:34.553861 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.553834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/kube-rbac-proxy/0.log"
Jul 11 04:35:34.574281 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.574231    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/kube-rbac-proxy-thanos/0.log"
Jul 11 04:35:34.603249 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.603224    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7457f081-b564-4f92-b98e-da8339c800d2/init-config-reloader/0.log"
Jul 11 04:35:34.774493 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.774450    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548744f4b-ffmfr_6e37fa09-7e2c-472f-b7e3-329aaab48897/thanos-query/0.log"
Jul 11 04:35:34.793630 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.793600    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548744f4b-ffmfr_6e37fa09-7e2c-472f-b7e3-329aaab48897/kube-rbac-proxy-web/0.log"
Jul 11 04:35:34.812996 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.812911    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548744f4b-ffmfr_6e37fa09-7e2c-472f-b7e3-329aaab48897/kube-rbac-proxy/0.log"
Jul 11 04:35:34.833430 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.833398    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548744f4b-ffmfr_6e37fa09-7e2c-472f-b7e3-329aaab48897/prom-label-proxy/0.log"
Jul 11 04:35:34.855374 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.855345    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548744f4b-ffmfr_6e37fa09-7e2c-472f-b7e3-329aaab48897/kube-rbac-proxy-rules/0.log"
Jul 11 04:35:34.875618 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:34.875559    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548744f4b-ffmfr_6e37fa09-7e2c-472f-b7e3-329aaab48897/kube-rbac-proxy-metrics/0.log"
Jul 11 04:35:36.656088 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.656039    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"]
Jul 11 04:35:36.662486 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.662461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.666590 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.666554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"]
Jul 11 04:35:36.744333 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.744268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-podres\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.744615 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.744590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pxj5\" (UniqueName: \"kubernetes.io/projected/da3c0728-c11f-46b5-8b42-3c82e82fe49e-kube-api-access-8pxj5\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.744851 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.744834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-lib-modules\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.745411 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.745391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-proc\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.745679 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.745662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-sys\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.846565 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-podres\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.846565 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pxj5\" (UniqueName: \"kubernetes.io/projected/da3c0728-c11f-46b5-8b42-3c82e82fe49e-kube-api-access-8pxj5\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-lib-modules\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-proc\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-sys\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-podres\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-sys\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-proc\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.848913 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.846919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da3c0728-c11f-46b5-8b42-3c82e82fe49e-lib-modules\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.855059 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.854963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pxj5\" (UniqueName: \"kubernetes.io/projected/da3c0728-c11f-46b5-8b42-3c82e82fe49e-kube-api-access-8pxj5\") pod \"perf-node-gather-daemonset-fbht4\" (UID: \"da3c0728-c11f-46b5-8b42-3c82e82fe49e\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:36.974889 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:36.974812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:37.169458 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:37.165668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"]
Jul 11 04:35:37.180327 ip-10-0-134-138 kubenswrapper[2580]: W0711 04:35:37.177708    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda3c0728_c11f_46b5_8b42_3c82e82fe49e.slice/crio-9ffeb1a0075d0092d090064b1df586be6ff2313511dc276100133e2c58ed0dab WatchSource:0}: Error finding container 9ffeb1a0075d0092d090064b1df586be6ff2313511dc276100133e2c58ed0dab: Status 404 returned error can't find the container with id 9ffeb1a0075d0092d090064b1df586be6ff2313511dc276100133e2c58ed0dab
Jul 11 04:35:37.260412 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:37.260349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4" event={"ID":"da3c0728-c11f-46b5-8b42-3c82e82fe49e","Type":"ContainerStarted","Data":"9ffeb1a0075d0092d090064b1df586be6ff2313511dc276100133e2c58ed0dab"}
Jul 11 04:35:38.268056 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:38.268014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4" event={"ID":"da3c0728-c11f-46b5-8b42-3c82e82fe49e","Type":"ContainerStarted","Data":"95f932a03d98c21d1f01907a448a2a70fc7cfd7dd0171710a6f8f9de1070740c"}
Jul 11 04:35:38.268565 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:38.268147    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:38.282780 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:38.282698    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4" podStartSLOduration=2.282677969 podStartE2EDuration="2.282677969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 04:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:35:38.282480646 +0000 UTC m=+2806.979752508" watchObservedRunningTime="2026-07-11 04:35:38.282677969 +0000 UTC m=+2806.979949832"
Jul 11 04:35:38.967697 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:38.967658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bq4nj_dad95498-e584-4b36-9f2a-4d3c25001f12/dns/0.log"
Jul 11 04:35:38.986369 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:38.986342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bq4nj_dad95498-e584-4b36-9f2a-4d3c25001f12/kube-rbac-proxy/0.log"
Jul 11 04:35:39.007570 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:39.007547    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49drc_e87a3290-e12e-44f2-8ce0-8489f2d17493/dns-node-resolver/0.log"
Jul 11 04:35:39.552789 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:39.552763    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-746dcb8c78-vznmc_8069c608-4998-482c-b8d0-f6e7ae81c6a5/registry/0.log"
Jul 11 04:35:39.615747 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:39.615712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrl8g_86c220b7-6a8d-4717-8b44-ec0d42e38189/node-ca/0.log"
Jul 11 04:35:40.646972 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:40.646906    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-6kht2_02146b9e-e659-4160-be7c-076221038c5c/kube-auth-proxy/0.log"
Jul 11 04:35:41.520841 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:41.520813    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4zrw_aadb1db3-28b0-4aeb-b615-ecf22880259d/serve-healthcheck-canary/0.log"
Jul 11 04:35:42.116440 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:42.116407    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjx8s_cc3335fa-a8b4-46f9-9aae-c64185790e9c/kube-rbac-proxy/0.log"
Jul 11 04:35:42.136101 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:42.136079    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjx8s_cc3335fa-a8b4-46f9-9aae-c64185790e9c/exporter/0.log"
Jul 11 04:35:42.155197 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:42.155161    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjx8s_cc3335fa-a8b4-46f9-9aae-c64185790e9c/extractor/0.log"
Jul 11 04:35:44.177883 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:44.177847    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ffgjn_15c9e339-0713-4c70-baca-cf1c09d159a6/manager/0.log"
Jul 11 04:35:44.287188 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:44.287104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-fbht4"
Jul 11 04:35:44.353821 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:44.353781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xz7cj_1f75c234-f833-4192-be7c-5721434bc219/manager/0.log"
Jul 11 04:35:44.713754 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:44.713725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-fgsth_effd8fd2-a382-4a26-b418-a5ef814983d1/manager/0.log"
Jul 11 04:35:44.732814 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:44.732776    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-fgsth_effd8fd2-a382-4a26-b418-a5ef814983d1/copy-manifests/0.log"
Jul 11 04:35:46.043276 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:46.043198    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84fcd84596-7n7lz_fec3e105-d00d-4ec2-9049-7256946a5d61/manager/0.log"
Jul 11 04:35:47.360692 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:47.360662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-6kht2_02146b9e-e659-4160-be7c-076221038c5c/kube-auth-proxy/0.log"
Jul 11 04:35:48.871087 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:48.871041    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-6kht2_02146b9e-e659-4160-be7c-076221038c5c/kube-auth-proxy/0.log"
Jul 11 04:35:52.538210 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.538184    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/kube-multus-additional-cni-plugins/0.log"
Jul 11 04:35:52.558539 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.558511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/egress-router-binary-copy/0.log"
Jul 11 04:35:52.577622 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.577592    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/cni-plugins/0.log"
Jul 11 04:35:52.595825 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.595792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/bond-cni-plugin/0.log"
Jul 11 04:35:52.615779 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.615753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/routeoverride-cni/0.log"
Jul 11 04:35:52.638103 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.638059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/whereabouts-cni-bincopy/0.log"
Jul 11 04:35:52.656352 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.656304    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7snj_98d0747b-7781-4416-a833-b61b4b78de90/whereabouts-cni/0.log"
Jul 11 04:35:52.826262 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.826208    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s4dl7_82b7dbfc-e082-41d4-ad90-c7ec819c23cd/kube-multus/0.log"
Jul 11 04:35:52.926541 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.926509    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8srd5_cfc53e74-81fc-4fa2-b0a9-b65bb79b679e/network-metrics-daemon/0.log"
Jul 11 04:35:52.946198 ip-10-0-134-138 kubenswrapper[2580]: I0711 04:35:52.946171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8srd5_cfc53e74-81fc-4fa2-b0a9-b65bb79b679e/kube-rbac-proxy/0.log"