Jul 06 19:05:40.112446 ip-10-0-130-64 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:05:40.557905 ip-10-0-130-64 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:40.557905 ip-10-0-130-64 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:05:40.557905 ip-10-0-130-64 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:40.557905 ip-10-0-130-64 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:05:40.557905 ip-10-0-130-64 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:40.560468 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.560388    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:05:40.564847 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564832    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:40.564847 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564847    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564850    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564853    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564856    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564859    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564861    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564864    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564867    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564869    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564872    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564875    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564879    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564882    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564884    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564892    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564895    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564898    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564900    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564903    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564905    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:40.564911 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564908    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564910    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564913    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564916    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564919    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564922    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564924    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564927    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564929    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564932    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564934    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564937    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564939    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564942    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564945    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564947    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564950    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564953    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564955    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564958    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:40.565404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564960    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564963    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564965    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564967    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564970    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564972    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564975    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564978    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564980    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564983    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564985    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564988    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564990    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564993    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564996    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.564999    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565002    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565008    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565011    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565013    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:40.565882 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565016    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565018    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565021    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565023    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565028    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565032    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565035    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565038    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565041    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565044    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565047    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565049    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565052    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565054    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565057    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565059    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565063    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565067    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:40.566404 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565071    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565073    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565076    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565079    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565083    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565085    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565088    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565091    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565095    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565097    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565100    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565103    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565119    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565122    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565124    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565127    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565130    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565132    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565135    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565137    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565836    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:40.566865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565842    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565845    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565848    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565851    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565860    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565863    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565865    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565868    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565870    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565873    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565875    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565878    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565880    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565883    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565886    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565889    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565892    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565894    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565897    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565900    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:40.567422 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565903    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565906    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565908    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565911    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565913    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565916    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565918    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565921    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565925    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565929    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565932    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565935    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565938    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565940    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565942    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565945    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565947    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565955    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565958    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:40.567915 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565962    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565965    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565968    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565971    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565974    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565976    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565979    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565982    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565984    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565987    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565989    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565993    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565997    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.565999    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566002    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566005    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566007    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566010    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566012    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566015    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:40.568429 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566017    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566020    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566022    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566025    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566027    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566030    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566032    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566035    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566037    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566040    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566042    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566050    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566053    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566055    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566058    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566060    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566062    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566065    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566068    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566070    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:40.568902 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566073    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566075    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566077    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566080    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566084    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566086    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566089    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566091    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566094    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566099    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566102    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566120    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566123    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566126    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566128    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566132    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566135    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566138    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566141    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:40.569397 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566492    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566497    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566500    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566503    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566506    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566509    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566512    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566514    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566516    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566519    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566522    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566524    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566527    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566529    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566532    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566534    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566539    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566542    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566546    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:40.569849 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566549    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566551    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566554    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566556    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566559    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566561    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566564    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566566    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566569    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566571    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566574    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566576    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566578    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566581    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566583    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566586    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566588    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566590    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566593    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566596    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:40.570319 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566599    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566601    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566603    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566606    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566608    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566611    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566613    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566615    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566618    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566621    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566624    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566627    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566630    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566632    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566635    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566638    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566641    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566643    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566646    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566649    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:40.570797 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566651    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566654    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566656    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566659    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566661    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566663    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566666    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566668    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566671    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566674    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566677    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566682    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566684    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566686    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566689    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566693    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566696    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566699    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566702    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:40.571290 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566705    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566707    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566711    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566714    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566716    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566719    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566721    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566724    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566726    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566728    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566731    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566733    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566736    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566738    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566741    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566743    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566745    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566748    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566750    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566753    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:40.571747 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.566755    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566816    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566827    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566832    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566837    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566843    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566846    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566850    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566854    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566857    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566860    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566864    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566869    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566872    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566875    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566880    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566883    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566885    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566888    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566892    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566895    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566898    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566901    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566904    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:05:40.572238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566907    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566910    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566913    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566916    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566919    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566922    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566925    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566928    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566931    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566934    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566937    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566940    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566943    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566946    2561 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566949    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566953    2561 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566956    2561 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566959    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566961    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566964    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566968    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566971    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566974    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566978    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566981    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:05:40.572822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566984    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566987    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566990    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566992    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566995    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.566998    2561 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567001    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567004    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567007    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567010    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567013    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567016    2561 flags.go:64] FLAG: --help="false"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567018    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-130-64.ec2.internal"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567021    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567024    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567027    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567030    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567033    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567036    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567039    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567041    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567044    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567047    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567050    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:05:40.573482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567053    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567056    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567058    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567062    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567064    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567067    2561 flags.go:64] FLAG: --lock-file=""
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567071    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567074    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567077    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567082    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567085    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567087    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567090    2561 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567093    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567096    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567099    2561 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567101    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567122    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567128    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567134    2561 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567139    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567142    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567145    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567148    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567151    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:05:40.574081 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567154    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567156    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567163    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567166    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567169    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567172    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567176    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567181    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567184    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567187    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567191    2561 flags.go:64] FLAG: --port="10250"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567194    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567197    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0549a604cb9652de0"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567200    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567204    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567207    2561 flags.go:64] FLAG: --register-node="true"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567210    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567213    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567216    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567219    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567222    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567225    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567228    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567231    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567234    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:05:40.574679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567237    2561 flags.go:64] FLAG: --runonce="false"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567240    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567243    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567246    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567248    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567251    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567254    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567257    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567260    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567262    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567265    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567268    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567270    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567274    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567278    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567280    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567285    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567288    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567291    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567295    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567298    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567302    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567305    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567307    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567310    2561 flags.go:64] FLAG: --v="2"
Jul 06 19:05:40.575352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567314    2561 flags.go:64] FLAG: --version="false"
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567318    2561 flags.go:64] FLAG: --vmodule=""
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567321    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.567324    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567430    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567434    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567438    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567441    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567443    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567446    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567449    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567451    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567454    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567456    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567459    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567461    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567464    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567466    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567469    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567471    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:40.575946 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567474    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567476    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567479    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567483    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567486    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567489    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567491    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567494    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567498    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567500    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567503    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567505    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567508    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567510    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567513    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567515    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567518    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567520    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567523    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:40.576502 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567525    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567529    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567533    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567536    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567538    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567541    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567543    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567546    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567549    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567551    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567554    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567556    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567558    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567561    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567564    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567566    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567572    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567575    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567578    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567580    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:40.576966 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567583    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567587    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567589    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567592    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567594    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567597    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567600    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567602    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567605    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567607    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567609    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567612    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567614    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567617    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567619    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567622    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567624    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567627    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567629    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:40.577503 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567632    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567634    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567636    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567639    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567642    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567646    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567649    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567652    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567655    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567660    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567663    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567666    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567668    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567671    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567674    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567677    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567680    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567682    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567684    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567687    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:40.577971 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567690    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567692    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567695    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567697    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.567700    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.568292    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.575836    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.575854    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.575877    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.575882    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575956    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575961    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575965    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575969    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:40.578475 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575974    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575976    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575979    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575982    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575985    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575988    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575991    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575994    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575996    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.575999    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576002    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576005    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576007    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576010    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576012    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576015    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576018    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576020    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576023    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:40.578824 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576025    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576028    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576030    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576033    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576035    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576038    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576047    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576050    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576052    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576055    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576057    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576060    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576063    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576065    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576068    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576071    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576074    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576076    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576079    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576081    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:40.579292 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576083    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576086    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576088    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576091    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576093    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576096    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576098    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576102    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576131    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576135    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576138    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576140    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576143    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576146    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576148    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576151    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576154    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576157    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576160    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:40.579760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576169    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576172    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576175    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576177    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576180    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576182    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576185    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576188    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576190    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576193    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576195    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576198    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576200    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576203    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576205    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576208    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576210    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576213    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576216    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576218    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:40.580294 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576220    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576223    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576226    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576228    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576231    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576233    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576236    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576238    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576241    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576244    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576247    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576250    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576252    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576260    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576263    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576266    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:40.580822 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576270    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.576275    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576439    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576444    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576447    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576450    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576453    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576456    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576459    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576461    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576464    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576466    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576469    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576471    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576474    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:40.581205 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576476    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576478    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576481    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576484    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576486    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576488    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576491    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576493    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576496    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576498    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576501    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576503    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576506    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576509    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576512    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576521    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576525    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576527    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576530    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:40.581570 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576532    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576535    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576538    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576540    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576543    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576545    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576547    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576550    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576552    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576554    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576558    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576561    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576564    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576567    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576570    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576572    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576575    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576578    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576580    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:40.582012 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576583    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576586    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576588    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576591    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576593    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576596    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576599    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576601    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576604    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576606    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576614    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576617    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576620    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576622    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576624    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576627    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576629    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576632    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576634    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:40.582465 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576637    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576640    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576644    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576646    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576649    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576652    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576654    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576657    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576659    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576662    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576665    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576667    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576669    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576672    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576674    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576676    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576679    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576681    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576684    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576687    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:40.582919 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576689    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576692    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576694    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576697    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576704    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576707    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576709    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576712    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:40.576714    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.576718    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.576851    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.579007    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.580543    2561 server.go:1019] "Starting client certificate rotation"
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.580646    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:40.583412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.581552    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:40.583748 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.583623    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:40.589033 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.589012    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:40.599337 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.599319    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:05:40.601291 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.601273    2561 log.go:25] "Validated CRI v1 image API"
Jul 06 19:05:40.603258 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.603243    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:05:40.606770 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.606748    2561 fs.go:135] Filesystem UUIDs: map[08dcb46a-afaa-493b-9c4e-4c4f5253ceea:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ea3d72f5-f35c-4041-9e68-f389fae17628:/dev/nvme0n1p4]
Jul 06 19:05:40.606816 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.606771    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:05:40.612245 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.612229    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:40.612558 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.612453    2561 manager.go:216] Machine: {Timestamp:2026-07-06 19:05:40.610573841 +0000 UTC m=+0.361283095 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096881 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ee826f334fbae4da668d255886a5 SystemUUID:ec20ee82-6f33-4fba-e4da-668d255886a5 BootID:79c384bc-ffa5-4e1a-9e10-a1b8a6b728ff Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:14:1f:28:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:14:1f:28:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:6a:a2:d1:97:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:05:40.612558 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.612559    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:05:40.612646 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.612638    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:05:40.613720 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.613693    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:05:40.613861 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.613722    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:05:40.615011 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.615000    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:05:40.615048 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.615013    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:05:40.615048 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.615025    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:40.615576 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.615565    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:40.616910 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.616900    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:05:40.620477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620465    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:40.620758 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620748    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:05:40.620788 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620780    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:05:40.620818 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620791    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:05:40.620818 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620805    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:05:40.620818 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620815    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:05:40.620901 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.620824    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:05:40.621204 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.621192    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:40.621249 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.621212    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:40.623390 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.623363    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:05:40.625207 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.625195    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:05:40.625251 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.625225    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:05:40.626278 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626266    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:05:40.626320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626285    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:05:40.626320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626291    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:05:40.626320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626296    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:05:40.626320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626306    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:05:40.626320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626312    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:05:40.626320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626320    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626325    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626332    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626337    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626350    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626356    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626378    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:05:40.626472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.626384    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:05:40.629808 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.629774    2561 server.go:1268] "Started kubelet"
Jul 06 19:05:40.630519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.630471    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:05:40.630635 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.630518    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:05:40.630635 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.630590    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:05:40.631014 ip-10-0-130-64 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:05:40.632763 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.632744    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:05:40.633361 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.633345    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:05:40.633769 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.633747    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:05:40.633846 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.633801    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:05:40.633926 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.633759    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:05:40.636524 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.636502    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:05:40.639420 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.639403    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:05:40.639492 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.639424    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:40.639553 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.639483    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:40.640134 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640100    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:05:40.640236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640138    2561 factory.go:55] Registering systemd factory
Jul 06 19:05:40.640236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640152    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:05:40.640236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640222    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:05:40.640236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640235    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:05:40.640431 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640360    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:05:40.640431 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640370    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:05:40.640553 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640539    2561 factory.go:153] Registering CRI-O factory
Jul 06 19:05:40.640601 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640578    2561 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:05:40.640661 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640649    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:05:40.640702 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640676    2561 factory.go:103] Registering Raw factory
Jul 06 19:05:40.640702 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.640691    2561 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:05:40.641123 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.641096    2561 manager.go:349] Starting recovery of all containers
Jul 06 19:05:40.642588 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.640851    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-64.ec2.internal.18bfc8c86e3153c6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-64.ec2.internal,UID:ip-10-0-130-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-64.ec2.internal,},FirstTimestamp:2026-07-06 19:05:40.62974663 +0000 UTC m=+0.380455868,LastTimestamp:2026-07-06 19:05:40.62974663 +0000 UTC m=+0.380455868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-64.ec2.internal,}"
Jul 06 19:05:40.650042 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.649877    2561 manager.go:354] Recovery completed
Jul 06 19:05:40.650142 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.649982    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:05:40.650142 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.649994    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:05:40.655327 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.655316    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.657236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657215    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.657302 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657252    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.657302 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657267    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:40.657790 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657776    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:05:40.657790 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657787    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.657880 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657791    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:05:40.657880 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.657809    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:40.658501 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.658488    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.658559 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.658513    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.658559 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.658523    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:40.659259 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.659247    2561 policy_none.go:49] "None policy: Start"
Jul 06 19:05:40.659306 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.659263    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:05:40.659306 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.659274    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:05:40.660423 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.660413    2561 policy_none.go:47] "Start"
Jul 06 19:05:40.666955 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.666694    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-64.ec2.internal.18bfc8c86fd4c6c4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-64.ec2.internal,UID:ip-10-0-130-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-64.ec2.internal,},FirstTimestamp:2026-07-06 19:05:40.657235652 +0000 UTC m=+0.407944896,LastTimestamp:2026-07-06 19:05:40.657235652 +0000 UTC m=+0.407944896,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-64.ec2.internal,}"
Jul 06 19:05:40.670373 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.670355    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ts5d"
Jul 06 19:05:40.671722 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.671665    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-64.ec2.internal.18bfc8c86fd520e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-64.ec2.internal,UID:ip-10-0-130-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-64.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-64.ec2.internal,},FirstTimestamp:2026-07-06 19:05:40.657258723 +0000 UTC m=+0.407967965,LastTimestamp:2026-07-06 19:05:40.657258723 +0000 UTC m=+0.407967965,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-64.ec2.internal,}"
Jul 06 19:05:40.677658 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.677591    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-64.ec2.internal.18bfc8c86fd553c3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-64.ec2.internal,UID:ip-10-0-130-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-64.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-64.ec2.internal,},FirstTimestamp:2026-07-06 19:05:40.657271747 +0000 UTC m=+0.407980985,LastTimestamp:2026-07-06 19:05:40.657271747 +0000 UTC m=+0.407980985,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-64.ec2.internal,}"
Jul 06 19:05:40.679609 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.679592    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ts5d"
Jul 06 19:05:40.681174 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.681095    2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-64.ec2.internal.18bfc8c86fd4c6c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-64.ec2.internal.18bfc8c86fd4c6c4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-64.ec2.internal,UID:ip-10-0-130-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-64.ec2.internal,},FirstTimestamp:2026-07-06 19:05:40.657235652 +0000 UTC m=+0.407944896,LastTimestamp:2026-07-06 19:05:40.658501354 +0000 UTC m=+0.409210592,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-64.ec2.internal,}"
Jul 06 19:05:40.700529 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.700513    2561 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:05:40.700605 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.700547    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:05:40.700605 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.700557    2561 server.go:87] "Starting device plugin registration server"
Jul 06 19:05:40.700814 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.700801    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:05:40.700884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.700814    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:05:40.700925 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.700894    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:05:40.701019 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.701005    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:05:40.701019 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.701019    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:05:40.701615 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.701595    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:05:40.701693 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.701640    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:40.801369 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.801339    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.802586 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.802459    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.802586 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.802491    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.802586 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.802502    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:40.802586 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.802533    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-64.ec2.internal"
Jul 06 19:05:40.809996 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.809953    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-64.ec2.internal"
Jul 06 19:05:40.809996 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.809980    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-64.ec2.internal\": node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:40.835382 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.835354    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:40.874587 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.874547    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:05:40.875925 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.875906    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:05:40.876031 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.875941    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:05:40.876031 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.875963    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:05:40.876031 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.875996    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:05:40.878326 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.878293    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:40.936477 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:40.936449    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:40.976891 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.976856    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"]
Jul 06 19:05:40.976964 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.976938    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.979101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.979084    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.979198 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.979133    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.979198 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.979150    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:40.980559 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.980548    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.980661 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.980647    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:40.980716 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.980676    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.981258 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.981242    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.981347 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.981273    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.981347 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.981286    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:40.981347 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.981247    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.981347 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.981346    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.981522 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.981356    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:40.982996 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.982980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:40.983079 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.983010    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:40.983660 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.983644    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:40.983660 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.983671    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:40.983764 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:40.983681    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:41.010644 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.010619    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-64.ec2.internal\" not found" node="ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.015153 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.015135    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-64.ec2.internal\" not found" node="ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.036671 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.036648    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:41.041997 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.041981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c11890a9c7093c33fc263ce2ef65cf8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"4c11890a9c7093c33fc263ce2ef65cf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.042077 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.042006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c11890a9c7093c33fc263ce2ef65cf8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"4c11890a9c7093c33fc263ce2ef65cf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.042077 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.042023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5d35cca57c2f2c6fe15afe949f8be24-config\") pod \"kube-apiserver-proxy-ip-10-0-130-64.ec2.internal\" (UID: \"f5d35cca57c2f2c6fe15afe949f8be24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.137481 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.137405    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:41.142774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.142755    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c11890a9c7093c33fc263ce2ef65cf8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"4c11890a9c7093c33fc263ce2ef65cf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.142871 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.142712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c11890a9c7093c33fc263ce2ef65cf8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"4c11890a9c7093c33fc263ce2ef65cf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.142871 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.142851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c11890a9c7093c33fc263ce2ef65cf8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"4c11890a9c7093c33fc263ce2ef65cf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.142979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.142878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5d35cca57c2f2c6fe15afe949f8be24-config\") pod \"kube-apiserver-proxy-ip-10-0-130-64.ec2.internal\" (UID: \"f5d35cca57c2f2c6fe15afe949f8be24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.142979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.142929    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5d35cca57c2f2c6fe15afe949f8be24-config\") pod \"kube-apiserver-proxy-ip-10-0-130-64.ec2.internal\" (UID: \"f5d35cca57c2f2c6fe15afe949f8be24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.142979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.142939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c11890a9c7093c33fc263ce2ef65cf8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"4c11890a9c7093c33fc263ce2ef65cf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.237950 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.237919    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:41.314494 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.314464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.319502 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.319240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.338911 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.338740    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:41.443369 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.443268    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:41.543983 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.543947    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found"
Jul 06 19:05:41.582066 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.582041    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:05:41.582611 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.582241    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:05:41.611608 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.611586    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:41.621307 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.621284    2561 apiserver.go:52] "Watching apiserver"
Jul 06 19:05:41.636100 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.636067    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:05:41.637591 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.637566    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-26zhw","kube-system/global-pull-secret-syncer-9r7wx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9","openshift-cluster-node-tuning-operator/tuned-trz2w","openshift-image-registry/node-ca-8n9fn","openshift-multus/multus-additional-cni-plugins-shfl9","openshift-multus/network-metrics-daemon-bh48g","openshift-network-diagnostics/network-check-target-7hggc","openshift-ovn-kubernetes/ovnkube-node-5652z","kube-system/konnectivity-agent-4ds4k","openshift-dns/node-resolver-dkqg4","openshift-multus/multus-hj2h5"]
Jul 06 19:05:41.639809 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.639791    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.639900 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.639817    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:41.640054 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.640037    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.641716 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.641695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.641810 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.641785    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:41.642779 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.642759    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75b77\""
Jul 06 19:05:41.642869 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.642835    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.642869 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.642855    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:05:41.642975 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.642839    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.643363 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.643349    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.644978 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.644955    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.645247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-host-slash\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.645353 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.645353 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-iptables-alerter-script\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.645353 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzsk\" (UniqueName: \"kubernetes.io/projected/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-kube-api-access-nbzsk\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.645353 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645348    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-kubelet-config\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.645540 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-dbus\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.646040 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645751    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.646040 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.646040 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.645981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h2c44\""
Jul 06 19:05:41.646255 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.646240    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:05:41.646482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.646469    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.647351 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.647333    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.647441 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.647374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.647499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.647376    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n9pt\""
Jul 06 19:05:41.648001 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.647979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.648476 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.648457    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.648903 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.648890    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:05:41.649062 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.649049    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q6kbs\""
Jul 06 19:05:41.649244 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.649231    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.649455 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.649441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:41.649540 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.649521    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:41.650055 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.650041    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:05:41.650379 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.650359    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:05:41.650463 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.650396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ws5pk\""
Jul 06 19:05:41.650552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.650535    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.650642 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.650627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:05:41.650712 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.650659    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.651075 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.651059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:41.651144 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.651111    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:41.652548 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.652531    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:41.652632 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.652620    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"
Jul 06 19:05:41.652827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.652813    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.654735 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.654721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.654869 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.654853    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:05:41.655217 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.655194    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:05:41.655313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.655240    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:05:41.655313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.655266    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bjkqn\""
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.656258    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.656282    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.656311    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.656481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.656791    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.657347    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.657356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tb57k\""
Jul 06 19:05:41.658908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.657425    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:05:41.659311 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.658997    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5cx5\""
Jul 06 19:05:41.659311 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.659038    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:05:41.659311 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.659098    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:05:41.659582 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.659562    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"]
Jul 06 19:05:41.659665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.659646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.661841 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.661824    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:05:41.662026 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.662014    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fgpct\""
Jul 06 19:05:41.664242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.664225    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:41.664683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.664655    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"]
Jul 06 19:05:41.681888 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.681811    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:00:41 +0000 UTC" deadline="2028-01-16 14:52:27.652035665 +0000 UTC"
Jul 06 19:05:41.681888 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.681882    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13411h46m45.970157327s"
Jul 06 19:05:41.741242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.741219    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:05:41.745968 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.745941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-modprobe-d\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746071 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.745975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-run\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746071 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.745995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e666f47-e909-477e-85d2-5e1e3c7c65c8-tmp\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746071 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746007    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hhx4k"
Jul 06 19:05:41.746071 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.746071 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-cni-multus\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-host\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-systemd\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-etc-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-var-lib-kubelet\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56r4j\" (UniqueName: \"kubernetes.io/projected/2e666f47-e909-477e-85d2-5e1e3c7c65c8-kube-api-access-56r4j\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdkp\" (UniqueName: \"kubernetes.io/projected/6214672d-02ef-442f-8ccd-3ee67b411b8a-kube-api-access-dwdkp\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-multus-certs\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d789442a-f602-4d5b-871c-731b864abea4-agent-certs\") pod \"konnectivity-agent-4ds4k\" (UID: \"d789442a-f602-4d5b-871c-731b864abea4\") " pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.746303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkvk\" (UniqueName: \"kubernetes.io/projected/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-kube-api-access-cvkvk\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-serviceca\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-socket-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysconfig\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysctl-conf\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-os-release\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-cni-bin\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s266q\" (UniqueName: \"kubernetes.io/projected/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-kube-api-access-s266q\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-host-slash\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.746626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-conf-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746640    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-host-slash\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-cni-netd\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-registration-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-system-cni-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9465d8c3-1226-48e6-b481-a3527097297c-multus-daemon-config\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-etc-kubernetes\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-systemd-units\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-node-log\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.746987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.747068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysctl-d\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.747109    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.747198    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.247174694 +0000 UTC m=+1.997883921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-hostroot\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tc2l\" (UniqueName: \"kubernetes.io/projected/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-kube-api-access-8tc2l\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-sys-fs\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-sys\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-log-socket\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-kubelet\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d789442a-f602-4d5b-871c-731b864abea4-konnectivity-ca\") pod \"konnectivity-agent-4ds4k\" (UID: \"d789442a-f602-4d5b-871c-731b864abea4\") " pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1de5e4a6-395d-47a9-8f97-e3df63ec715e-hosts-file\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.747579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzsk\" (UniqueName: \"kubernetes.io/projected/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-kube-api-access-nbzsk\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-kubernetes\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-lib-modules\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkvvx\" (UniqueName: \"kubernetes.io/projected/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-kube-api-access-wkvvx\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-cni-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9465d8c3-1226-48e6-b481-a3527097297c-cni-binary-copy\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-netns\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-cni-bin\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-cnibin\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747893    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovnkube-config\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.747970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-host\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-cnibin\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4bd\" (UniqueName: \"kubernetes.io/projected/9465d8c3-1226-48e6-b481-a3527097297c-kube-api-access-2k4bd\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-slash\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovn-node-metrics-cert\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-tuned\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-socket-dir-parent\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-run-netns\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-var-lib-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-env-overrides\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovnkube-script-lib\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de5e4a6-395d-47a9-8f97-e3df63ec715e-tmp-dir\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk2l5\" (UniqueName: \"kubernetes.io/projected/1de5e4a6-395d-47a9-8f97-e3df63ec715e-kube-api-access-vk2l5\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-systemd\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-os-release\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-k8s-cni-cncf-io\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-iptables-alerter-script\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748440    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-kubelet-config\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-dbus\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-device-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.748935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-system-cni-dir\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.749456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748547    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-kubelet\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.749456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748567    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-dbus\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.749456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-ovn\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.749456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.748555    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-kubelet-config\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:41.750934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.750913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-iptables-alerter-script\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.757287 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.757271    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hhx4k"
Jul 06 19:05:41.759702 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.759680    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:05:41.762975 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.762952    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzsk\" (UniqueName: \"kubernetes.io/projected/ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639-kube-api-access-nbzsk\") pod \"iptables-alerter-26zhw\" (UID: \"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639\") " pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.817826 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.817799    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:41.848776 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-device-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-system-cni-dir\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-kubelet\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-ovn\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-modprobe-d\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-run\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848879    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-device-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e666f47-e909-477e-85d2-5e1e3c7c65c8-tmp\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848882    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-system-cni-dir\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848886    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-kubelet\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848927    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-run\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848930    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-ovn\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-cni-multus\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.848993    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-modprobe-d\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849007 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-host\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849036    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-host\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849046    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-cni-multus\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-systemd\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-etc-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849092    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-systemd\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-var-lib-kubelet\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849154    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-etc-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849161    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-var-lib-kubelet\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56r4j\" (UniqueName: \"kubernetes.io/projected/2e666f47-e909-477e-85d2-5e1e3c7c65c8-kube-api-access-56r4j\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdkp\" (UniqueName: \"kubernetes.io/projected/6214672d-02ef-442f-8ccd-3ee67b411b8a-kube-api-access-dwdkp\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-multus-certs\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d789442a-f602-4d5b-871c-731b864abea4-agent-certs\") pod \"konnectivity-agent-4ds4k\" (UID: \"d789442a-f602-4d5b-871c-731b864abea4\") " pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkvk\" (UniqueName: \"kubernetes.io/projected/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-kube-api-access-cvkvk\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849285    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-multus-certs\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-serviceca\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-socket-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.849827 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.849502    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysconfig\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.849579    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.349559104 +0000 UTC m=+2.100268329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849628    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysctl-conf\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849738    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysconfig\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849810    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-socket-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-os-release\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-cni-bin\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849923    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-serviceca\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s266q\" (UniqueName: \"kubernetes.io/projected/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-kube-api-access-s266q\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-conf-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850134    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-os-release\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-cni-netd\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850173    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-cni-netd\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-registration-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.850949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850219    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-registration-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-system-cni-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9465d8c3-1226-48e6-b481-a3527097297c-multus-daemon-config\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-etc-kubernetes\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-systemd-units\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-node-log\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850377    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849862    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysctl-conf\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysctl-d\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-hostroot\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tc2l\" (UniqueName: \"kubernetes.io/projected/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-kube-api-access-8tc2l\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850520    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-var-lib-cni-bin\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-sys-fs\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.851907 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.849946    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-sys\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850583    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-systemd-units\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-log-socket\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850635    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-node-log\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-kubelet\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d789442a-f602-4d5b-871c-731b864abea4-konnectivity-ca\") pod \"konnectivity-agent-4ds4k\" (UID: \"d789442a-f602-4d5b-871c-731b864abea4\") " pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1de5e4a6-395d-47a9-8f97-e3df63ec715e-hosts-file\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850730    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-sysctl-d\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-kubernetes\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-lib-modules\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkvvx\" (UniqueName: \"kubernetes.io/projected/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-kube-api-access-wkvvx\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-cni-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9465d8c3-1226-48e6-b481-a3527097297c-cni-binary-copy\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-netns\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850888    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9465d8c3-1226-48e6-b481-a3527097297c-multus-daemon-config\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.852823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-cni-bin\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-cnibin\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-etc-kubernetes\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850998    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850303    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-conf-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovnkube-config\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851043    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-kubelet\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-host\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-cnibin\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851085    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-run-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851132    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851135    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-cnibin\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4bd\" (UniqueName: \"kubernetes.io/projected/9465d8c3-1226-48e6-b481-a3527097297c-kube-api-access-2k4bd\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851206    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1de5e4a6-395d-47a9-8f97-e3df63ec715e-hosts-file\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-slash\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851245    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-hostroot\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.853811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovn-node-metrics-cert\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-tuned\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851277    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851302    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-sys-fs\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-socket-dir-parent\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851346    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-sys\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851355    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-socket-dir-parent\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-run-netns\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851394    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-run-netns\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-var-lib-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851422    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-multus-cni-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851443    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-cni-bin\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-env-overrides\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovnkube-script-lib\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851490    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-netns\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de5e4a6-395d-47a9-8f97-e3df63ec715e-tmp-dir\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850278    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-system-cni-dir\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk2l5\" (UniqueName: \"kubernetes.io/projected/1de5e4a6-395d-47a9-8f97-e3df63ec715e-kube-api-access-vk2l5\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.854789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.850989    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-kubernetes\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851535    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-slash\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-systemd\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851621    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-systemd\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851656    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-log-socket\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851749    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-lib-modules\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851785    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e666f47-e909-477e-85d2-5e1e3c7c65c8-host\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851841    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9465d8c3-1226-48e6-b481-a3527097297c-cni-binary-copy\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851958    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-cnibin\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.851982    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-var-lib-openvswitch\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852148    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovnkube-config\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-os-release\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852236    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d789442a-f602-4d5b-871c-731b864abea4-konnectivity-ca\") pod \"konnectivity-agent-4ds4k\" (UID: \"d789442a-f602-4d5b-871c-731b864abea4\") " pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-k8s-cni-cncf-io\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9465d8c3-1226-48e6-b481-a3527097297c-host-run-k8s-cni-cncf-io\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852341    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d789442a-f602-4d5b-871c-731b864abea4-agent-certs\") pod \"konnectivity-agent-4ds4k\" (UID: \"d789442a-f602-4d5b-871c-731b864abea4\") " pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852383    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6214672d-02ef-442f-8ccd-3ee67b411b8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.855941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e666f47-e909-477e-85d2-5e1e3c7c65c8-tmp\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.856957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852433    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6214672d-02ef-442f-8ccd-3ee67b411b8a-os-release\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.856957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852610    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-env-overrides\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.856957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852652    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de5e4a6-395d-47a9-8f97-e3df63ec715e-tmp-dir\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.856957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.852992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovnkube-script-lib\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.856957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.854607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e666f47-e909-477e-85d2-5e1e3c7c65c8-etc-tuned\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.856957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.854751    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-ovn-node-metrics-cert\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.861468 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.861443    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56r4j\" (UniqueName: \"kubernetes.io/projected/2e666f47-e909-477e-85d2-5e1e3c7c65c8-kube-api-access-56r4j\") pod \"tuned-trz2w\" (UID: \"2e666f47-e909-477e-85d2-5e1e3c7c65c8\") " pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.865119 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.865096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdkp\" (UniqueName: \"kubernetes.io/projected/6214672d-02ef-442f-8ccd-3ee67b411b8a-kube-api-access-dwdkp\") pod \"multus-additional-cni-plugins-shfl9\" (UID: \"6214672d-02ef-442f-8ccd-3ee67b411b8a\") " pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:41.865241 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.865117    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkvk\" (UniqueName: \"kubernetes.io/projected/1f8c92c9-4e6e-499e-bfc3-f7f09397b224-kube-api-access-cvkvk\") pod \"aws-ebs-csi-driver-node-gwqg9\" (UID: \"1f8c92c9-4e6e-499e-bfc3-f7f09397b224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.865241 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.865148    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:41.865241 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.865166    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:41.865241 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.865176    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:41.865405 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:41.865280    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.365261596 +0000 UTC m=+2.115970828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:41.867130 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.867104    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tc2l\" (UniqueName: \"kubernetes.io/projected/6dadbfed-32a7-4d11-90f7-8c26da9d38f4-kube-api-access-8tc2l\") pod \"node-ca-8n9fn\" (UID: \"6dadbfed-32a7-4d11-90f7-8c26da9d38f4\") " pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:41.867875 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.867826    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s266q\" (UniqueName: \"kubernetes.io/projected/fb725fae-ebae-48a2-a351-8cd8b8c03c4d-kube-api-access-s266q\") pod \"ovnkube-node-5652z\" (UID: \"fb725fae-ebae-48a2-a351-8cd8b8c03c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:41.868039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.868020    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkvvx\" (UniqueName: \"kubernetes.io/projected/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-kube-api-access-wkvvx\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:41.868247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.868228    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4bd\" (UniqueName: \"kubernetes.io/projected/9465d8c3-1226-48e6-b481-a3527097297c-kube-api-access-2k4bd\") pod \"multus-hj2h5\" (UID: \"9465d8c3-1226-48e6-b481-a3527097297c\") " pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:41.869353 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.869335    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk2l5\" (UniqueName: \"kubernetes.io/projected/1de5e4a6-395d-47a9-8f97-e3df63ec715e-kube-api-access-vk2l5\") pod \"node-resolver-dkqg4\" (UID: \"1de5e4a6-395d-47a9-8f97-e3df63ec715e\") " pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:41.960089 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:41.960008    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c11890a9c7093c33fc263ce2ef65cf8.slice/crio-4f685c10ce4b5d46fa93858c1e1094f159cd0e8a81d4543667f3b8aca4a492f8 WatchSource:0}: Error finding container 4f685c10ce4b5d46fa93858c1e1094f159cd0e8a81d4543667f3b8aca4a492f8: Status 404 returned error can't find the container with id 4f685c10ce4b5d46fa93858c1e1094f159cd0e8a81d4543667f3b8aca4a492f8
Jul 06 19:05:41.960533 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:41.960505    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d35cca57c2f2c6fe15afe949f8be24.slice/crio-90844e1298530e461fbda9ddb9d2c17efbe75e4e304fd94645490e5b5f018ff3 WatchSource:0}: Error finding container 90844e1298530e461fbda9ddb9d2c17efbe75e4e304fd94645490e5b5f018ff3: Status 404 returned error can't find the container with id 90844e1298530e461fbda9ddb9d2c17efbe75e4e304fd94645490e5b5f018ff3
Jul 06 19:05:41.965526 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.965505    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:05:41.970289 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.970265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-26zhw"
Jul 06 19:05:41.985929 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.985909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9"
Jul 06 19:05:41.992683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:41.992666    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trz2w"
Jul 06 19:05:41.993865 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:41.993840    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8c92c9_4e6e_499e_bfc3_f7f09397b224.slice/crio-78d908fc6b4a79f3ffcec743a5f4a9ee0efd9873b3b367c5dda78a05e5f1fb04 WatchSource:0}: Error finding container 78d908fc6b4a79f3ffcec743a5f4a9ee0efd9873b3b367c5dda78a05e5f1fb04: Status 404 returned error can't find the container with id 78d908fc6b4a79f3ffcec743a5f4a9ee0efd9873b3b367c5dda78a05e5f1fb04
Jul 06 19:05:42.001626 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.001593    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e666f47_e909_477e_85d2_5e1e3c7c65c8.slice/crio-5dd9fd4dbf352f07658d9e399a6d011c50c51cf5e144c1d07e84af8a20f1c4c1 WatchSource:0}: Error finding container 5dd9fd4dbf352f07658d9e399a6d011c50c51cf5e144c1d07e84af8a20f1c4c1: Status 404 returned error can't find the container with id 5dd9fd4dbf352f07658d9e399a6d011c50c51cf5e144c1d07e84af8a20f1c4c1
Jul 06 19:05:42.026867 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.026840    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n9fn"
Jul 06 19:05:42.034032 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.034011    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dadbfed_32a7_4d11_90f7_8c26da9d38f4.slice/crio-fb49394c52922eff9eec460f4f9f364e2aa7c80c765c0e5c5300a3da3a3af79c WatchSource:0}: Error finding container fb49394c52922eff9eec460f4f9f364e2aa7c80c765c0e5c5300a3da3a3af79c: Status 404 returned error can't find the container with id fb49394c52922eff9eec460f4f9f364e2aa7c80c765c0e5c5300a3da3a3af79c
Jul 06 19:05:42.043629 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.043613    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shfl9"
Jul 06 19:05:42.050412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.050388    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:42.050860 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.050839    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6214672d_02ef_442f_8ccd_3ee67b411b8a.slice/crio-d2fb2563c4e6f9a627ff2a8321b7c43524bd4d4e57f4ae515ad887dd0ec0b017 WatchSource:0}: Error finding container d2fb2563c4e6f9a627ff2a8321b7c43524bd4d4e57f4ae515ad887dd0ec0b017: Status 404 returned error can't find the container with id d2fb2563c4e6f9a627ff2a8321b7c43524bd4d4e57f4ae515ad887dd0ec0b017
Jul 06 19:05:42.056304 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.056288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:05:42.063390 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.063358    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb725fae_ebae_48a2_a351_8cd8b8c03c4d.slice/crio-2a6006fb1586ba44e2ba10dac793d2fbd1110ed56b38ab0118c29da361d5311c WatchSource:0}: Error finding container 2a6006fb1586ba44e2ba10dac793d2fbd1110ed56b38ab0118c29da361d5311c: Status 404 returned error can't find the container with id 2a6006fb1586ba44e2ba10dac793d2fbd1110ed56b38ab0118c29da361d5311c
Jul 06 19:05:42.073470 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.073451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:05:42.080854 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.080835    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd789442a_f602_4d5b_871c_731b864abea4.slice/crio-1777e66694b504962c6fdf5832b49a3ef78e79530003924207e6dc44397e8a02 WatchSource:0}: Error finding container 1777e66694b504962c6fdf5832b49a3ef78e79530003924207e6dc44397e8a02: Status 404 returned error can't find the container with id 1777e66694b504962c6fdf5832b49a3ef78e79530003924207e6dc44397e8a02
Jul 06 19:05:42.091578 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.091561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dkqg4"
Jul 06 19:05:42.097569 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.097544    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hj2h5"
Jul 06 19:05:42.098696 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.098677    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de5e4a6_395d_47a9_8f97_e3df63ec715e.slice/crio-26d630c7c8f6f74a0b8653f4a6f552885681660b212e01fe860811d792a568cd WatchSource:0}: Error finding container 26d630c7c8f6f74a0b8653f4a6f552885681660b212e01fe860811d792a568cd: Status 404 returned error can't find the container with id 26d630c7c8f6f74a0b8653f4a6f552885681660b212e01fe860811d792a568cd
Jul 06 19:05:42.106540 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:05:42.106524    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9465d8c3_1226_48e6_b481_a3527097297c.slice/crio-3db56d387287df60d7374ff16fa4a33b1239a756e6fcd152d31c08501f2ccea6 WatchSource:0}: Error finding container 3db56d387287df60d7374ff16fa4a33b1239a756e6fcd152d31c08501f2ccea6: Status 404 returned error can't find the container with id 3db56d387287df60d7374ff16fa4a33b1239a756e6fcd152d31c08501f2ccea6
Jul 06 19:05:42.107968 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.107947    2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-hj2h5_openshift-multus(9465d8c3-1226-48e6-b481-a3527097297c): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 06 19:05:42.108054 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.107979    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-hj2h5" podUID="9465d8c3-1226-48e6-b481-a3527097297c"
Jul 06 19:05:42.254901 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.254818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:42.255047 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.254994    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:42.255096 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.255057    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:43.255038206 +0000 UTC m=+3.005747459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:42.355909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.355868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:42.356160 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.355990    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:42.356160 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.356108    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:43.356086691 +0000 UTC m=+3.106795920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:42.456684 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.456638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:42.456866 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.456822    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:42.456866 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.456850    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:42.456866 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.456864    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:42.457022 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.456932    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:43.456911047 +0000 UTC m=+3.207620292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:42.605928 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.605841    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:42.760371 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.760217    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:42 +0000 UTC" deadline="2027-12-30 12:22:11.477661434 +0000 UTC"
Jul 06 19:05:42.760371 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.760279    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13001h16m28.717387132s"
Jul 06 19:05:42.879203 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.878941    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:42.879203 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.879088    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:42.915454 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.914695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hj2h5" event={"ID":"9465d8c3-1226-48e6-b481-a3527097297c","Type":"ContainerStarted","Data":"3db56d387287df60d7374ff16fa4a33b1239a756e6fcd152d31c08501f2ccea6"}
Jul 06 19:05:42.918630 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:42.918591    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55ec7147f859301bbb8288966c8a21c5db729200f3c3d91db671978baef79517\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-hj2h5" podUID="9465d8c3-1226-48e6-b481-a3527097297c"
Jul 06 19:05:42.943461 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.943367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9" event={"ID":"1f8c92c9-4e6e-499e-bfc3-f7f09397b224","Type":"ContainerStarted","Data":"78d908fc6b4a79f3ffcec743a5f4a9ee0efd9873b3b367c5dda78a05e5f1fb04"}
Jul 06 19:05:42.973117 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:42.973032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-26zhw" event={"ID":"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639","Type":"ContainerStarted","Data":"175a75eefc0d70e4ec1f56f28b4bb9c43d845bd45397fdc7309fe208ba98bad7"}
Jul 06 19:05:43.003458 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.003354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" event={"ID":"f5d35cca57c2f2c6fe15afe949f8be24","Type":"ContainerStarted","Data":"90844e1298530e461fbda9ddb9d2c17efbe75e4e304fd94645490e5b5f018ff3"}
Jul 06 19:05:43.007039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.007004    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dkqg4" event={"ID":"1de5e4a6-395d-47a9-8f97-e3df63ec715e","Type":"ContainerStarted","Data":"26d630c7c8f6f74a0b8653f4a6f552885681660b212e01fe860811d792a568cd"}
Jul 06 19:05:43.027485 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.027442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ds4k" event={"ID":"d789442a-f602-4d5b-871c-731b864abea4","Type":"ContainerStarted","Data":"1777e66694b504962c6fdf5832b49a3ef78e79530003924207e6dc44397e8a02"}
Jul 06 19:05:43.031017 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.030983    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"2a6006fb1586ba44e2ba10dac793d2fbd1110ed56b38ab0118c29da361d5311c"}
Jul 06 19:05:43.046480 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.046447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerStarted","Data":"d2fb2563c4e6f9a627ff2a8321b7c43524bd4d4e57f4ae515ad887dd0ec0b017"}
Jul 06 19:05:43.062284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.062047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n9fn" event={"ID":"6dadbfed-32a7-4d11-90f7-8c26da9d38f4","Type":"ContainerStarted","Data":"fb49394c52922eff9eec460f4f9f364e2aa7c80c765c0e5c5300a3da3a3af79c"}
Jul 06 19:05:43.077206 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.077135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trz2w" event={"ID":"2e666f47-e909-477e-85d2-5e1e3c7c65c8","Type":"ContainerStarted","Data":"5dd9fd4dbf352f07658d9e399a6d011c50c51cf5e144c1d07e84af8a20f1c4c1"}
Jul 06 19:05:43.080235 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.080177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" event={"ID":"4c11890a9c7093c33fc263ce2ef65cf8","Type":"ContainerStarted","Data":"4f685c10ce4b5d46fa93858c1e1094f159cd0e8a81d4543667f3b8aca4a492f8"}
Jul 06 19:05:43.263238 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.263119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:43.263417 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.263289    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:43.263417 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.263352    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.26333379 +0000 UTC m=+5.014043022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:43.364578 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.364450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:43.364778 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.364623    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:43.364778 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.364683    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.364663802 +0000 UTC m=+5.115373030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:43.465564 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.465528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:43.465768 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.465720    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:43.465768 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.465743    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:43.465768 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.465756    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:43.465959 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.465816    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.465796506 +0000 UTC m=+5.216505737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:43.761219 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.761173    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:42 +0000 UTC" deadline="2028-01-07 22:52:05.861170703 +0000 UTC"
Jul 06 19:05:43.761219 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.761215    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13203h46m22.09995971s"
Jul 06 19:05:43.877083 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.876995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:43.877264 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.877117    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:43.877580 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:43.877558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:43.877697 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:43.877675    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:44.877645 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:44.877379    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:44.878163 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:44.877758    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:45.285570 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:45.285401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:45.285744 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.285594    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:45.285744 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.285691    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.285667316 +0000 UTC m=+9.036376549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:45.387271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:45.386673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:45.387271 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.386851    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:45.387271 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.386903    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.386888406 +0000 UTC m=+9.137597637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:45.487255 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:45.487216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:45.487446 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.487377    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:45.487446 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.487394    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:45.487446 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.487404    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:45.487596 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.487483    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.487462079 +0000 UTC m=+9.238171312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:45.876708 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:45.876645    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:45.876882 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.876796    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:45.877260 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:45.877242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:45.877358 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:45.877342    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:46.877747 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:46.877222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:46.877747 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:46.877374    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:47.877477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:47.876869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:47.877477 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:47.876987    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:47.877477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:47.876879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:47.877477 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:47.877437    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:48.879415 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:48.879317    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:48.879815 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:48.879460    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:49.320672 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:49.320569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:49.320806 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.320762    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:49.320886 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.320849    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:57.320824381 +0000 UTC m=+17.071533608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:49.421008 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:49.420967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:49.421237 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.421167    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:49.421237 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.421226    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:57.421210071 +0000 UTC m=+17.171919298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:49.522413 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:49.522381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:49.522586 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.522565    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:49.522631 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.522588    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:49.522631 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.522604    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:49.522713 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.522662    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:57.522645185 +0000 UTC m=+17.273354414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:49.877167 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:49.877112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:49.877374 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:49.877148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:49.877374 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.877266    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:49.877374 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:49.877357    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:50.877060 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:50.877014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:50.877547 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:50.877149    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:51.876369 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:51.876329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:51.876535 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:51.876329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:51.876535 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:51.876451    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:51.876657 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:51.876552    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:52.876662 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:52.876632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:52.876957 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:52.876775    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:53.876536 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:53.876501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:53.876713 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:53.876543    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:53.876713 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:53.876612    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:53.877080 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:53.876906    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:54.876261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:54.876226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:54.876417 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:54.876360    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:55.877048 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:55.877008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:55.877048 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:55.877037    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:55.877511 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:55.877152    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:55.877511 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:55.877253    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:56.876394 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:56.876360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:56.876594 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:56.876491    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:57.379498 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:57.379477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:57.379743 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.379591    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:57.379743 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.379640    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.379626903 +0000 UTC m=+33.130336145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:57.480505 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:57.480481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:57.480630 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.480612    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:57.480682 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.480671    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.480656759 +0000 UTC m=+33.231365987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:57.581369 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:57.581339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:57.581509 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.581495    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:57.581556 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.581515    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:57.581556 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.581524    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:57.581615 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.581571    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.581552384 +0000 UTC m=+33.332261609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:57.876896 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:57.876865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:57.877056 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.876995    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:57.877432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:57.877409    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:57.877596 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:57.877553    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:05:58.119352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.119133    2561 generic.go:356] "Generic (PLEG): container finished" podID="4c11890a9c7093c33fc263ce2ef65cf8" containerID="f51f00b887e5cbb19f82f850265ef5b769f7009feec70825ee0c95c32475a425" exitCode=0
Jul 06 19:05:58.119499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.119225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" event={"ID":"4c11890a9c7093c33fc263ce2ef65cf8","Type":"ContainerDied","Data":"f51f00b887e5cbb19f82f850265ef5b769f7009feec70825ee0c95c32475a425"}
Jul 06 19:05:58.121087 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.121063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9" event={"ID":"1f8c92c9-4e6e-499e-bfc3-f7f09397b224","Type":"ContainerStarted","Data":"5488a676b6cd471ca79ffb33250297a53d1ddd18bd799c07ec3aafc776016407"}
Jul 06 19:05:58.123069 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.123048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" event={"ID":"f5d35cca57c2f2c6fe15afe949f8be24","Type":"ContainerStarted","Data":"8347c77292a91f17b0427acebc8b357c935d3465b706c2e4b592c4e6a56f0cea"}
Jul 06 19:05:58.124867 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.124843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dkqg4" event={"ID":"1de5e4a6-395d-47a9-8f97-e3df63ec715e","Type":"ContainerStarted","Data":"33ae0a78d3029176dd52a00f2117a8bf6ebf768aa9ddfa77e6c47f55149b9177"}
Jul 06 19:05:58.126241 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.126209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ds4k" event={"ID":"d789442a-f602-4d5b-871c-731b864abea4","Type":"ContainerStarted","Data":"fb2896c672066696cbcab819d85135b9f7fbbbf8adc1cb7bc751d33fa01a2ee6"}
Jul 06 19:05:58.128426 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.128400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"89c3c3e85feeb4975cb0f9e878a6ab949a391edbb3a8c48db681cd2d348834fe"}
Jul 06 19:05:58.128533 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.128451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"bf57dfa8b2d541d7e6f1731dc18473f7d8a81d108794779d4428834b94dcab34"}
Jul 06 19:05:58.128533 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.128484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"fb7fb13e22e3b1ea47ed073128a98ca88c7fdb462dc86675a2d64d955bef68bd"}
Jul 06 19:05:58.130026 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.130004    2561 generic.go:356] "Generic (PLEG): container finished" podID="6214672d-02ef-442f-8ccd-3ee67b411b8a" containerID="ceb38837ceae321ce1d2321b5fb1f97632d1d497f18ba6484b7cade602d889d3" exitCode=0
Jul 06 19:05:58.130133 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.130070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerDied","Data":"ceb38837ceae321ce1d2321b5fb1f97632d1d497f18ba6484b7cade602d889d3"}
Jul 06 19:05:58.132516 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.132487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n9fn" event={"ID":"6dadbfed-32a7-4d11-90f7-8c26da9d38f4","Type":"ContainerStarted","Data":"4f27cb344d52eb1f653493969c14e94332c8b39c816fff6ebe48e9c2da055867"}
Jul 06 19:05:58.134183 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.134159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trz2w" event={"ID":"2e666f47-e909-477e-85d2-5e1e3c7c65c8","Type":"ContainerStarted","Data":"e41d6481f112f425bf810d1c1c9910dccc0fd66e425ab6d2dbc1042fa259678a"}
Jul 06 19:05:58.139890 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.139845    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" podStartSLOduration=16.139829682 podStartE2EDuration="16.139829682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:58.13923927 +0000 UTC m=+17.889948517" watchObservedRunningTime="2026-07-06 19:05:58.139829682 +0000 UTC m=+17.890538932"
Jul 06 19:05:58.177805 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.177766    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4ds4k" podStartSLOduration=1.950428483 podStartE2EDuration="17.177752254s" totalImagesPullingTime="15.227323771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:58.177483295 +0000 UTC m=+17.928192562" watchObservedRunningTime="2026-07-06 19:05:58.177752254 +0000 UTC m=+17.928461501"
Jul 06 19:05:58.194485 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.194449    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dkqg4" podStartSLOduration=1.9849712290000001 podStartE2EDuration="17.194430502s" totalImagesPullingTime="15.209459273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:58.193827595 +0000 UTC m=+17.944536843" watchObservedRunningTime="2026-07-06 19:05:58.194430502 +0000 UTC m=+17.945139750"
Jul 06 19:05:58.214318 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.214275    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trz2w" podStartSLOduration=1.895295637 podStartE2EDuration="17.214256556s" totalImagesPullingTime="15.318960919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:58.213386519 +0000 UTC m=+17.964095794" watchObservedRunningTime="2026-07-06 19:05:58.214256556 +0000 UTC m=+17.964965815"
Jul 06 19:05:58.231477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.231430    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8n9fn" podStartSLOduration=1.95711908 podStartE2EDuration="17.231416141s" totalImagesPullingTime="15.274297061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:58.231340778 +0000 UTC m=+17.982050026" watchObservedRunningTime="2026-07-06 19:05:58.231416141 +0000 UTC m=+17.982125387"
Jul 06 19:05:58.877190 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:58.876900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:05:58.877964 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:58.877317    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:05:59.091029 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.090817    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:05:59.138924 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.138892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"8fd0f862849c5bf7724d714205cfa76e4244226c3ee276c318c47a9cb55ed133"}
Jul 06 19:05:59.139050 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.138982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"9c7ec8219c241557c544d796ab3afcede91301ab185c7c190b2d6aa25968817d"}
Jul 06 19:05:59.139050 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.139040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"fdcbb3e9fa77939ee9c5ddcc8a7d8340d3cf0086d0b5debb908db568f3a864ec"}
Jul 06 19:05:59.140878 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.140850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9" event={"ID":"1f8c92c9-4e6e-499e-bfc3-f7f09397b224","Type":"ContainerStarted","Data":"6cc9b1808c703574e9fe2ffe632dd485c8eb67b479c94e50342c65212f8f0968"}
Jul 06 19:05:59.142507 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.142483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-26zhw" event={"ID":"ecb8c524-d1e1-42f1-ba52-b8ad1ee7e639","Type":"ContainerStarted","Data":"5105b7e20b33d06aefbd5b7232d1a55f30a81625d7ba73f44d1f733028025685"}
Jul 06 19:05:59.160228 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.160186    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-26zhw" podStartSLOduration=2.834857701 podStartE2EDuration="18.160173807s" totalImagesPullingTime="15.325316106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:59.159822786 +0000 UTC m=+18.910532033" watchObservedRunningTime="2026-07-06 19:05:59.160173807 +0000 UTC m=+18.910883053"
Jul 06 19:05:59.712501 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.712383    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:05:59.090835337Z","UUID":"ef9e4a52-7df9-4acc-b607-5f8b72bd9bff","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:05:59.714450 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.714427    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:05:59.714601 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.714471    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:05:59.876629 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.876591    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:05:59.876807 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:59.876700    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:05:59.876993 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:05:59.876591    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:05:59.877097 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:05:59.877074    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:00.148004 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:00.147602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" event={"ID":"4c11890a9c7093c33fc263ce2ef65cf8","Type":"ContainerStarted","Data":"b930406cb09427f3ccaecc3eb1e64fe891bd218c1f6ee1d6e97d9744425c493b"}
Jul 06 19:06:00.165195 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:00.165090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" podStartSLOduration=18.165071801 podStartE2EDuration="18.165071801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:00.164885542 +0000 UTC m=+19.915594800" watchObservedRunningTime="2026-07-06 19:06:00.165071801 +0000 UTC m=+19.915781048"
Jul 06 19:06:00.877917 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:00.877830    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:00.878189 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:00.877958    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:00.961671 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:00.961438    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:06:00.962206 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:00.962181    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:06:01.154233 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:01.154147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"ceef9dd1677b1936ec3271b849e707bf275bb95703c6d022f8f0811ff9f50bce"}
Jul 06 19:06:01.156482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:01.156452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9" event={"ID":"1f8c92c9-4e6e-499e-bfc3-f7f09397b224","Type":"ContainerStarted","Data":"850ef90aac7258b825a91c21d24066454315fbcfc1ffcc8309222ae6b60f2ef1"}
Jul 06 19:06:01.177169 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:01.177125    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwqg9" podStartSLOduration=2.862203031 podStartE2EDuration="20.177092275s" totalImagesPullingTime="17.314889244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:01.176950083 +0000 UTC m=+20.927659350" watchObservedRunningTime="2026-07-06 19:06:01.177092275 +0000 UTC m=+20.927801522"
Jul 06 19:06:01.876224 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:01.876191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:01.876382 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:01.876190    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:01.876382 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:01.876334    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:01.876505 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:01.876386    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:02.877146 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:02.877040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:02.877537 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:02.877199    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:03.876719 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:03.876524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:03.876884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:03.876524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:03.876884 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:03.876803    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:03.876961 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:03.876910    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:04.167237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.167147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" event={"ID":"fb725fae-ebae-48a2-a351-8cd8b8c03c4d","Type":"ContainerStarted","Data":"51ecfffea59338522125c556f3b9bd0442f5c47faf83ef345c39c11e2cb793d2"}
Jul 06 19:06:04.167957 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.167423    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:06:04.169631 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.169597    2561 generic.go:356] "Generic (PLEG): container finished" podID="6214672d-02ef-442f-8ccd-3ee67b411b8a" containerID="5f75f2981741b47eccdcea481aa0748ee41c2a6fc346c8e8c9181d706e0e1197" exitCode=0
Jul 06 19:06:04.169744 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.169641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerDied","Data":"5f75f2981741b47eccdcea481aa0748ee41c2a6fc346c8e8c9181d706e0e1197"}
Jul 06 19:06:04.185096 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.185073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:06:04.197829 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.197761    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5652z" podStartSLOduration=7.5390293790000005 podStartE2EDuration="23.19774932s" totalImagesPullingTime="15.658719941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:04.197220204 +0000 UTC m=+23.947929465" watchObservedRunningTime="2026-07-06 19:06:04.19774932 +0000 UTC m=+23.948458567"
Jul 06 19:06:04.876868 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:04.876836    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:04.877013 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:04.876982    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:05.175483 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.175191    2561 generic.go:356] "Generic (PLEG): container finished" podID="6214672d-02ef-442f-8ccd-3ee67b411b8a" containerID="7ab491e25a5d7796e2e945289a1609358bc75059f9dff8b50a3152f547887955" exitCode=0
Jul 06 19:06:05.175483 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.175272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerDied","Data":"7ab491e25a5d7796e2e945289a1609358bc75059f9dff8b50a3152f547887955"}
Jul 06 19:06:05.175936 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.175544    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:06:05.176567 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.176039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:06:05.194913 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.194886    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:06:05.236724 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.236695    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9r7wx"]
Jul 06 19:06:05.236848 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.236812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:05.236941 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:05.236916    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:05.237686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.237479    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hggc"]
Jul 06 19:06:05.237686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.237578    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:05.237686 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:05.237657    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:05.252412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.252388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bh48g"]
Jul 06 19:06:05.252515 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:05.252487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:05.252643 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:05.252604    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:06.180723 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:06.180631    2561 generic.go:356] "Generic (PLEG): container finished" podID="6214672d-02ef-442f-8ccd-3ee67b411b8a" containerID="431e7402a8e9574e9b25e153ac9c8bf13259334682caa99904e15e7a1765e1d5" exitCode=0
Jul 06 19:06:06.181188 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:06.180718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerDied","Data":"431e7402a8e9574e9b25e153ac9c8bf13259334682caa99904e15e7a1765e1d5"}
Jul 06 19:06:06.181188 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:06.180801    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:06:06.876625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:06.876551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:06.876770 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:06.876689    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:06.877055 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:06.877041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:06.877153 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:06.877135    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:06.877198 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:06.877188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:06.877275 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:06.877262    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:07.183636 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:07.183569    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:06:08.877213 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:08.877164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:08.877724 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:08.877167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:08.877724 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:08.877300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:08.877724 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:08.877179    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:08.877724 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:08.877402    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:08.877724 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:08.877475    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:09.445769 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:09.445729    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:06:09.445949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:09.445907    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:06:09.446449 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:09.446432    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4ds4k"
Jul 06 19:06:10.880788 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:10.880759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:10.881240 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:10.880759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:10.881240 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:10.880886    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:10.881240 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:10.880988    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:10.881240 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:10.880759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:10.881240 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:10.881075    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:12.034267 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:12.034226    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:06:12.034720 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:12.034532    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:06:12.045941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:12.045914    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5652z"
Jul 06 19:06:12.876622 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:12.876590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:12.876781 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:12.876590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:12.876781 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:12.876723    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:12.876781 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:12.876753    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:12.876905 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:12.876815    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:12.876905 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:12.876861    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:13.202172 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:13.201885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerStarted","Data":"62b49e7f962c1736a60818f00cbe2d44f0779e2aa75bef87830c7c37097f3f9d"}
Jul 06 19:06:13.203654 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:13.203608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hj2h5" event={"ID":"9465d8c3-1226-48e6-b481-a3527097297c","Type":"ContainerStarted","Data":"5a2e8f86df76bf4f7077da0f07bcb5944e42f8f0ed653f138c9a5780f3fbe91c"}
Jul 06 19:06:13.246333 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:13.246290    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hj2h5" podStartSLOduration=1.287258351 podStartE2EDuration="32.246273944s" totalImagesPullingTime="30.959015593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 19:06:13.24617581 +0000 UTC m=+32.996885050" watchObservedRunningTime="2026-07-06 19:06:13.246273944 +0000 UTC m=+32.996983190"
Jul 06 19:06:13.402795 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:13.402721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:13.402913 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.402854    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:06:13.402913 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.402910    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret podName:f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:45.402895495 +0000 UTC m=+65.153604723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret") pod "global-pull-secret-syncer-9r7wx" (UID: "f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:06:13.503960 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:13.503925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:13.504136 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.504066    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:06:13.504184 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.504147    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:45.504129372 +0000 UTC m=+65.254838616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:06:13.604290 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:13.604260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:13.604486 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.604376    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:06:13.604486 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.604389    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:06:13.604486 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.604398    2561 projected.go:196] Error preparing data for projected volume kube-api-access-7n7r2 for pod openshift-network-diagnostics/network-check-target-7hggc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:06:13.604486 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:13.604444    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2 podName:af74421d-5940-439e-8223-bbf0d6c03fd2 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:45.604431785 +0000 UTC m=+65.355141009 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n7r2" (UniqueName: "kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2") pod "network-check-target-7hggc" (UID: "af74421d-5940-439e-8223-bbf0d6c03fd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:06:14.208266 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:14.208234    2561 generic.go:356] "Generic (PLEG): container finished" podID="6214672d-02ef-442f-8ccd-3ee67b411b8a" containerID="62b49e7f962c1736a60818f00cbe2d44f0779e2aa75bef87830c7c37097f3f9d" exitCode=0
Jul 06 19:06:14.208704 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:14.208289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerDied","Data":"62b49e7f962c1736a60818f00cbe2d44f0779e2aa75bef87830c7c37097f3f9d"}
Jul 06 19:06:14.876870 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:14.876837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:14.876870 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:14.876867    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:14.877143 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:14.876837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:14.877143 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:14.876960    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hggc" podUID="af74421d-5940-439e-8223-bbf0d6c03fd2"
Jul 06 19:06:14.877143 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:14.877022    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9r7wx" podUID="f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7"
Jul 06 19:06:14.877143 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:14.877104    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:06:15.034844 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.034772    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeReady"
Jul 06 19:06:15.035040 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.034906    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:06:15.085708 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.085679    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z2g8d"]
Jul 06 19:06:15.104717 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.104689    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fh4xd"]
Jul 06 19:06:15.104866 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.104834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.107532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.107395    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:06:15.107532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.107419    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qlc5\""
Jul 06 19:06:15.107532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.107465    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:06:15.107532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.107396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:06:15.121448 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.121423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z2g8d"]
Jul 06 19:06:15.121620 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.121485    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fh4xd"]
Jul 06 19:06:15.121620 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.121571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.123815 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.123795    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:06:15.124459 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.124446    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:06:15.124647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.124636    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\""
Jul 06 19:06:15.213244 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.213217    2561 generic.go:356] "Generic (PLEG): container finished" podID="6214672d-02ef-442f-8ccd-3ee67b411b8a" containerID="40d1dd81f74b0301de0a00d2609efe039bcdc99ce69b10fd5e8dd925bdf4cf9b" exitCode=0
Jul 06 19:06:15.213791 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.213267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerDied","Data":"40d1dd81f74b0301de0a00d2609efe039bcdc99ce69b10fd5e8dd925bdf4cf9b"}
Jul 06 19:06:15.215185 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.215166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887c074b-d3e3-42fe-9a5b-ddee82884a6a-cert\") pod \"ingress-canary-z2g8d\" (UID: \"887c074b-d3e3-42fe-9a5b-ddee82884a6a\") " pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.215271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.215202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.215271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.215245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkt92\" (UniqueName: \"kubernetes.io/projected/0d6b5338-13bf-41f6-89e9-302b27d2abfc-kube-api-access-xkt92\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.215373 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.215343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6b5338-13bf-41f6-89e9-302b27d2abfc-config-volume\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.215429 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.215374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b5338-13bf-41f6-89e9-302b27d2abfc-tmp-dir\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.215429 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.215418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvrx\" (UniqueName: \"kubernetes.io/projected/887c074b-d3e3-42fe-9a5b-ddee82884a6a-kube-api-access-bdvrx\") pod \"ingress-canary-z2g8d\" (UID: \"887c074b-d3e3-42fe-9a5b-ddee82884a6a\") " pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.315940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.315916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvrx\" (UniqueName: \"kubernetes.io/projected/887c074b-d3e3-42fe-9a5b-ddee82884a6a-kube-api-access-bdvrx\") pod \"ingress-canary-z2g8d\" (UID: \"887c074b-d3e3-42fe-9a5b-ddee82884a6a\") " pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.316056 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.315950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887c074b-d3e3-42fe-9a5b-ddee82884a6a-cert\") pod \"ingress-canary-z2g8d\" (UID: \"887c074b-d3e3-42fe-9a5b-ddee82884a6a\") " pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.316056 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.315972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.316180 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:15.316062    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:15.316180 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:15.316161    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:06:15.816142704 +0000 UTC m=+35.566851931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:15.316287 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.316193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkt92\" (UniqueName: \"kubernetes.io/projected/0d6b5338-13bf-41f6-89e9-302b27d2abfc-kube-api-access-xkt92\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.316346 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.316281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6b5338-13bf-41f6-89e9-302b27d2abfc-config-volume\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.316346 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.316318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b5338-13bf-41f6-89e9-302b27d2abfc-tmp-dir\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.316643 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.316621    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6b5338-13bf-41f6-89e9-302b27d2abfc-tmp-dir\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.316788 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.316773    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6b5338-13bf-41f6-89e9-302b27d2abfc-config-volume\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.320440 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.320423    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887c074b-d3e3-42fe-9a5b-ddee82884a6a-cert\") pod \"ingress-canary-z2g8d\" (UID: \"887c074b-d3e3-42fe-9a5b-ddee82884a6a\") " pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.326412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.326390    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkt92\" (UniqueName: \"kubernetes.io/projected/0d6b5338-13bf-41f6-89e9-302b27d2abfc-kube-api-access-xkt92\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.326779 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.326757    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvrx\" (UniqueName: \"kubernetes.io/projected/887c074b-d3e3-42fe-9a5b-ddee82884a6a-kube-api-access-bdvrx\") pod \"ingress-canary-z2g8d\" (UID: \"887c074b-d3e3-42fe-9a5b-ddee82884a6a\") " pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.414843 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.414810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z2g8d"
Jul 06 19:06:15.561505 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.561425    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z2g8d"]
Jul 06 19:06:15.564698 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:06:15.564677    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887c074b_d3e3_42fe_9a5b_ddee82884a6a.slice/crio-1e751f5fbadf2eed9a0f7ffce8d2b51625032ee84d0ec26f48fba26c8e29df68 WatchSource:0}: Error finding container 1e751f5fbadf2eed9a0f7ffce8d2b51625032ee84d0ec26f48fba26c8e29df68: Status 404 returned error can't find the container with id 1e751f5fbadf2eed9a0f7ffce8d2b51625032ee84d0ec26f48fba26c8e29df68
Jul 06 19:06:15.820546 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:15.820454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:15.820756 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:15.820646    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:15.820756 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:15.820731    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:06:16.820706381 +0000 UTC m=+36.571415609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:16.216477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.216395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z2g8d" event={"ID":"887c074b-d3e3-42fe-9a5b-ddee82884a6a","Type":"ContainerStarted","Data":"1e751f5fbadf2eed9a0f7ffce8d2b51625032ee84d0ec26f48fba26c8e29df68"}
Jul 06 19:06:16.219591 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.219563    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shfl9" event={"ID":"6214672d-02ef-442f-8ccd-3ee67b411b8a","Type":"ContainerStarted","Data":"644a38ad46c1737ef218f75ef1204d9c4e0caf5f3c003d13223f3e7e80a51080"}
Jul 06 19:06:16.247432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.247383    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-shfl9" podStartSLOduration=6.513651432 podStartE2EDuration="35.247366011s" totalImagesPullingTime="28.733714579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:16.247279001 +0000 UTC m=+35.997988304" watchObservedRunningTime="2026-07-06 19:06:16.247366011 +0000 UTC m=+35.998075258"
Jul 06 19:06:16.827027 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.826992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:16.827292 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:16.827163    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:16.827292 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:16.827232    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:06:18.827215285 +0000 UTC m=+38.577924510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:16.876697 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.876658    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:16.876697 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.876694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:16.876889 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.876658    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:16.879390 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.879368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:16.879519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.879371    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:16.879519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.879371    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:16.880135 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.880102    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\""
Jul 06 19:06:16.880200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.880141    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\""
Jul 06 19:06:16.880287 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:16.880271    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:18.841728 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:18.841682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:18.842163 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:18.841838    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:18.842163 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:18.841901    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.841886323 +0000 UTC m=+42.592595548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:20.230921 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:20.230887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z2g8d" event={"ID":"887c074b-d3e3-42fe-9a5b-ddee82884a6a","Type":"ContainerStarted","Data":"a1c29aa834168478ecc601dd4e9cd479b9b9c630bc25e718c3779ac549c9d871"}
Jul 06 19:06:20.249293 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:20.249246    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z2g8d" podStartSLOduration=1.001627922 podStartE2EDuration="5.249232086s" totalImagesPullingTime="4.247604164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:20.248651068 +0000 UTC m=+39.999360315" watchObservedRunningTime="2026-07-06 19:06:20.249232086 +0000 UTC m=+39.999941364"
Jul 06 19:06:22.868837 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:22.868793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:22.869265 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:22.868940    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:22.869265 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:22.868999    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.868986473 +0000 UTC m=+50.619695699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:30.922813 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:30.922767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:30.923237 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:30.922908    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:30.923237 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:30.922998    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:06:46.922978754 +0000 UTC m=+66.673687982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:45.422477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.422436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:45.425296 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.425263    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:45.435339 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.435316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7-original-pull-secret\") pod \"global-pull-secret-syncer-9r7wx\" (UID: \"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7\") " pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:45.523613 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.523581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:06:45.526188 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.526169    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:45.534372 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:45.534356    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:06:45.534432 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:45.534418    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:49.534395393 +0000 UTC m=+129.285104619 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : secret "metrics-daemon-secret" not found
Jul 06 19:06:45.624355 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.624329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:45.626749 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.626731    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:45.637012 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.636995    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:45.647167 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.647140    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7r2\" (UniqueName: \"kubernetes.io/projected/af74421d-5940-439e-8223-bbf0d6c03fd2-kube-api-access-7n7r2\") pod \"network-check-target-7hggc\" (UID: \"af74421d-5940-439e-8223-bbf0d6c03fd2\") " pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:45.687456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.687391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9r7wx"
Jul 06 19:06:45.699201 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.699177    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\""
Jul 06 19:06:45.707101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.707083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:45.870552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.870472    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9r7wx"]
Jul 06 19:06:45.873400 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:06:45.873375    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cb2f5b_6bd6_4687_9df3_a0471d2e39d7.slice/crio-8bffaeafd96e4e4b500537dd0b8559366fa01d0b427541b491f89f940009684e WatchSource:0}: Error finding container 8bffaeafd96e4e4b500537dd0b8559366fa01d0b427541b491f89f940009684e: Status 404 returned error can't find the container with id 8bffaeafd96e4e4b500537dd0b8559366fa01d0b427541b491f89f940009684e
Jul 06 19:06:45.889212 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:45.889182    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hggc"]
Jul 06 19:06:45.908456 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:06:45.908429    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf74421d_5940_439e_8223_bbf0d6c03fd2.slice/crio-0068898e1ad035144f311acf7efabe764f795b94f92c12b7d64963155d899d00 WatchSource:0}: Error finding container 0068898e1ad035144f311acf7efabe764f795b94f92c12b7d64963155d899d00: Status 404 returned error can't find the container with id 0068898e1ad035144f311acf7efabe764f795b94f92c12b7d64963155d899d00
Jul 06 19:06:46.292726 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:46.292691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9r7wx" event={"ID":"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7","Type":"ContainerStarted","Data":"8bffaeafd96e4e4b500537dd0b8559366fa01d0b427541b491f89f940009684e"}
Jul 06 19:06:46.293964 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:46.293934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hggc" event={"ID":"af74421d-5940-439e-8223-bbf0d6c03fd2","Type":"ContainerStarted","Data":"0068898e1ad035144f311acf7efabe764f795b94f92c12b7d64963155d899d00"}
Jul 06 19:06:46.933072 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:46.933037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:06:46.933573 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:46.933247    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:46.933573 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:06:46.933328    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:07:18.93330503 +0000 UTC m=+98.684014271 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:51.307986 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:51.307947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hggc" event={"ID":"af74421d-5940-439e-8223-bbf0d6c03fd2","Type":"ContainerStarted","Data":"1cc426f441732431d1f23cecb379fe447217eac9471856331d94cb2b4a44c33b"}
Jul 06 19:06:51.308527 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:51.308030    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:06:51.309355 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:51.309333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9r7wx" event={"ID":"f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7","Type":"ContainerStarted","Data":"a1c69f4be0a2acb8b6a5db2947791d10e96d41ef9aa34f0471120ac9a95a50ea"}
Jul 06 19:06:51.326560 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:51.326516    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7hggc" podStartSLOduration=65.721606818 podStartE2EDuration="1m10.32649846s" totalImagesPullingTime="4.604891642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:51.325797284 +0000 UTC m=+71.076506554" watchObservedRunningTime="2026-07-06 19:06:51.32649846 +0000 UTC m=+71.077207704"
Jul 06 19:06:51.342513 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:06:51.342448    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9r7wx" podStartSLOduration=65.696286724 podStartE2EDuration="1m10.342429455s" totalImagesPullingTime="4.646142731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:51.341973791 +0000 UTC m=+71.092683055" watchObservedRunningTime="2026-07-06 19:06:51.342429455 +0000 UTC m=+71.093138704"
Jul 06 19:07:18.950358 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:07:18.950308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:07:18.950833 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:07:18.950457    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:07:18.950833 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:07:18.950539    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:08:22.950514629 +0000 UTC m=+162.701223854 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:07:22.314088 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:07:22.314053    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7hggc"
Jul 06 19:07:49.549244 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:07:49.549205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:07:49.549640 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:07:49.549315    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:07:49.549640 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:07:49.549378    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs podName:fbf062c3-52d4-44b4-8c93-fd235d3ccc98 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:51.549363648 +0000 UTC m=+251.300072873 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs") pod "network-metrics-daemon-bh48g" (UID: "fbf062c3-52d4-44b4-8c93-fd235d3ccc98") : secret "metrics-daemon-secret" not found
Jul 06 19:08:18.130554 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:08:18.130492    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fh4xd" podUID="0d6b5338-13bf-41f6-89e9-302b27d2abfc"
Jul 06 19:08:19.892226 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:08:19.892182    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bh48g" podUID="fbf062c3-52d4-44b4-8c93-fd235d3ccc98"
Jul 06 19:08:22.975762 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:08:22.975727    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:08:22.976182 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:08:22.975846    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:08:22.976182 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:08:22.975899    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls podName:0d6b5338-13bf-41f6-89e9-302b27d2abfc nodeName:}" failed. No retries permitted until 2026-07-06 19:10:24.975884997 +0000 UTC m=+284.726594222 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls") pod "dns-default-fh4xd" (UID: "0d6b5338-13bf-41f6-89e9-302b27d2abfc") : secret "dns-default-metrics-tls" not found
Jul 06 19:08:31.876844 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:08:31.876732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:08:32.876263 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:08:32.876226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:09:29.465861 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.465814    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"]
Jul 06 19:09:29.468100 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.468080    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66f45d6fc7-4846p"]
Jul 06 19:09:29.468244 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.468197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.472195 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.472171    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 19:09:29.472316 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.472300    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:09:29.472385 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.472302    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 19:09:29.472741 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.472725    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2drw8\""
Jul 06 19:09:29.472982 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.472964    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 19:09:29.473354 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.473338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.475965 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.475940    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-npkq6\""
Jul 06 19:09:29.476476 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.476449    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 19:09:29.476566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.476505    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:09:29.476566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.476528    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 19:09:29.476566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.476536    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:09:29.476744 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.476637    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 19:09:29.476994 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.476980    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 19:09:29.482818 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.482800    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"]
Jul 06 19:09:29.487439 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.487417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66f45d6fc7-4846p"]
Jul 06 19:09:29.558692 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.558657    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"]
Jul 06 19:09:29.560718 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.560695    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jdlx8"]
Jul 06 19:09:29.560837 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.560798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.562514 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.562494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.568679 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.568664    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 19:09:29.568826 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.568812    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 19:09:29.568979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.568967    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 19:09:29.569362 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.569345    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:09:29.569464 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.569383    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tmzqf\""
Jul 06 19:09:29.569464 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.569458    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:09:29.569902 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.569861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 19:09:29.569902 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.569865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 19:09:29.570290 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.570275    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-snggv\""
Jul 06 19:09:29.570609 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.570588    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 19:09:29.576734 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.576713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"]
Jul 06 19:09:29.577377 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.577357    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 19:09:29.577457 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.577447    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jdlx8"]
Jul 06 19:09:29.618734 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8156a742-e1e0-4acb-96d9-2913f7a08b5e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.618839 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-default-certificate\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.618839 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxp7d\" (UniqueName: \"kubernetes.io/projected/8156a742-e1e0-4acb-96d9-2913f7a08b5e-kube-api-access-jxp7d\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.618839 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.618939 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ggvp\" (UniqueName: \"kubernetes.io/projected/3df4cb41-be07-4684-afc6-c906b0a1c917-kube-api-access-9ggvp\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.618939 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8156a742-e1e0-4acb-96d9-2913f7a08b5e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.618939 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-stats-auth\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.618939 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.618935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.720342 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ggvp\" (UniqueName: \"kubernetes.io/projected/3df4cb41-be07-4684-afc6-c906b0a1c917-kube-api-access-9ggvp\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.720342 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8156a742-e1e0-4acb-96d9-2913f7a08b5e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.720342 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-stats-auth\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.720342 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7e7199-e91e-41ff-976d-86a7c55b2358-config\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.720665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqs6\" (UniqueName: \"kubernetes.io/projected/ff7e7199-e91e-41ff-976d-86a7c55b2358-kube-api-access-wzqs6\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.720665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.720665 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:29.720524    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:30.220499154 +0000 UTC m=+229.971208379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : configmap references non-existent config key: service-ca.crt
Jul 06 19:09:29.720665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8156a742-e1e0-4acb-96d9-2913f7a08b5e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.720665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7e7199-e91e-41ff-976d-86a7c55b2358-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.720909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67b47669-a105-4779-879f-997de9f6dfe1-config\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.720909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-default-certificate\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.720909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b47669-a105-4779-879f-997de9f6dfe1-trusted-ca\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.720909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx4hv\" (UniqueName: \"kubernetes.io/projected/67b47669-a105-4779-879f-997de9f6dfe1-kube-api-access-zx4hv\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.720909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxp7d\" (UniqueName: \"kubernetes.io/projected/8156a742-e1e0-4acb-96d9-2913f7a08b5e-kube-api-access-jxp7d\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.720909 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.721180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67b47669-a105-4779-879f-997de9f6dfe1-serving-cert\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.721180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.720938    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8156a742-e1e0-4acb-96d9-2913f7a08b5e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.721180 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:29.721037    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:09:29.721180 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:29.721096    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:30.221079502 +0000 UTC m=+229.971788729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : secret "router-metrics-certs-default" not found
Jul 06 19:09:29.722844 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.722815    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8156a742-e1e0-4acb-96d9-2913f7a08b5e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.722991 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.722972    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-stats-auth\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.723135 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.723096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-default-certificate\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.730900 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.730870    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxp7d\" (UniqueName: \"kubernetes.io/projected/8156a742-e1e0-4acb-96d9-2913f7a08b5e-kube-api-access-jxp7d\") pod \"kube-storage-version-migrator-operator-846bf668f7-qh2fm\" (UID: \"8156a742-e1e0-4acb-96d9-2913f7a08b5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.731182 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.731165    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ggvp\" (UniqueName: \"kubernetes.io/projected/3df4cb41-be07-4684-afc6-c906b0a1c917-kube-api-access-9ggvp\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:29.780997 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.780972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"
Jul 06 19:09:29.821278 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7e7199-e91e-41ff-976d-86a7c55b2358-config\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.821278 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqs6\" (UniqueName: \"kubernetes.io/projected/ff7e7199-e91e-41ff-976d-86a7c55b2358-kube-api-access-wzqs6\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.821489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7e7199-e91e-41ff-976d-86a7c55b2358-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.821489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67b47669-a105-4779-879f-997de9f6dfe1-config\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.821489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b47669-a105-4779-879f-997de9f6dfe1-trusted-ca\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.821489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx4hv\" (UniqueName: \"kubernetes.io/projected/67b47669-a105-4779-879f-997de9f6dfe1-kube-api-access-zx4hv\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.821489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67b47669-a105-4779-879f-997de9f6dfe1-serving-cert\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.821783 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.821757    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7e7199-e91e-41ff-976d-86a7c55b2358-config\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.822339 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.822312    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67b47669-a105-4779-879f-997de9f6dfe1-config\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.822647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.822621    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67b47669-a105-4779-879f-997de9f6dfe1-trusted-ca\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.823869 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.823842    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67b47669-a105-4779-879f-997de9f6dfe1-serving-cert\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.824050 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.824026    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7e7199-e91e-41ff-976d-86a7c55b2358-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.831597 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.831564    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx4hv\" (UniqueName: \"kubernetes.io/projected/67b47669-a105-4779-879f-997de9f6dfe1-kube-api-access-zx4hv\") pod \"console-operator-68b757fb67-jdlx8\" (UID: \"67b47669-a105-4779-879f-997de9f6dfe1\") " pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.831702 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.831601    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqs6\" (UniqueName: \"kubernetes.io/projected/ff7e7199-e91e-41ff-976d-86a7c55b2358-kube-api-access-wzqs6\") pod \"service-ca-operator-5d46d9ffd4-p4jj4\" (UID: \"ff7e7199-e91e-41ff-976d-86a7c55b2358\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.870242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.870214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"
Jul 06 19:09:29.877189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.877166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:29.905062 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:29.904943    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm"]
Jul 06 19:09:29.908426 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:09:29.908397    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8156a742_e1e0_4acb_96d9_2913f7a08b5e.slice/crio-1a9b43d048a2fc0f396af3d9cb087e22bde36855d843fc66fbf94216f47e331d WatchSource:0}: Error finding container 1a9b43d048a2fc0f396af3d9cb087e22bde36855d843fc66fbf94216f47e331d: Status 404 returned error can't find the container with id 1a9b43d048a2fc0f396af3d9cb087e22bde36855d843fc66fbf94216f47e331d
Jul 06 19:09:30.004626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.004595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4"]
Jul 06 19:09:30.007529 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:09:30.007488    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7e7199_e91e_41ff_976d_86a7c55b2358.slice/crio-4692dd3bea40a29fa7fef1a87e16ed519c4dae0e5f5568300d043f5565163baf WatchSource:0}: Error finding container 4692dd3bea40a29fa7fef1a87e16ed519c4dae0e5f5568300d043f5565163baf: Status 404 returned error can't find the container with id 4692dd3bea40a29fa7fef1a87e16ed519c4dae0e5f5568300d043f5565163baf
Jul 06 19:09:30.020175 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.020153    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jdlx8"]
Jul 06 19:09:30.022560 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:09:30.022527    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b47669_a105_4779_879f_997de9f6dfe1.slice/crio-890ccf9edc45731d9e08695fd5dda12d2f63acae94b643cd6a5acedaa46783fc WatchSource:0}: Error finding container 890ccf9edc45731d9e08695fd5dda12d2f63acae94b643cd6a5acedaa46783fc: Status 404 returned error can't find the container with id 890ccf9edc45731d9e08695fd5dda12d2f63acae94b643cd6a5acedaa46783fc
Jul 06 19:09:30.225261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.225226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:30.225405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.225278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:30.225405 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:30.225376    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:09:30.225471 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:30.225430    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:31.225413672 +0000 UTC m=+230.976122915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : configmap references non-existent config key: service-ca.crt
Jul 06 19:09:30.225471 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:30.225446    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:31.225439624 +0000 UTC m=+230.976148850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : secret "router-metrics-certs-default" not found
Jul 06 19:09:30.672972 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.672648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm" event={"ID":"8156a742-e1e0-4acb-96d9-2913f7a08b5e","Type":"ContainerStarted","Data":"1a9b43d048a2fc0f396af3d9cb087e22bde36855d843fc66fbf94216f47e331d"}
Jul 06 19:09:30.674328 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.674161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" event={"ID":"67b47669-a105-4779-879f-997de9f6dfe1","Type":"ContainerStarted","Data":"890ccf9edc45731d9e08695fd5dda12d2f63acae94b643cd6a5acedaa46783fc"}
Jul 06 19:09:30.675657 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:30.675624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4" event={"ID":"ff7e7199-e91e-41ff-976d-86a7c55b2358","Type":"ContainerStarted","Data":"4692dd3bea40a29fa7fef1a87e16ed519c4dae0e5f5568300d043f5565163baf"}
Jul 06 19:09:31.231528 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:31.231492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:31.231708 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:31.231546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:31.231708 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:31.231646    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:09:31.231838 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:31.231713    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.231699415 +0000 UTC m=+232.982408641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : configmap references non-existent config key: service-ca.crt
Jul 06 19:09:31.231838 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:31.231730    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.231723953 +0000 UTC m=+232.982433178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : secret "router-metrics-certs-default" not found
Jul 06 19:09:32.683045 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:32.682961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm" event={"ID":"8156a742-e1e0-4acb-96d9-2913f7a08b5e","Type":"ContainerStarted","Data":"ab96d61a049e33c5253c5a0311275494d2949e6d33f83a232c716b8a2a0ce137"}
Jul 06 19:09:32.702658 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:32.702600    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm" podStartSLOduration=1.1804154 podStartE2EDuration="3.702581227s" totalImagesPullingTime="2.522165827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:32.701658624 +0000 UTC m=+232.452367896" watchObservedRunningTime="2026-07-06 19:09:32.702581227 +0000 UTC m=+232.453290476"
Jul 06 19:09:33.041533 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.041494    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m5qmb"]
Jul 06 19:09:33.044502 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.044478    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.045999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.045968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c2ef21-a971-4580-8e25-f231cab3f2f1-crio-socket\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.046125 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.046087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.046262 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.046244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c2ef21-a971-4580-8e25-f231cab3f2f1-data-volume\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.046320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.046274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.046320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.046298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66smw\" (UniqueName: \"kubernetes.io/projected/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-api-access-66smw\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.047705 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.047671    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:09:33.048227 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.048206    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxdw6\""
Jul 06 19:09:33.048793 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.048765    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:09:33.048793 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.048784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:09:33.056455 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.056424    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:09:33.067744 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.067719    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5qmb"]
Jul 06 19:09:33.146683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.146646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.146860 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.146740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c2ef21-a971-4580-8e25-f231cab3f2f1-data-volume\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.146860 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.146766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.146860 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.146792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66smw\" (UniqueName: \"kubernetes.io/projected/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-api-access-66smw\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.146860 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.146824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c2ef21-a971-4580-8e25-f231cab3f2f1-crio-socket\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.146860 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.146844    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:33.146860 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.146851    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.147193 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.146914    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.646894661 +0000 UTC m=+233.397603907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:33.147193 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.146931    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.646922543 +0000 UTC m=+233.397631768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.147193 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.146943    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c2ef21-a971-4580-8e25-f231cab3f2f1-crio-socket\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.147193 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.147049    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c2ef21-a971-4580-8e25-f231cab3f2f1-data-volume\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.159968 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.159940    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66smw\" (UniqueName: \"kubernetes.io/projected/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-api-access-66smw\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.247250 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.247216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:33.247429 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.247295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:33.247429 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.247357    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:09:33.247429 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.247424    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:37.247405405 +0000 UTC m=+236.998114632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : secret "router-metrics-certs-default" not found
Jul 06 19:09:33.247582 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.247492    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:37.247471366 +0000 UTC m=+236.998180593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : configmap references non-existent config key: service-ca.crt
Jul 06 19:09:33.649815 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.649781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.649973 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:33.649853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:33.649973 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.649923    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:33.649973 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.649937    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.650078 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.649989    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:34.649974897 +0000 UTC m=+234.400684122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.650078 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:33.650009    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:34.650003229 +0000 UTC m=+234.400712454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:34.658393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.658345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:34.658854 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.658436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:34.658854 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:34.658516    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:34.658854 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:34.658521    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:34.658854 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:34.658574    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.658558947 +0000 UTC m=+236.409268189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:34.658854 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:34.658597    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.658580024 +0000 UTC m=+236.409289252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:34.689444 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.689411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4" event={"ID":"ff7e7199-e91e-41ff-976d-86a7c55b2358","Type":"ContainerStarted","Data":"81c0362bf65b0dfd4ee7fc805a34313a5c98af51b00d55138c90405238f08ea6"}
Jul 06 19:09:34.690976 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.690955    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/0.log"
Jul 06 19:09:34.691072 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.690996    2561 generic.go:356] "Generic (PLEG): container finished" podID="67b47669-a105-4779-879f-997de9f6dfe1" containerID="fd9e6eb584054371d7131055cec4e63cdd5d5589a2b085fef5e1427860e17f9c" exitCode=255
Jul 06 19:09:34.691072 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.691027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" event={"ID":"67b47669-a105-4779-879f-997de9f6dfe1","Type":"ContainerDied","Data":"fd9e6eb584054371d7131055cec4e63cdd5d5589a2b085fef5e1427860e17f9c"}
Jul 06 19:09:34.691271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.691257    2561 scope.go:117] "RemoveContainer" containerID="fd9e6eb584054371d7131055cec4e63cdd5d5589a2b085fef5e1427860e17f9c"
Jul 06 19:09:34.711805 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.708391    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4" podStartSLOduration=2.045473788 podStartE2EDuration="5.70837032s" totalImagesPullingTime="3.662896532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:34.706450749 +0000 UTC m=+234.457160009" watchObservedRunningTime="2026-07-06 19:09:34.70837032 +0000 UTC m=+234.459079570"
Jul 06 19:09:34.793103 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:34.793074    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dkqg4_1de5e4a6-395d-47a9-8f97-e3df63ec715e/dns-node-resolver/0.log"
Jul 06 19:09:35.695693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:35.695667    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/1.log"
Jul 06 19:09:35.696060 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:35.696045    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/0.log"
Jul 06 19:09:35.696101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:35.696077    2561 generic.go:356] "Generic (PLEG): container finished" podID="67b47669-a105-4779-879f-997de9f6dfe1" containerID="5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10" exitCode=255
Jul 06 19:09:35.696212 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:35.696175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" event={"ID":"67b47669-a105-4779-879f-997de9f6dfe1","Type":"ContainerDied","Data":"5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10"}
Jul 06 19:09:35.696290 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:35.696275    2561 scope.go:117] "RemoveContainer" containerID="fd9e6eb584054371d7131055cec4e63cdd5d5589a2b085fef5e1427860e17f9c"
Jul 06 19:09:35.696406 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:35.696393    2561 scope.go:117] "RemoveContainer" containerID="5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10"
Jul 06 19:09:35.696611 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:35.696577    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jdlx8_openshift-console-operator(67b47669-a105-4779-879f-997de9f6dfe1)\"" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" podUID="67b47669-a105-4779-879f-997de9f6dfe1"
Jul 06 19:09:36.192538 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.192510    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n9fn_6dadbfed-32a7-4d11-90f7-8c26da9d38f4/node-ca/0.log"
Jul 06 19:09:36.673296 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.673239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:36.673475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.673339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:36.673475 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:36.673387    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:36.673475 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:36.673418    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:36.673475 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:36.673462    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:40.673447995 +0000 UTC m=+240.424157221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:36.673475 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:36.673474    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:40.673468474 +0000 UTC m=+240.424177700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:36.700522 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.700495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/1.log"
Jul 06 19:09:36.700853 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.700786    2561 scope.go:117] "RemoveContainer" containerID="5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10"
Jul 06 19:09:36.700932 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:36.700913    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jdlx8_openshift-console-operator(67b47669-a105-4779-879f-997de9f6dfe1)\"" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" podUID="67b47669-a105-4779-879f-997de9f6dfe1"
Jul 06 19:09:36.830348 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.830311    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-d6qmz"]
Jul 06 19:09:36.833242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.833221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.836614 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.836594    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 19:09:36.836729 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.836700    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 19:09:36.836805 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.836791    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 19:09:36.836926 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.836907    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7hxw6\""
Jul 06 19:09:36.837214 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.837199    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 19:09:36.845546 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.845526    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-d6qmz"]
Jul 06 19:09:36.875320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.875295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b47f342-32f6-4561-828d-2424130ed830-signing-key\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.875414 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.875343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvh5q\" (UniqueName: \"kubernetes.io/projected/9b47f342-32f6-4561-828d-2424130ed830-kube-api-access-mvh5q\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.875464 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.875451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b47f342-32f6-4561-828d-2424130ed830-signing-cabundle\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.975910 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.975883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b47f342-32f6-4561-828d-2424130ed830-signing-key\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.976051 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.975934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvh5q\" (UniqueName: \"kubernetes.io/projected/9b47f342-32f6-4561-828d-2424130ed830-kube-api-access-mvh5q\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.976178 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.976158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b47f342-32f6-4561-828d-2424130ed830-signing-cabundle\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.976668 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.976649    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b47f342-32f6-4561-828d-2424130ed830-signing-cabundle\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.978470 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.978452    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b47f342-32f6-4561-828d-2424130ed830-signing-key\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.986249 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.986228    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvh5q\" (UniqueName: \"kubernetes.io/projected/9b47f342-32f6-4561-828d-2424130ed830-kube-api-access-mvh5q\") pod \"service-ca-758f599c5-d6qmz\" (UID: \"9b47f342-32f6-4561-828d-2424130ed830\") " pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:36.993031 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:36.993015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z2g8d_887c074b-d3e3-42fe-9a5b-ddee82884a6a/serve-healthcheck-canary/0.log"
Jul 06 19:09:37.141852 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.141819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-d6qmz"
Jul 06 19:09:37.269716 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.269651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-d6qmz"]
Jul 06 19:09:37.272640 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:09:37.272612    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b47f342_32f6_4561_828d_2424130ed830.slice/crio-19b2131c7474cf6ced8bbf50cc6089c0305db9c536026be78b4a9dbd6c7591df WatchSource:0}: Error finding container 19b2131c7474cf6ced8bbf50cc6089c0305db9c536026be78b4a9dbd6c7591df: Status 404 returned error can't find the container with id 19b2131c7474cf6ced8bbf50cc6089c0305db9c536026be78b4a9dbd6c7591df
Jul 06 19:09:37.278914 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.278892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:37.278993 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.278933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:37.279073 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:37.279030    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:09:37.279125 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:37.279072    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.27905788 +0000 UTC m=+245.029767105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : configmap references non-existent config key: service-ca.crt
Jul 06 19:09:37.279125 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:37.279088    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.279081907 +0000 UTC m=+245.029791132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : secret "router-metrics-certs-default" not found
Jul 06 19:09:37.705397 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.705307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-d6qmz" event={"ID":"9b47f342-32f6-4561-828d-2424130ed830","Type":"ContainerStarted","Data":"9138cded5971b8df172042a1b9869f8fee600b0b23af085baaf1211557a11a14"}
Jul 06 19:09:37.705397 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.705360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-d6qmz" event={"ID":"9b47f342-32f6-4561-828d-2424130ed830","Type":"ContainerStarted","Data":"19b2131c7474cf6ced8bbf50cc6089c0305db9c536026be78b4a9dbd6c7591df"}
Jul 06 19:09:37.725873 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:37.725824    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-d6qmz" podStartSLOduration=1.725809646 podStartE2EDuration="1.725809646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:37.725311199 +0000 UTC m=+237.476020457" watchObservedRunningTime="2026-07-06 19:09:37.725809646 +0000 UTC m=+237.476518893"
Jul 06 19:09:39.878312 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:39.878219    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:39.878312 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:39.878303    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:39.878727 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:39.878714    2561 scope.go:117] "RemoveContainer" containerID="5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10"
Jul 06 19:09:39.878924 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:39.878899    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jdlx8_openshift-console-operator(67b47669-a105-4779-879f-997de9f6dfe1)\"" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" podUID="67b47669-a105-4779-879f-997de9f6dfe1"
Jul 06 19:09:40.706985 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:40.706953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:40.707183 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:40.707007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:40.707183 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:40.707087    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:40.707183 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:40.707104    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:40.707183 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:40.707169    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:48.707150383 +0000 UTC m=+248.457859631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:40.707366 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:40.707190    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:48.707179569 +0000 UTC m=+248.457888795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:45.344456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:45.344412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:45.344859 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:45.344470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:45.344859 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:45.344659    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle podName:3df4cb41-be07-4684-afc6-c906b0a1c917 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:01.344639373 +0000 UTC m=+261.095348598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle") pod "router-default-66f45d6fc7-4846p" (UID: "3df4cb41-be07-4684-afc6-c906b0a1c917") : configmap references non-existent config key: service-ca.crt
Jul 06 19:09:45.346946 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:45.346914    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3df4cb41-be07-4684-afc6-c906b0a1c917-metrics-certs\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:09:48.776208 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:48.776169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:48.776630 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:48.776236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:48.776630 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:48.776432    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:48.776630 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:48.776519    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls podName:81c2ef21-a971-4580-8e25-f231cab3f2f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:04.776496214 +0000 UTC m=+264.527205439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5qmb" (UID: "81c2ef21-a971-4580-8e25-f231cab3f2f1") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:48.776860 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:48.776706    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c2ef21-a971-4580-8e25-f231cab3f2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:09:51.601618 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:51.601571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:09:51.603983 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:51.603963    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbf062c3-52d4-44b4-8c93-fd235d3ccc98-metrics-certs\") pod \"network-metrics-daemon-bh48g\" (UID: \"fbf062c3-52d4-44b4-8c93-fd235d3ccc98\") " pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:09:51.781058 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:51.781032    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\""
Jul 06 19:09:51.787959 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:51.787940    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bh48g"
Jul 06 19:09:51.876974 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:51.876948    2561 scope.go:117] "RemoveContainer" containerID="5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10"
Jul 06 19:09:51.924637 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:51.924612    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bh48g"]
Jul 06 19:09:51.927775 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:09:51.927747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf062c3_52d4_44b4_8c93_fd235d3ccc98.slice/crio-6ab9851acb06e2eb0950cc5dfc1ff7735b2a2def45af97ce542acafac8689b79 WatchSource:0}: Error finding container 6ab9851acb06e2eb0950cc5dfc1ff7735b2a2def45af97ce542acafac8689b79: Status 404 returned error can't find the container with id 6ab9851acb06e2eb0950cc5dfc1ff7735b2a2def45af97ce542acafac8689b79
Jul 06 19:09:52.752309 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.752285    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:09:52.752748 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.752732    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/1.log"
Jul 06 19:09:52.752812 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.752774    2561 generic.go:356] "Generic (PLEG): container finished" podID="67b47669-a105-4779-879f-997de9f6dfe1" containerID="03a296e3bbea1abad063cf53a2c444f1bbb7b8c78d1352a9584540611bfcf398" exitCode=255
Jul 06 19:09:52.752858 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.752821    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" event={"ID":"67b47669-a105-4779-879f-997de9f6dfe1","Type":"ContainerDied","Data":"03a296e3bbea1abad063cf53a2c444f1bbb7b8c78d1352a9584540611bfcf398"}
Jul 06 19:09:52.752927 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.752904    2561 scope.go:117] "RemoveContainer" containerID="5a2f66e475206558b6d70b3ff9d7bee76d0cdf173c524a84edb6b524ec498c10"
Jul 06 19:09:52.754139 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.754098    2561 scope.go:117] "RemoveContainer" containerID="03a296e3bbea1abad063cf53a2c444f1bbb7b8c78d1352a9584540611bfcf398"
Jul 06 19:09:52.754347 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:52.754319    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-jdlx8_openshift-console-operator(67b47669-a105-4779-879f-997de9f6dfe1)\"" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" podUID="67b47669-a105-4779-879f-997de9f6dfe1"
Jul 06 19:09:52.754686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:52.754657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bh48g" event={"ID":"fbf062c3-52d4-44b4-8c93-fd235d3ccc98","Type":"ContainerStarted","Data":"6ab9851acb06e2eb0950cc5dfc1ff7735b2a2def45af97ce542acafac8689b79"}
Jul 06 19:09:53.758767 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:53.758727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bh48g" event={"ID":"fbf062c3-52d4-44b4-8c93-fd235d3ccc98","Type":"ContainerStarted","Data":"b93e9540659e16c4e1ac4e92e72252312f4719553d70efe125ba30fa37fc87ef"}
Jul 06 19:09:53.759253 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:53.758808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bh48g" event={"ID":"fbf062c3-52d4-44b4-8c93-fd235d3ccc98","Type":"ContainerStarted","Data":"b2801e01f16d519d9b33691f35eecce34066179e87294e05dc2b725caf0bdb06"}
Jul 06 19:09:53.760125 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:53.760089    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:09:53.779552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:53.779506    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bh48g" podStartSLOduration=251.972117985 podStartE2EDuration="4m12.779466977s" totalImagesPullingTime="807.348992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:53.778141211 +0000 UTC m=+253.528850470" watchObservedRunningTime="2026-07-06 19:09:53.779466977 +0000 UTC m=+253.530176223"
Jul 06 19:09:59.877402 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:59.877367    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:59.877402 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:59.877411    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:09:59.877823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:09:59.877609    2561 scope.go:117] "RemoveContainer" containerID="03a296e3bbea1abad063cf53a2c444f1bbb7b8c78d1352a9584540611bfcf398"
Jul 06 19:09:59.877823 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:09:59.877717    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-jdlx8_openshift-console-operator(67b47669-a105-4779-879f-997de9f6dfe1)\"" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" podUID="67b47669-a105-4779-879f-997de9f6dfe1"
Jul 06 19:10:00.704692 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.704616    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-754c49c7d6-vrvp9"]
Jul 06 19:10:00.706645 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.706618    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.709522 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.709500    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55x6z\""
Jul 06 19:10:00.709840 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.709823    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:10:00.709892 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.709859    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:10:00.711085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.711068    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:10:00.721044 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.721017    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:10:00.742768 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.742738    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-754c49c7d6-vrvp9"]
Jul 06 19:10:00.767159 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-image-registry-private-configuration\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt8fp\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-kube-api-access-rt8fp\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-trusted-ca\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-installation-pull-secrets\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767241    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-ca-trust-extracted\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767262    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-registry-certificates\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767438 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-bound-sa-token\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.767438 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.767346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-registry-tls\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868624 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-image-registry-private-configuration\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868636    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8fp\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-kube-api-access-rt8fp\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-trusted-ca\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-installation-pull-secrets\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-ca-trust-extracted\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-registry-certificates\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.868822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-bound-sa-token\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.869104 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.868829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-registry-tls\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.869329 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.869300    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-ca-trust-extracted\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.869732 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.869708    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-registry-certificates\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.869969 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.869950    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-trusted-ca\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.871287 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.871261    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-installation-pull-secrets\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.871726 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.871708    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-registry-tls\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.871808 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.871767    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-image-registry-private-configuration\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.879477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.879456    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt8fp\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-kube-api-access-rt8fp\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:00.879750 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:00.879463    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4a2c9fe-5258-47bc-9f32-a8e314bf93d5-bound-sa-token\") pod \"image-registry-754c49c7d6-vrvp9\" (UID: \"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5\") " pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:01.016252 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.016224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:01.143445 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.143329    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-754c49c7d6-vrvp9"]
Jul 06 19:10:01.145817 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:01.145791    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a2c9fe_5258_47bc_9f32_a8e314bf93d5.slice/crio-59794812890eafaa2a1d7a3e2139e569ac10caba943136f8bc91b680328fd916 WatchSource:0}: Error finding container 59794812890eafaa2a1d7a3e2139e569ac10caba943136f8bc91b680328fd916: Status 404 returned error can't find the container with id 59794812890eafaa2a1d7a3e2139e569ac10caba943136f8bc91b680328fd916
Jul 06 19:10:01.373554 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.373470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:01.374174 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.374151    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df4cb41-be07-4684-afc6-c906b0a1c917-service-ca-bundle\") pod \"router-default-66f45d6fc7-4846p\" (UID: \"3df4cb41-be07-4684-afc6-c906b0a1c917\") " pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:01.589618 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.589591    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-npkq6\""
Jul 06 19:10:01.597579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.597560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:01.727237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.727080    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66f45d6fc7-4846p"]
Jul 06 19:10:01.729019 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:01.728992    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df4cb41_be07_4684_afc6_c906b0a1c917.slice/crio-c033e59ad5de69390c5a2656d8c170ebe35d53ba50e569cd08096fdd99e8ff7f WatchSource:0}: Error finding container c033e59ad5de69390c5a2656d8c170ebe35d53ba50e569cd08096fdd99e8ff7f: Status 404 returned error can't find the container with id c033e59ad5de69390c5a2656d8c170ebe35d53ba50e569cd08096fdd99e8ff7f
Jul 06 19:10:01.786818 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.786784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66f45d6fc7-4846p" event={"ID":"3df4cb41-be07-4684-afc6-c906b0a1c917","Type":"ContainerStarted","Data":"21953e82872854d7a0f4d9d61f653de932c33cdb05899105758d5bbf22edae88"}
Jul 06 19:10:01.786964 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.786849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66f45d6fc7-4846p" event={"ID":"3df4cb41-be07-4684-afc6-c906b0a1c917","Type":"ContainerStarted","Data":"c033e59ad5de69390c5a2656d8c170ebe35d53ba50e569cd08096fdd99e8ff7f"}
Jul 06 19:10:01.788487 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.788463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9" event={"ID":"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5","Type":"ContainerStarted","Data":"68e40dee2a77c15d9015d0a0e8f48dd3ef1159bb0082f7d3c309cbde1e3a7211"}
Jul 06 19:10:01.788599 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.788510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9" event={"ID":"f4a2c9fe-5258-47bc-9f32-a8e314bf93d5","Type":"ContainerStarted","Data":"59794812890eafaa2a1d7a3e2139e569ac10caba943136f8bc91b680328fd916"}
Jul 06 19:10:01.788599 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.788533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:01.815702 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.815504    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66f45d6fc7-4846p" podStartSLOduration=32.81548741 podStartE2EDuration="32.81548741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:01.815295956 +0000 UTC m=+261.566005224" watchObservedRunningTime="2026-07-06 19:10:01.81548741 +0000 UTC m=+261.566196659"
Jul 06 19:10:01.842391 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:01.842340    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9" podStartSLOduration=1.8423205839999999 podStartE2EDuration="1.842320584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:01.840822349 +0000 UTC m=+261.591531596" watchObservedRunningTime="2026-07-06 19:10:01.842320584 +0000 UTC m=+261.593029831"
Jul 06 19:10:02.598544 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:02.598501    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:02.601133 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:02.601090    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:02.792852 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:02.792821    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:02.793901 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:02.793879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66f45d6fc7-4846p"
Jul 06 19:10:04.800232 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:04.800199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:10:04.802584 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:04.802566    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c2ef21-a971-4580-8e25-f231cab3f2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5qmb\" (UID: \"81c2ef21-a971-4580-8e25-f231cab3f2f1\") " pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:10:04.859168 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:04.859141    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxdw6\""
Jul 06 19:10:04.867180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:04.867160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5qmb"
Jul 06 19:10:05.002890 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:05.002857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5qmb"]
Jul 06 19:10:05.005520 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:05.005490    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c2ef21_a971_4580_8e25_f231cab3f2f1.slice/crio-66a8427d1305898dabd24515a33cac5dc32ded8b15b868fc6e34b9ab4fc02e18 WatchSource:0}: Error finding container 66a8427d1305898dabd24515a33cac5dc32ded8b15b868fc6e34b9ab4fc02e18: Status 404 returned error can't find the container with id 66a8427d1305898dabd24515a33cac5dc32ded8b15b868fc6e34b9ab4fc02e18
Jul 06 19:10:05.806806 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:05.806768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5qmb" event={"ID":"81c2ef21-a971-4580-8e25-f231cab3f2f1","Type":"ContainerStarted","Data":"66a8427d1305898dabd24515a33cac5dc32ded8b15b868fc6e34b9ab4fc02e18"}
Jul 06 19:10:08.248937 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.248903    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"]
Jul 06 19:10:08.258940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.258913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.261683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.261661    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 19:10:08.262850 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.262828    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 19:10:08.263082 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.263001    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n6kdw\""
Jul 06 19:10:08.264260 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.264240    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:10:08.264983 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.264929    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:10:08.265064 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.265024    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:10:08.269013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.268874    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"]
Jul 06 19:10:08.333002 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.332970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88fc981-49e4-43ea-9518-215fd3e6eab1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.333187 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.333017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b88fc981-49e4-43ea-9518-215fd3e6eab1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.333187 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.333050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b88fc981-49e4-43ea-9518-215fd3e6eab1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.333187 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.333171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n624s\" (UniqueName: \"kubernetes.io/projected/b88fc981-49e4-43ea-9518-215fd3e6eab1-kube-api-access-n624s\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.434232 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.434196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88fc981-49e4-43ea-9518-215fd3e6eab1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.434420 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.434251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b88fc981-49e4-43ea-9518-215fd3e6eab1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.434420 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.434280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b88fc981-49e4-43ea-9518-215fd3e6eab1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.434420 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.434353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n624s\" (UniqueName: \"kubernetes.io/projected/b88fc981-49e4-43ea-9518-215fd3e6eab1-kube-api-access-n624s\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.434993 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.434958    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88fc981-49e4-43ea-9518-215fd3e6eab1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.437140 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.437090    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b88fc981-49e4-43ea-9518-215fd3e6eab1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.437264 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.437164    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b88fc981-49e4-43ea-9518-215fd3e6eab1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.446304 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.446279    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n624s\" (UniqueName: \"kubernetes.io/projected/b88fc981-49e4-43ea-9518-215fd3e6eab1-kube-api-access-n624s\") pod \"prometheus-operator-567f7b8b7c-6k2xz\" (UID: \"b88fc981-49e4-43ea-9518-215fd3e6eab1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.572096 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.572016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"
Jul 06 19:10:08.804235 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.804206    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz"]
Jul 06 19:10:08.807278 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:08.807252    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88fc981_49e4_43ea_9518_215fd3e6eab1.slice/crio-b436ffc9db1edb9dcc3d906b100f9f17fca1f3caff23d4d6b250e7a43c7d0214 WatchSource:0}: Error finding container b436ffc9db1edb9dcc3d906b100f9f17fca1f3caff23d4d6b250e7a43c7d0214: Status 404 returned error can't find the container with id b436ffc9db1edb9dcc3d906b100f9f17fca1f3caff23d4d6b250e7a43c7d0214
Jul 06 19:10:08.818413 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.818376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5qmb" event={"ID":"81c2ef21-a971-4580-8e25-f231cab3f2f1","Type":"ContainerStarted","Data":"558f196bbd3aee5b9855ecde1ef55aa5c06677faf4aacd45aaf7b132410f6dbd"}
Jul 06 19:10:08.819574 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:08.819547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz" event={"ID":"b88fc981-49e4-43ea-9518-215fd3e6eab1","Type":"ContainerStarted","Data":"b436ffc9db1edb9dcc3d906b100f9f17fca1f3caff23d4d6b250e7a43c7d0214"}
Jul 06 19:10:09.826585 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:09.826508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5qmb" event={"ID":"81c2ef21-a971-4580-8e25-f231cab3f2f1","Type":"ContainerStarted","Data":"78ff092efcf2ce7d2c3b98be1fdeacf4e7234300f73521e98b405f2bc6dba161"}
Jul 06 19:10:10.831552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:10.831511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz" event={"ID":"b88fc981-49e4-43ea-9518-215fd3e6eab1","Type":"ContainerStarted","Data":"4e9168759321fdd88cb2631cb605b43ddb9bc590f95dca1362637c5a22c249ee"}
Jul 06 19:10:10.831955 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:10.831566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz" event={"ID":"b88fc981-49e4-43ea-9518-215fd3e6eab1","Type":"ContainerStarted","Data":"0fcbecc9825cb261727345768d1f9ae24b507eae390fd416732bce1860784c7a"}
Jul 06 19:10:10.863836 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:10.863768    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6k2xz" podStartSLOduration=1.358722693 podStartE2EDuration="2.863747726s" totalImagesPullingTime="1.505025033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:10.863435683 +0000 UTC m=+270.614144956" watchObservedRunningTime="2026-07-06 19:10:10.863747726 +0000 UTC m=+270.614456974"
Jul 06 19:10:12.739884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.739849    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"]
Jul 06 19:10:12.743734 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.743715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.746653 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.746625    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h6rnb\""
Jul 06 19:10:12.746783 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.746630    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 19:10:12.747583 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.747560    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:10:12.747692 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.747600    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 19:10:12.756230 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.756209    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-scdhv"]
Jul 06 19:10:12.759880 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.759861    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"]
Jul 06 19:10:12.760010 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.759993    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.762383 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.762365    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:10:12.762532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.762513    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vp86h\""
Jul 06 19:10:12.763073 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.763055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:10:12.763589 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.763572    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:10:12.840887 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.840844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5qmb" event={"ID":"81c2ef21-a971-4580-8e25-f231cab3f2f1","Type":"ContainerStarted","Data":"05e0e4bef9a911a5e7e4fb1f0563e02cf3c41a7c137f095f66699698c2812f84"}
Jul 06 19:10:12.867371 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.867325    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m5qmb" podStartSLOduration=33.127861031 podStartE2EDuration="39.867310895s" totalImagesPullingTime="6.739449864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:12.86629607 +0000 UTC m=+272.617005321" watchObservedRunningTime="2026-07-06 19:10:12.867310895 +0000 UTC m=+272.618020143"
Jul 06 19:10:12.873569 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-root\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873682 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-wtmp\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873682 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lnjn\" (UniqueName: \"kubernetes.io/projected/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-api-access-9lnjn\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.873757 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.873757 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-sys\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873825 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873825 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv8hz\" (UniqueName: \"kubernetes.io/projected/00eed00a-0677-4630-813f-dbc16bf2e3ce-kube-api-access-gv8hz\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873825 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/75584f33-dde1-41dc-a320-5e33cd86f1c4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.873940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-textfile\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.873940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-tls\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.874079 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.873999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00eed00a-0677-4630-813f-dbc16bf2e3ce-metrics-client-ca\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.874079 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.874034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75584f33-dde1-41dc-a320-5e33cd86f1c4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.874204 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.874137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.874204 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.874170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.975030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.974997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-sys\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv8hz\" (UniqueName: \"kubernetes.io/projected/00eed00a-0677-4630-813f-dbc16bf2e3ce-kube-api-access-gv8hz\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/75584f33-dde1-41dc-a320-5e33cd86f1c4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975071    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-sys\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-textfile\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-tls\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00eed00a-0677-4630-813f-dbc16bf2e3ce-metrics-client-ca\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975639 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975551    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-textfile\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975639 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975551    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/75584f33-dde1-41dc-a320-5e33cd86f1c4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.975745 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:12.975643    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 19:10:12.975745 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:12.975698    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-tls podName:00eed00a-0677-4630-813f-dbc16bf2e3ce nodeName:}" failed. No retries permitted until 2026-07-06 19:10:13.475680326 +0000 UTC m=+273.226389554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-tls") pod "node-exporter-scdhv" (UID: "00eed00a-0677-4630-813f-dbc16bf2e3ce") : secret "node-exporter-tls" not found
Jul 06 19:10:12.975867 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975781    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.975867 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75584f33-dde1-41dc-a320-5e33cd86f1c4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.975867 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975831    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00eed00a-0677-4630-813f-dbc16bf2e3ce-metrics-client-ca\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.976035 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.976035 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.976035 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.975993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-root\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.976035 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-wtmp\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.976247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lnjn\" (UniqueName: \"kubernetes.io/projected/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-api-access-9lnjn\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.976247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.976247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976092    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-root\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.976404 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976325    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-wtmp\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.976404 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976347    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75584f33-dde1-41dc-a320-5e33cd86f1c4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.976707 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.976681    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.978389 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.978365    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:12.978513 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.978496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.978644 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.978626    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.987673 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.987643    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lnjn\" (UniqueName: \"kubernetes.io/projected/75584f33-dde1-41dc-a320-5e33cd86f1c4-kube-api-access-9lnjn\") pod \"kube-state-metrics-7c9dbb8b7d-qsfc2\" (UID: \"75584f33-dde1-41dc-a320-5e33cd86f1c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:12.988481 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:12.988459    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv8hz\" (UniqueName: \"kubernetes.io/projected/00eed00a-0677-4630-813f-dbc16bf2e3ce-kube-api-access-gv8hz\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:13.054858 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.054792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"
Jul 06 19:10:13.198393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.198243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2"]
Jul 06 19:10:13.200746 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:13.200718    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75584f33_dde1_41dc_a320_5e33cd86f1c4.slice/crio-112f5cebbb270edda7bcd3a4edb238754dcf8d68d9461a7a1a818295f11967e5 WatchSource:0}: Error finding container 112f5cebbb270edda7bcd3a4edb238754dcf8d68d9461a7a1a818295f11967e5: Status 404 returned error can't find the container with id 112f5cebbb270edda7bcd3a4edb238754dcf8d68d9461a7a1a818295f11967e5
Jul 06 19:10:13.480934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.480904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-tls\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:13.483465 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.483440    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00eed00a-0677-4630-813f-dbc16bf2e3ce-node-exporter-tls\") pod \"node-exporter-scdhv\" (UID: \"00eed00a-0677-4630-813f-dbc16bf2e3ce\") " pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:13.670169 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.669873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scdhv"
Jul 06 19:10:13.682127 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:13.682072    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eed00a_0677_4630_813f_dbc16bf2e3ce.slice/crio-7ca8a7abc80f41099b1300aa402aab045d433723b73049bfbf232e4e28c68375 WatchSource:0}: Error finding container 7ca8a7abc80f41099b1300aa402aab045d433723b73049bfbf232e4e28c68375: Status 404 returned error can't find the container with id 7ca8a7abc80f41099b1300aa402aab045d433723b73049bfbf232e4e28c68375
Jul 06 19:10:13.844999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.844906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2" event={"ID":"75584f33-dde1-41dc-a320-5e33cd86f1c4","Type":"ContainerStarted","Data":"112f5cebbb270edda7bcd3a4edb238754dcf8d68d9461a7a1a818295f11967e5"}
Jul 06 19:10:13.846025 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.846006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scdhv" event={"ID":"00eed00a-0677-4630-813f-dbc16bf2e3ce","Type":"ContainerStarted","Data":"7ca8a7abc80f41099b1300aa402aab045d433723b73049bfbf232e4e28c68375"}
Jul 06 19:10:13.876862 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:13.876841    2561 scope.go:117] "RemoveContainer" containerID="03a296e3bbea1abad063cf53a2c444f1bbb7b8c78d1352a9584540611bfcf398"
Jul 06 19:10:14.857777 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.857748    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:10:14.858261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.857814    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" event={"ID":"67b47669-a105-4779-879f-997de9f6dfe1","Type":"ContainerStarted","Data":"4f24030dd130ecd0c81bce7ead56df987c25b8a4c414218a14f07de94d1b7bf0"}
Jul 06 19:10:14.858261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.858169    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:10:14.863672 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.863647    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8"
Jul 06 19:10:14.882600 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.882574    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-7n5dd"]
Jul 06 19:10:14.885894 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.885869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:14.887612 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.887563    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-jdlx8" podStartSLOduration=42.238433133 podStartE2EDuration="45.887545578s" totalImagesPullingTime="3.649112445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:14.886799081 +0000 UTC m=+274.637508328" watchObservedRunningTime="2026-07-06 19:10:14.887545578 +0000 UTC m=+274.638254826"
Jul 06 19:10:14.888737 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.888644    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:10:14.889640 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.889270    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:10:14.889640 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.889481    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n8srr\""
Jul 06 19:10:14.899479 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.899454    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-7n5dd"]
Jul 06 19:10:14.993709 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:14.993676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvrbc\" (UniqueName: \"kubernetes.io/projected/d4f36103-e992-46f1-af97-90b276ccdc95-kube-api-access-xvrbc\") pod \"downloads-685bfb5f64-7n5dd\" (UID: \"d4f36103-e992-46f1-af97-90b276ccdc95\") " pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:15.095008 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.094981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvrbc\" (UniqueName: \"kubernetes.io/projected/d4f36103-e992-46f1-af97-90b276ccdc95-kube-api-access-xvrbc\") pod \"downloads-685bfb5f64-7n5dd\" (UID: \"d4f36103-e992-46f1-af97-90b276ccdc95\") " pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:15.106300 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.106244    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvrbc\" (UniqueName: \"kubernetes.io/projected/d4f36103-e992-46f1-af97-90b276ccdc95-kube-api-access-xvrbc\") pod \"downloads-685bfb5f64-7n5dd\" (UID: \"d4f36103-e992-46f1-af97-90b276ccdc95\") " pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:15.201471 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.201214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:15.365850 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.365770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-7n5dd"]
Jul 06 19:10:15.373476 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:15.373450    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f36103_e992_46f1_af97_90b276ccdc95.slice/crio-a5ada7fc1aeb4d89e4d7c4c7c98be57bdd799824d0a570a32015d1880425dfde WatchSource:0}: Error finding container a5ada7fc1aeb4d89e4d7c4c7c98be57bdd799824d0a570a32015d1880425dfde: Status 404 returned error can't find the container with id a5ada7fc1aeb4d89e4d7c4c7c98be57bdd799824d0a570a32015d1880425dfde
Jul 06 19:10:15.863768 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.863725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2" event={"ID":"75584f33-dde1-41dc-a320-5e33cd86f1c4","Type":"ContainerStarted","Data":"a4c2c77926cfbbd6304be5b1e3235ce95be4364a3c1f7980cda526b901c24ccc"}
Jul 06 19:10:15.864265 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.863808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2" event={"ID":"75584f33-dde1-41dc-a320-5e33cd86f1c4","Type":"ContainerStarted","Data":"b90ec19697f83977e0ffba361daa70dd5e28a5f88377c9f6688fc6219a7876c4"}
Jul 06 19:10:15.864265 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.863834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2" event={"ID":"75584f33-dde1-41dc-a320-5e33cd86f1c4","Type":"ContainerStarted","Data":"3ea16838dc02aee5b6f7b5533d9ce9ec215617ae0743db4195c859f3fbc179c1"}
Jul 06 19:10:15.865409 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.865380    2561 generic.go:356] "Generic (PLEG): container finished" podID="00eed00a-0677-4630-813f-dbc16bf2e3ce" containerID="4101e2423dbd72fe36ac18ff8ea53adf636bb449e179b49f1d82c5de9958a97a" exitCode=0
Jul 06 19:10:15.865512 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.865476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scdhv" event={"ID":"00eed00a-0677-4630-813f-dbc16bf2e3ce","Type":"ContainerDied","Data":"4101e2423dbd72fe36ac18ff8ea53adf636bb449e179b49f1d82c5de9958a97a"}
Jul 06 19:10:15.866640 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.866616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-7n5dd" event={"ID":"d4f36103-e992-46f1-af97-90b276ccdc95","Type":"ContainerStarted","Data":"a5ada7fc1aeb4d89e4d7c4c7c98be57bdd799824d0a570a32015d1880425dfde"}
Jul 06 19:10:15.894150 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:15.894080    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qsfc2" podStartSLOduration=2.038187618 podStartE2EDuration="3.894060371s" totalImagesPullingTime="1.855872753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:15.893844594 +0000 UTC m=+275.644553855" watchObservedRunningTime="2026-07-06 19:10:15.894060371 +0000 UTC m=+275.644769619"
Jul 06 19:10:16.873405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:16.873355    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scdhv" event={"ID":"00eed00a-0677-4630-813f-dbc16bf2e3ce","Type":"ContainerStarted","Data":"948e6f1f020b53f48d2ec71dd03c30994097895229fc7fabee7c35e1fbe3476e"}
Jul 06 19:10:16.873910 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:16.873431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scdhv" event={"ID":"00eed00a-0677-4630-813f-dbc16bf2e3ce","Type":"ContainerStarted","Data":"ccea736fe2c3d33005cb9f96c4f8a418620a5823731f60f52044f7fa14a30f36"}
Jul 06 19:10:16.907560 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:16.907498    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-scdhv" podStartSLOduration=3.443686479 podStartE2EDuration="4.907474104s" totalImagesPullingTime="1.371947143s" totalInitContainerRuntime="91.840482ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:16.904482939 +0000 UTC m=+276.655192206" watchObservedRunningTime="2026-07-06 19:10:16.907474104 +0000 UTC m=+276.658183352"
Jul 06 19:10:17.512128 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.512082    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"]
Jul 06 19:10:17.515157 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.515141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:17.520066 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:17.520023    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"monitoring-plugin-d5dcff7cf-lphws\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="0c6212a6-9e09-4a6a-8840-13307d3c9b9a" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:17.526625 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:17.526598    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-dockercfg-8fvkp\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8fvkp\"" type="*v1.Secret"
Jul 06 19:10:17.529659 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:17.529629    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-cert\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret"
Jul 06 19:10:17.538495 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.538470    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"]
Jul 06 19:10:17.616470 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.616429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:17.616652 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.616585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjqs\" (UniqueName: \"kubernetes.io/projected/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-kube-api-access-dfjqs\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:17.717981 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.717935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjqs\" (UniqueName: \"kubernetes.io/projected/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-kube-api-access-dfjqs\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:17.718194 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.718000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:17.742956 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:17.742921    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjqs\" (UniqueName: \"kubernetes.io/projected/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-kube-api-access-dfjqs\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:18.718860 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:18.718823    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:10:18.719287 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:10:18.718928    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-monitoring-plugin-cert podName:0c6212a6-9e09-4a6a-8840-13307d3c9b9a nodeName:}" failed. No retries permitted until 2026-07-06 19:10:19.218905613 +0000 UTC m=+278.969614841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-lphws" (UID: "0c6212a6-9e09-4a6a-8840-13307d3c9b9a") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:10:18.801943 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:18.801908    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:10:19.061884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:19.061850    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8fvkp\""
Jul 06 19:10:19.232183 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:19.232153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:19.235774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:19.235411    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c6212a6-9e09-4a6a-8840-13307d3c9b9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lphws\" (UID: \"0c6212a6-9e09-4a6a-8840-13307d3c9b9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:19.324554 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:19.324466    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:19.481394 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:19.481359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"]
Jul 06 19:10:19.484774 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:19.484743    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6212a6_9e09_4a6a_8840_13307d3c9b9a.slice/crio-8c8f003432c536da336bf78c553a041ae54e4e16288f97ec014e0c836c463606 WatchSource:0}: Error finding container 8c8f003432c536da336bf78c553a041ae54e4e16288f97ec014e0c836c463606: Status 404 returned error can't find the container with id 8c8f003432c536da336bf78c553a041ae54e4e16288f97ec014e0c836c463606
Jul 06 19:10:19.886177 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:19.886141    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws" event={"ID":"0c6212a6-9e09-4a6a-8840-13307d3c9b9a","Type":"ContainerStarted","Data":"8c8f003432c536da336bf78c553a041ae54e4e16288f97ec014e0c836c463606"}
Jul 06 19:10:20.403026 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.402993    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d9dfc78-smvgf"]
Jul 06 19:10:20.406829 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.406802    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.410300 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.410273    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:10:20.410300 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.410284    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mk4nf\""
Jul 06 19:10:20.410498 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.410349    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:10:20.410498 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.410284    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:10:20.410498 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.410472    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:10:20.410665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.410649    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:10:20.417463 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.417439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d9dfc78-smvgf"]
Jul 06 19:10:20.545718 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.545560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-serving-cert\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.545718 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.545609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrgwq\" (UniqueName: \"kubernetes.io/projected/37f78c9f-31f3-42a4-be63-cad17305222b-kube-api-access-mrgwq\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.545718 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.545632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-service-ca\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.545718 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.545652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-console-config\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.546026 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.545771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-oauth-config\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.546026 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.545829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-oauth-serving-cert\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.647269 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.647219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-serving-cert\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.647269 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.647273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrgwq\" (UniqueName: \"kubernetes.io/projected/37f78c9f-31f3-42a4-be63-cad17305222b-kube-api-access-mrgwq\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.647504 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.647306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-service-ca\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.647504 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.647332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-console-config\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.647504 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.647384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-oauth-config\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.647504 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.647426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-oauth-serving-cert\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.648837 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.648806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-console-config\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.648974 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.648806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-service-ca\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.648974 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.648949    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-oauth-serving-cert\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.650411 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.650385    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-oauth-config\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.650536 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.650513    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-serving-cert\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.660889 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.660832    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrgwq\" (UniqueName: \"kubernetes.io/projected/37f78c9f-31f3-42a4-be63-cad17305222b-kube-api-access-mrgwq\") pod \"console-85d9dfc78-smvgf\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") " pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.719408 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.719370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:20.997813 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:20.997780    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d9dfc78-smvgf"]
Jul 06 19:10:21.000243 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:21.000214    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f78c9f_31f3_42a4_be63_cad17305222b.slice/crio-2959f8794dd93988bf67ba4cbe2520b6fb01b4ad46bf37da7539fb4e413087e2 WatchSource:0}: Error finding container 2959f8794dd93988bf67ba4cbe2520b6fb01b4ad46bf37da7539fb4e413087e2: Status 404 returned error can't find the container with id 2959f8794dd93988bf67ba4cbe2520b6fb01b4ad46bf37da7539fb4e413087e2
Jul 06 19:10:21.024331 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.024288    2561 patch_prober.go:28] interesting pod/image-registry-754c49c7d6-vrvp9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:10:21.024467 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.024357    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9" podUID="f4a2c9fe-5258-47bc-9f32-a8e314bf93d5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:10:21.897593 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.897558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws" event={"ID":"0c6212a6-9e09-4a6a-8840-13307d3c9b9a","Type":"ContainerStarted","Data":"f0f5e1a49d4dd25d159a806bf00a0e87b0b83613a7c3deec2d55c66f6cab8f60"}
Jul 06 19:10:21.897805 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.897735    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:21.898920 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.898894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9dfc78-smvgf" event={"ID":"37f78c9f-31f3-42a4-be63-cad17305222b","Type":"ContainerStarted","Data":"2959f8794dd93988bf67ba4cbe2520b6fb01b4ad46bf37da7539fb4e413087e2"}
Jul 06 19:10:21.904212 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.904184    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws"
Jul 06 19:10:21.935031 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:21.933789    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lphws" podStartSLOduration=3.523613199 podStartE2EDuration="4.933770455s" totalImagesPullingTime="1.410157256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:21.932289479 +0000 UTC m=+281.682998727" watchObservedRunningTime="2026-07-06 19:10:21.933770455 +0000 UTC m=+281.684479705"
Jul 06 19:10:22.798577 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:22.798245    2561 patch_prober.go:28] interesting pod/image-registry-754c49c7d6-vrvp9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:10:22.798577 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:22.798312    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9" podUID="f4a2c9fe-5258-47bc-9f32-a8e314bf93d5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:10:24.913869 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:24.913788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9dfc78-smvgf" event={"ID":"37f78c9f-31f3-42a4-be63-cad17305222b","Type":"ContainerStarted","Data":"2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2"}
Jul 06 19:10:24.985357 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:24.985322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:10:24.987743 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:24.987717    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d6b5338-13bf-41f6-89e9-302b27d2abfc-metrics-tls\") pod \"dns-default-fh4xd\" (UID: \"0d6b5338-13bf-41f6-89e9-302b27d2abfc\") " pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:10:25.280691 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:25.280655    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\""
Jul 06 19:10:25.288154 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:25.288128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:10:25.425662 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:25.425512    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d9dfc78-smvgf" podStartSLOduration=1.800154194 podStartE2EDuration="5.425493911s" totalImagesPullingTime="3.625339717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:24.945832271 +0000 UTC m=+284.696541545" watchObservedRunningTime="2026-07-06 19:10:25.425493911 +0000 UTC m=+285.176203158"
Jul 06 19:10:25.425895 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:25.425880    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fh4xd"]
Jul 06 19:10:25.427873 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:25.427833    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6b5338_13bf_41f6_89e9_302b27d2abfc.slice/crio-979c259cda8cccce4d509bbc8eb41d76f2d47052167c3738253ccbcf3483ac06 WatchSource:0}: Error finding container 979c259cda8cccce4d509bbc8eb41d76f2d47052167c3738253ccbcf3483ac06: Status 404 returned error can't find the container with id 979c259cda8cccce4d509bbc8eb41d76f2d47052167c3738253ccbcf3483ac06
Jul 06 19:10:25.922329 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:25.922290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fh4xd" event={"ID":"0d6b5338-13bf-41f6-89e9-302b27d2abfc","Type":"ContainerStarted","Data":"979c259cda8cccce4d509bbc8eb41d76f2d47052167c3738253ccbcf3483ac06"}
Jul 06 19:10:27.935243 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:27.935158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fh4xd" event={"ID":"0d6b5338-13bf-41f6-89e9-302b27d2abfc","Type":"ContainerStarted","Data":"b2e04affd8f42714b0fed39d0b36e88aa23bd7c21b758705155797a967263d1f"}
Jul 06 19:10:27.935243 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:27.935236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fh4xd" event={"ID":"0d6b5338-13bf-41f6-89e9-302b27d2abfc","Type":"ContainerStarted","Data":"5ac50bfeb8b3c64980c167b9390454f813b5dd5dfe41293040852c913ceed844"}
Jul 06 19:10:27.935670 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:27.935476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:10:29.853152 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.853077    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fh4xd" podStartSLOduration=252.75760166 podStartE2EDuration="4m14.853057473s" totalImagesPullingTime="2.095455813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:27.97286386 +0000 UTC m=+287.723573109" watchObservedRunningTime="2026-07-06 19:10:29.853057473 +0000 UTC m=+289.603766720"
Jul 06 19:10:29.853633 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.853299    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86bd4ddd4c-szmpv"]
Jul 06 19:10:29.857715 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.857696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.869315 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.869291    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:10:29.881933 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.881198    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bd4ddd4c-szmpv"]
Jul 06 19:10:29.930828 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.930796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-service-ca\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.930828 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.930832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-oauth-serving-cert\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.931030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.930854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-serving-cert\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.931030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.930946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-config\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.931142 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.931037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-oauth-config\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.931142 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.931076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrbnc\" (UniqueName: \"kubernetes.io/projected/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-kube-api-access-mrbnc\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:29.931142 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:29.931122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-trusted-ca-bundle\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032343 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-oauth-config\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032529 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrbnc\" (UniqueName: \"kubernetes.io/projected/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-kube-api-access-mrbnc\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032592 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-trusted-ca-bundle\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032645 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-service-ca\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032645 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-oauth-serving-cert\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032742 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-serving-cert\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.032742 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.032702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-config\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.033789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.033425    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-service-ca\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.033789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.033579    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-oauth-serving-cert\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.033789 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.033741    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-config\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.034020 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.033896    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-trusted-ca-bundle\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.035417 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.035368    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-oauth-config\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.036058 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.036036    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-serving-cert\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.049905 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.049881    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrbnc\" (UniqueName: \"kubernetes.io/projected/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-kube-api-access-mrbnc\") pod \"console-86bd4ddd4c-szmpv\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") " pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.169541 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.169449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:30.720483 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.720448    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:30.720655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.720526    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:30.725788 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.725763    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:30.953626 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:30.953595    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:10:31.022853 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:31.022717    2561 patch_prober.go:28] interesting pod/image-registry-754c49c7d6-vrvp9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:10:31.022853 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:31.022781    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9" podUID="f4a2c9fe-5258-47bc-9f32-a8e314bf93d5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:10:32.800131 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:32.800051    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-754c49c7d6-vrvp9"
Jul 06 19:10:35.705959 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.705925    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bd4ddd4c-szmpv"]
Jul 06 19:10:35.711081 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:10:35.711053    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cc38ac_cdf1_4f5d_81be_d1ae83e4a01e.slice/crio-a0ee3b115526e652f46f8c774905985b38843a34098e1a2e41bc5111391c59f9 WatchSource:0}: Error finding container a0ee3b115526e652f46f8c774905985b38843a34098e1a2e41bc5111391c59f9: Status 404 returned error can't find the container with id a0ee3b115526e652f46f8c774905985b38843a34098e1a2e41bc5111391c59f9
Jul 06 19:10:35.970282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.970242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-7n5dd" event={"ID":"d4f36103-e992-46f1-af97-90b276ccdc95","Type":"ContainerStarted","Data":"6e025af965c2544d8f7003f3abc286ed0f33de4d10ba1d110b298ad9512ff5e5"}
Jul 06 19:10:35.970523 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.970313    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:35.971671 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.971638    2561 patch_prober.go:28] interesting pod/downloads-685bfb5f64-7n5dd container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" start-of-body=
Jul 06 19:10:35.971779 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.971688    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-7n5dd" podUID="d4f36103-e992-46f1-af97-90b276ccdc95" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused"
Jul 06 19:10:35.972283 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.972255    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bd4ddd4c-szmpv" event={"ID":"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e","Type":"ContainerStarted","Data":"79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d"}
Jul 06 19:10:35.972367 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.972308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bd4ddd4c-szmpv" event={"ID":"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e","Type":"ContainerStarted","Data":"a0ee3b115526e652f46f8c774905985b38843a34098e1a2e41bc5111391c59f9"}
Jul 06 19:10:35.998300 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:35.998246    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-7n5dd" podStartSLOduration=1.5055624779999999 podStartE2EDuration="21.998228757s" totalImagesPullingTime="20.492666279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:35.996458067 +0000 UTC m=+295.747167335" watchObservedRunningTime="2026-07-06 19:10:35.998228757 +0000 UTC m=+295.748938003"
Jul 06 19:10:36.022849 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:36.022763    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86bd4ddd4c-szmpv" podStartSLOduration=7.022742818 podStartE2EDuration="7.022742818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:36.019176948 +0000 UTC m=+295.769886218" watchObservedRunningTime="2026-07-06 19:10:36.022742818 +0000 UTC m=+295.773452066"
Jul 06 19:10:37.001710 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:37.001671    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-7n5dd"
Jul 06 19:10:37.942656 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:37.942608    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fh4xd"
Jul 06 19:10:40.170250 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.170202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:40.170763 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.170279    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:40.176152 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.176099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:40.671485 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.671452    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:10:40.672669 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.672643    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:10:40.687263 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.687238    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:10:40.999088 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:40.999060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:10:41.065908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:41.059515    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d9dfc78-smvgf"]
Jul 06 19:10:43.005396 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:43.005366    2561 generic.go:356] "Generic (PLEG): container finished" podID="8156a742-e1e0-4acb-96d9-2913f7a08b5e" containerID="ab96d61a049e33c5253c5a0311275494d2949e6d33f83a232c716b8a2a0ce137" exitCode=0
Jul 06 19:10:43.005799 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:43.005438    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm" event={"ID":"8156a742-e1e0-4acb-96d9-2913f7a08b5e","Type":"ContainerDied","Data":"ab96d61a049e33c5253c5a0311275494d2949e6d33f83a232c716b8a2a0ce137"}
Jul 06 19:10:43.005855 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:43.005811    2561 scope.go:117] "RemoveContainer" containerID="ab96d61a049e33c5253c5a0311275494d2949e6d33f83a232c716b8a2a0ce137"
Jul 06 19:10:44.015426 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:44.015386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qh2fm" event={"ID":"8156a742-e1e0-4acb-96d9-2913f7a08b5e","Type":"ContainerStarted","Data":"db620385decc44d4ad1cd22c4b7d8e87c206282ff3a92c180b0f5347b1328b01"}
Jul 06 19:10:45.022307 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:45.022263    2561 generic.go:356] "Generic (PLEG): container finished" podID="ff7e7199-e91e-41ff-976d-86a7c55b2358" containerID="81c0362bf65b0dfd4ee7fc805a34313a5c98af51b00d55138c90405238f08ea6" exitCode=0
Jul 06 19:10:45.022703 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:45.022344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4" event={"ID":"ff7e7199-e91e-41ff-976d-86a7c55b2358","Type":"ContainerDied","Data":"81c0362bf65b0dfd4ee7fc805a34313a5c98af51b00d55138c90405238f08ea6"}
Jul 06 19:10:45.022842 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:45.022825    2561 scope.go:117] "RemoveContainer" containerID="81c0362bf65b0dfd4ee7fc805a34313a5c98af51b00d55138c90405238f08ea6"
Jul 06 19:10:46.028318 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:46.028283    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p4jj4" event={"ID":"ff7e7199-e91e-41ff-976d-86a7c55b2358","Type":"ContainerStarted","Data":"c276073b54de3ad2c5b05fb2683454ac2e1446f76d3ce102fd696bdcf3549a6c"}
Jul 06 19:10:53.287432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:53.287400    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66f45d6fc7-4846p_3df4cb41-be07-4684-afc6-c906b0a1c917/router/0.log"
Jul 06 19:10:53.325880 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:10:53.325851    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z2g8d_887c074b-d3e3-42fe-9a5b-ddee82884a6a/serve-healthcheck-canary/0.log"
Jul 06 19:11:06.087464 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.087417    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85d9dfc78-smvgf" podUID="37f78c9f-31f3-42a4-be63-cad17305222b" containerName="console" containerID="cri-o://2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2" gracePeriod=15
Jul 06 19:11:06.401435 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.401006    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:11:06.563196 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.563156    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-service-ca\") pod \"37f78c9f-31f3-42a4-be63-cad17305222b\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") "
Jul 06 19:11:06.563393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.563213    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-console-config\") pod \"37f78c9f-31f3-42a4-be63-cad17305222b\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") "
Jul 06 19:11:06.563393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.563288    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-oauth-config\") pod \"37f78c9f-31f3-42a4-be63-cad17305222b\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") "
Jul 06 19:11:06.563393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.563332    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-serving-cert\") pod \"37f78c9f-31f3-42a4-be63-cad17305222b\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") "
Jul 06 19:11:06.563393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.563357    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-oauth-serving-cert\") pod \"37f78c9f-31f3-42a4-be63-cad17305222b\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") "
Jul 06 19:11:06.563621 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.563400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrgwq\" (UniqueName: \"kubernetes.io/projected/37f78c9f-31f3-42a4-be63-cad17305222b-kube-api-access-mrgwq\") pod \"37f78c9f-31f3-42a4-be63-cad17305222b\" (UID: \"37f78c9f-31f3-42a4-be63-cad17305222b\") "
Jul 06 19:11:06.565041 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.564389    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-service-ca" (OuterVolumeSpecName: "service-ca") pod "37f78c9f-31f3-42a4-be63-cad17305222b" (UID: "37f78c9f-31f3-42a4-be63-cad17305222b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:11:06.565041 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.564663    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-console-config" (OuterVolumeSpecName: "console-config") pod "37f78c9f-31f3-42a4-be63-cad17305222b" (UID: "37f78c9f-31f3-42a4-be63-cad17305222b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:11:06.565257 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.565231    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37f78c9f-31f3-42a4-be63-cad17305222b" (UID: "37f78c9f-31f3-42a4-be63-cad17305222b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:11:06.566654 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.566629    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37f78c9f-31f3-42a4-be63-cad17305222b" (UID: "37f78c9f-31f3-42a4-be63-cad17305222b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:11:06.566977 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.566960    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f78c9f-31f3-42a4-be63-cad17305222b-kube-api-access-mrgwq" (OuterVolumeSpecName: "kube-api-access-mrgwq") pod "37f78c9f-31f3-42a4-be63-cad17305222b" (UID: "37f78c9f-31f3-42a4-be63-cad17305222b"). InnerVolumeSpecName "kube-api-access-mrgwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:11:06.567389 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.567368    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37f78c9f-31f3-42a4-be63-cad17305222b" (UID: "37f78c9f-31f3-42a4-be63-cad17305222b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:11:06.664375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.664299    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-service-ca\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:11:06.664375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.664328    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-console-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:11:06.664375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.664337    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-oauth-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:11:06.664375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.664347    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f78c9f-31f3-42a4-be63-cad17305222b-console-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:11:06.664375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.664356    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f78c9f-31f3-42a4-be63-cad17305222b-oauth-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:11:06.664375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:06.664365    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrgwq\" (UniqueName: \"kubernetes.io/projected/37f78c9f-31f3-42a4-be63-cad17305222b-kube-api-access-mrgwq\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:11:07.114637 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.114595    2561 generic.go:356] "Generic (PLEG): container finished" podID="37f78c9f-31f3-42a4-be63-cad17305222b" containerID="2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2" exitCode=0
Jul 06 19:11:07.115153 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.114641    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9dfc78-smvgf"
Jul 06 19:11:07.115153 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.114682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9dfc78-smvgf" event={"ID":"37f78c9f-31f3-42a4-be63-cad17305222b","Type":"ContainerDied","Data":"2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2"}
Jul 06 19:11:07.115153 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.114733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9dfc78-smvgf" event={"ID":"37f78c9f-31f3-42a4-be63-cad17305222b","Type":"ContainerDied","Data":"2959f8794dd93988bf67ba4cbe2520b6fb01b4ad46bf37da7539fb4e413087e2"}
Jul 06 19:11:07.115153 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.114753    2561 scope.go:117] "RemoveContainer" containerID="2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2"
Jul 06 19:11:07.123139 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.123098    2561 scope.go:117] "RemoveContainer" containerID="2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2"
Jul 06 19:11:07.123440 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:11:07.123420    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2\": container with ID starting with 2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2 not found: ID does not exist" containerID="2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2"
Jul 06 19:11:07.123513 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.123454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2"} err="failed to get container status \"2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2\": rpc error: code = NotFound desc = could not find container \"2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2\": container with ID starting with 2b242b22031d770a1fcc4150daa8e27ff555dcce5928fe6ae72e78a6a704dee2 not found: ID does not exist"
Jul 06 19:11:07.140381 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.140359    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d9dfc78-smvgf"]
Jul 06 19:11:07.142854 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:07.142834    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85d9dfc78-smvgf"]
Jul 06 19:11:08.882096 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:08.882064    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f78c9f-31f3-42a4-be63-cad17305222b" path="/var/lib/kubelet/pods/37f78c9f-31f3-42a4-be63-cad17305222b/volumes"
Jul 06 19:11:41.806013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.805979    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc4bfdb58-b6xsr"]
Jul 06 19:11:41.806546 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.806433    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f78c9f-31f3-42a4-be63-cad17305222b" containerName="console"
Jul 06 19:11:41.806546 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.806452    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f78c9f-31f3-42a4-be63-cad17305222b" containerName="console"
Jul 06 19:11:41.806655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.806559    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f78c9f-31f3-42a4-be63-cad17305222b" containerName="console"
Jul 06 19:11:41.809719 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.809689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.831515 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.831488    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc4bfdb58-b6xsr"]
Jul 06 19:11:41.946802 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-config\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.946802 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrs4\" (UniqueName: \"kubernetes.io/projected/e8b0da53-0e52-48f6-a6d7-059b82ca4909-kube-api-access-cqrs4\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.946802 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-oauth-config\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.946802 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-oauth-serving-cert\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.946802 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-trusted-ca-bundle\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.947185 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-service-ca\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:41.947185 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:41.946945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-serving-cert\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.047769 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-trusted-ca-bundle\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.047769 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-service-ca\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-serving-cert\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-config\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrs4\" (UniqueName: \"kubernetes.io/projected/e8b0da53-0e52-48f6-a6d7-059b82ca4909-kube-api-access-cqrs4\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-oauth-config\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.047949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-oauth-serving-cert\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048671 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.048639    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-service-ca\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.048816 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.048788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-config\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.049074 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.049026    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-oauth-serving-cert\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.049493 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.049469    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-trusted-ca-bundle\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.050616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.050588    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-serving-cert\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.050696 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.050614    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-oauth-config\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.065494 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.065436    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrs4\" (UniqueName: \"kubernetes.io/projected/e8b0da53-0e52-48f6-a6d7-059b82ca4909-kube-api-access-cqrs4\") pod \"console-fc4bfdb58-b6xsr\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") " pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.120300 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.120256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:42.264930 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:42.264894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc4bfdb58-b6xsr"]
Jul 06 19:11:42.269251 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:11:42.269225    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b0da53_0e52_48f6_a6d7_059b82ca4909.slice/crio-0c3ed7fe51712a06cc796502475622c97731f47494b3d19f1e08d32917cdd578 WatchSource:0}: Error finding container 0c3ed7fe51712a06cc796502475622c97731f47494b3d19f1e08d32917cdd578: Status 404 returned error can't find the container with id 0c3ed7fe51712a06cc796502475622c97731f47494b3d19f1e08d32917cdd578
Jul 06 19:11:43.248811 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:43.248772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc4bfdb58-b6xsr" event={"ID":"e8b0da53-0e52-48f6-a6d7-059b82ca4909","Type":"ContainerStarted","Data":"eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008"}
Jul 06 19:11:43.249215 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:43.248831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc4bfdb58-b6xsr" event={"ID":"e8b0da53-0e52-48f6-a6d7-059b82ca4909","Type":"ContainerStarted","Data":"0c3ed7fe51712a06cc796502475622c97731f47494b3d19f1e08d32917cdd578"}
Jul 06 19:11:43.280087 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:43.280034    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc4bfdb58-b6xsr" podStartSLOduration=2.2800189570000002 podStartE2EDuration="2.280018957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:43.278874097 +0000 UTC m=+363.029583344" watchObservedRunningTime="2026-07-06 19:11:43.280018957 +0000 UTC m=+363.030728259"
Jul 06 19:11:52.121200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:52.121146    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:52.121603 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:52.121243    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:52.125859 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:52.125837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:52.286738 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:52.286711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:11:52.366374 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:11:52.366334    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bd4ddd4c-szmpv"]
Jul 06 19:12:17.387815 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.387776    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86bd4ddd4c-szmpv" podUID="35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" containerName="console" containerID="cri-o://79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d" gracePeriod=15
Jul 06 19:12:17.633237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.633214    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:12:17.735345 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735313    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrbnc\" (UniqueName: \"kubernetes.io/projected/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-kube-api-access-mrbnc\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735363    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-serving-cert\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735387    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-oauth-config\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-service-ca\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735457    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-config\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-oauth-serving-cert\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735722 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735527    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-trusted-ca-bundle\") pod \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\" (UID: \"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e\") "
Jul 06 19:12:17.735958 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735930    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:12:17.735958 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735939    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-config" (OuterVolumeSpecName: "console-config") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:12:17.736101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.735947    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-service-ca" (OuterVolumeSpecName: "service-ca") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:12:17.736101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.736011    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:12:17.737630 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.737608    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-kube-api-access-mrbnc" (OuterVolumeSpecName: "kube-api-access-mrbnc") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "kube-api-access-mrbnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:12:17.738121 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.738083    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:12:17.738245 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.738099    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" (UID: "35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:12:17.836791 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836747    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:17.836791 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836784    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-oauth-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:17.836791 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836795    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-trusted-ca-bundle\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:17.836791 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836804    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrbnc\" (UniqueName: \"kubernetes.io/projected/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-kube-api-access-mrbnc\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:17.837038 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836813    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:17.837038 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836822    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-console-oauth-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:17.837038 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:17.836829    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e-service-ca\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:12:18.377970 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.377932    2561 generic.go:356] "Generic (PLEG): container finished" podID="35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" containerID="79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d" exitCode=0
Jul 06 19:12:18.378178 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.377993    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bd4ddd4c-szmpv"
Jul 06 19:12:18.378178 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.377994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bd4ddd4c-szmpv" event={"ID":"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e","Type":"ContainerDied","Data":"79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d"}
Jul 06 19:12:18.378178 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.378139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bd4ddd4c-szmpv" event={"ID":"35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e","Type":"ContainerDied","Data":"a0ee3b115526e652f46f8c774905985b38843a34098e1a2e41bc5111391c59f9"}
Jul 06 19:12:18.378178 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.378168    2561 scope.go:117] "RemoveContainer" containerID="79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d"
Jul 06 19:12:18.386559 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.386541    2561 scope.go:117] "RemoveContainer" containerID="79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d"
Jul 06 19:12:18.386803 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:12:18.386783    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d\": container with ID starting with 79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d not found: ID does not exist" containerID="79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d"
Jul 06 19:12:18.386848 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.386811    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d"} err="failed to get container status \"79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d\": rpc error: code = NotFound desc = could not find container \"79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d\": container with ID starting with 79379d75d801b86bf89fc52bdbdd5f58526d49b51b77077348f7ae7ee0a3274d not found: ID does not exist"
Jul 06 19:12:18.406705 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.406679    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bd4ddd4c-szmpv"]
Jul 06 19:12:18.408463 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.408444    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86bd4ddd4c-szmpv"]
Jul 06 19:12:18.881389 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:12:18.881358    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" path="/var/lib/kubelet/pods/35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e/volumes"
Jul 06 19:13:14.924393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:14.924358    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b659c5577-7gqpv"]
Jul 06 19:13:14.924865 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:14.924650    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" containerName="console"
Jul 06 19:13:14.924865 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:14.924663    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" containerName="console"
Jul 06 19:13:14.924865 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:14.924714    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="35cc38ac-cdf1-4f5d-81be-d1ae83e4a01e" containerName="console"
Jul 06 19:13:14.926618 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:14.926600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:14.943671 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:14.943649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b659c5577-7gqpv"]
Jul 06 19:13:15.003886 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.003854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-console-config\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.003886 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.003888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-trusted-ca-bundle\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.004095 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.003922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-serving-cert\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.004095 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.003965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-service-ca\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.004095 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.004027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7hfx\" (UniqueName: \"kubernetes.io/projected/977c4f79-124b-49df-957e-3481d2f21d63-kube-api-access-t7hfx\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.004095 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.004047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-oauth-serving-cert\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.004095 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.004072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-oauth-config\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104504 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7hfx\" (UniqueName: \"kubernetes.io/projected/977c4f79-124b-49df-957e-3481d2f21d63-kube-api-access-t7hfx\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104504 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-oauth-serving-cert\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-oauth-config\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-console-config\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-trusted-ca-bundle\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104874 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-serving-cert\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.104874 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.104767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-service-ca\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.105363 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.105320    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-console-config\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.105363 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.105323    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-oauth-serving-cert\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.105509 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.105399    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-service-ca\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.106128 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.106083    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-trusted-ca-bundle\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.107366 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.107340    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-oauth-config\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.107456 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.107373    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-serving-cert\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.118739 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.118718    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7hfx\" (UniqueName: \"kubernetes.io/projected/977c4f79-124b-49df-957e-3481d2f21d63-kube-api-access-t7hfx\") pod \"console-7b659c5577-7gqpv\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") " pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.236440 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.236414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:15.375395 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.375233    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b659c5577-7gqpv"]
Jul 06 19:13:15.379452 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:13:15.379418    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977c4f79_124b_49df_957e_3481d2f21d63.slice/crio-f6df6670eed533ca4b117e382924e7644e266fcc9098096898a9edc8b37c7f96 WatchSource:0}: Error finding container f6df6670eed533ca4b117e382924e7644e266fcc9098096898a9edc8b37c7f96: Status 404 returned error can't find the container with id f6df6670eed533ca4b117e382924e7644e266fcc9098096898a9edc8b37c7f96
Jul 06 19:13:15.582030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.581927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b659c5577-7gqpv" event={"ID":"977c4f79-124b-49df-957e-3481d2f21d63","Type":"ContainerStarted","Data":"bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0"}
Jul 06 19:13:15.582030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.581979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b659c5577-7gqpv" event={"ID":"977c4f79-124b-49df-957e-3481d2f21d63","Type":"ContainerStarted","Data":"f6df6670eed533ca4b117e382924e7644e266fcc9098096898a9edc8b37c7f96"}
Jul 06 19:13:15.608061 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:15.608003    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b659c5577-7gqpv" podStartSLOduration=1.607983216 podStartE2EDuration="1.607983216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:15.606688042 +0000 UTC m=+455.357397308" watchObservedRunningTime="2026-07-06 19:13:15.607983216 +0000 UTC m=+455.358692466"
Jul 06 19:13:25.236771 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:25.236737    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:25.237263 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:25.236796    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:25.241365 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:25.241340    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:25.626747 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:25.626666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:13:25.688793 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:25.688765    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc4bfdb58-b6xsr"]
Jul 06 19:13:50.711970 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:50.711898    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fc4bfdb58-b6xsr" podUID="e8b0da53-0e52-48f6-a6d7-059b82ca4909" containerName="console" containerID="cri-o://eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008" gracePeriod=15
Jul 06 19:13:50.946171 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:50.946146    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:13:51.112941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.112893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-trusted-ca-bundle\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.112941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.112941    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-serving-cert\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.113237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.112961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-oauth-serving-cert\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.113237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.112986    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-oauth-config\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.113237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqrs4\" (UniqueName: \"kubernetes.io/projected/e8b0da53-0e52-48f6-a6d7-059b82ca4909-kube-api-access-cqrs4\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.113237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113088    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-service-ca\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.113237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-config\") pod \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\" (UID: \"e8b0da53-0e52-48f6-a6d7-059b82ca4909\") "
Jul 06 19:13:51.113489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113457    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:13:51.113561 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113499    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:13:51.113642 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113615    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-config" (OuterVolumeSpecName: "console-config") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:13:51.113700 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.113630    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:13:51.115319 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.115294    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:13:51.115415 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.115384    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b0da53-0e52-48f6-a6d7-059b82ca4909-kube-api-access-cqrs4" (OuterVolumeSpecName: "kube-api-access-cqrs4") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "kube-api-access-cqrs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:51.115415 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.115390    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8b0da53-0e52-48f6-a6d7-059b82ca4909" (UID: "e8b0da53-0e52-48f6-a6d7-059b82ca4909"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:13:51.214637 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214604    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.214637 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214631    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-trusted-ca-bundle\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.214637 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214641    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.214854 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214652    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-oauth-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.214854 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214661    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8b0da53-0e52-48f6-a6d7-059b82ca4909-console-oauth-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.214854 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214669    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqrs4\" (UniqueName: \"kubernetes.io/projected/e8b0da53-0e52-48f6-a6d7-059b82ca4909-kube-api-access-cqrs4\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.214854 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.214677    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b0da53-0e52-48f6-a6d7-059b82ca4909-service-ca\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.717618 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.717588    2561 generic.go:356] "Generic (PLEG): container finished" podID="e8b0da53-0e52-48f6-a6d7-059b82ca4909" containerID="eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008" exitCode=0
Jul 06 19:13:51.718009 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.717631    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc4bfdb58-b6xsr"
Jul 06 19:13:51.718009 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.717667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc4bfdb58-b6xsr" event={"ID":"e8b0da53-0e52-48f6-a6d7-059b82ca4909","Type":"ContainerDied","Data":"eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008"}
Jul 06 19:13:51.718009 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.717704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc4bfdb58-b6xsr" event={"ID":"e8b0da53-0e52-48f6-a6d7-059b82ca4909","Type":"ContainerDied","Data":"0c3ed7fe51712a06cc796502475622c97731f47494b3d19f1e08d32917cdd578"}
Jul 06 19:13:51.718009 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.717725    2561 scope.go:117] "RemoveContainer" containerID="eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008"
Jul 06 19:13:51.730434 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.730413    2561 scope.go:117] "RemoveContainer" containerID="eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008"
Jul 06 19:13:51.730691 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:13:51.730672    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008\": container with ID starting with eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008 not found: ID does not exist" containerID="eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008"
Jul 06 19:13:51.730736 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.730698    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008"} err="failed to get container status \"eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008\": rpc error: code = NotFound desc = could not find container \"eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008\": container with ID starting with eb4b20a2e1055cabf2cfc6b7ce1d320e0e3e124a4eeb97cb2e56a33ade0fd008 not found: ID does not exist"
Jul 06 19:13:51.746713 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.746683    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc4bfdb58-b6xsr"]
Jul 06 19:13:51.753595 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:51.753571    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc4bfdb58-b6xsr"]
Jul 06 19:13:52.880993 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:52.880959    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8b0da53-0e52-48f6-a6d7-059b82ca4909" path="/var/lib/kubelet/pods/e8b0da53-0e52-48f6-a6d7-059b82ca4909/volumes"
Jul 06 19:13:57.001720 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.001686    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"]
Jul 06 19:13:57.002201 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.001982    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b0da53-0e52-48f6-a6d7-059b82ca4909" containerName="console"
Jul 06 19:13:57.002201 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.001994    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b0da53-0e52-48f6-a6d7-059b82ca4909" containerName="console"
Jul 06 19:13:57.002201 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.002043    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8b0da53-0e52-48f6-a6d7-059b82ca4909" containerName="console"
Jul 06 19:13:57.005313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.005296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.008212 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.008188    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:13:57.008339 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.008320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 19:13:57.008625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.008605    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7n6bf\""
Jul 06 19:13:57.023405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.023379    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"]
Jul 06 19:13:57.061236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.061201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlph2\" (UniqueName: \"kubernetes.io/projected/7a2a2af5-33fb-49e1-adb3-fc320d623af3-kube-api-access-hlph2\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpfhx\" (UID: \"7a2a2af5-33fb-49e1-adb3-fc320d623af3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.061380 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.061277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2a2af5-33fb-49e1-adb3-fc320d623af3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpfhx\" (UID: \"7a2a2af5-33fb-49e1-adb3-fc320d623af3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.162193 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.162147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlph2\" (UniqueName: \"kubernetes.io/projected/7a2a2af5-33fb-49e1-adb3-fc320d623af3-kube-api-access-hlph2\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpfhx\" (UID: \"7a2a2af5-33fb-49e1-adb3-fc320d623af3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.162322 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.162287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2a2af5-33fb-49e1-adb3-fc320d623af3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpfhx\" (UID: \"7a2a2af5-33fb-49e1-adb3-fc320d623af3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.162668 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.162650    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2a2af5-33fb-49e1-adb3-fc320d623af3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpfhx\" (UID: \"7a2a2af5-33fb-49e1-adb3-fc320d623af3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.174687 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.174669    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlph2\" (UniqueName: \"kubernetes.io/projected/7a2a2af5-33fb-49e1-adb3-fc320d623af3-kube-api-access-hlph2\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpfhx\" (UID: \"7a2a2af5-33fb-49e1-adb3-fc320d623af3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.314455 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.314376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"
Jul 06 19:13:57.468453 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.468418    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx"]
Jul 06 19:13:57.473792 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:13:57.473767    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2a2af5_33fb_49e1_adb3_fc320d623af3.slice/crio-d6b42278e3842307df1a6744f22b5afa7faa30e761173ec604df1d4c8b40a706 WatchSource:0}: Error finding container d6b42278e3842307df1a6744f22b5afa7faa30e761173ec604df1d4c8b40a706: Status 404 returned error can't find the container with id d6b42278e3842307df1a6744f22b5afa7faa30e761173ec604df1d4c8b40a706
Jul 06 19:13:57.476537 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.476522    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:13:57.748328 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:13:57.748296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx" event={"ID":"7a2a2af5-33fb-49e1-adb3-fc320d623af3","Type":"ContainerStarted","Data":"d6b42278e3842307df1a6744f22b5afa7faa30e761173ec604df1d4c8b40a706"}
Jul 06 19:14:00.763981 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:00.763939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx" event={"ID":"7a2a2af5-33fb-49e1-adb3-fc320d623af3","Type":"ContainerStarted","Data":"f2fda56d53c0e76f9664b739bab3ecb87ecaa6f31ecf20e55db2bb9d678f17e6"}
Jul 06 19:14:00.791424 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:00.791326    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpfhx" podStartSLOduration=2.178734627 podStartE2EDuration="4.79130909s" totalImagesPullingTime="2.612574463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:00.789694492 +0000 UTC m=+500.540403774" watchObservedRunningTime="2026-07-06 19:14:00.79130909 +0000 UTC m=+500.542018337"
Jul 06 19:14:08.784236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.784196    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hl57n"]
Jul 06 19:14:08.786476 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.786455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:08.789242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.789163    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:14:08.789895 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.789879    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:14:08.789990 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.789879    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gz22s\""
Jul 06 19:14:08.796816 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.796794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hl57n"]
Jul 06 19:14:08.855833 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.855799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvr9w\" (UniqueName: \"kubernetes.io/projected/924512ba-ff1e-48dc-b4d4-cd3a42c70ab1-kube-api-access-cvr9w\") pod \"cert-manager-webhook-6486ffd997-hl57n\" (UID: \"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:08.856028 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.855854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/924512ba-ff1e-48dc-b4d4-cd3a42c70ab1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hl57n\" (UID: \"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:08.957085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.957049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/924512ba-ff1e-48dc-b4d4-cd3a42c70ab1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hl57n\" (UID: \"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:08.957266 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.957137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvr9w\" (UniqueName: \"kubernetes.io/projected/924512ba-ff1e-48dc-b4d4-cd3a42c70ab1-kube-api-access-cvr9w\") pod \"cert-manager-webhook-6486ffd997-hl57n\" (UID: \"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:08.969749 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.969720    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/924512ba-ff1e-48dc-b4d4-cd3a42c70ab1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hl57n\" (UID: \"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:08.971123 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:08.971093    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvr9w\" (UniqueName: \"kubernetes.io/projected/924512ba-ff1e-48dc-b4d4-cd3a42c70ab1-kube-api-access-cvr9w\") pod \"cert-manager-webhook-6486ffd997-hl57n\" (UID: \"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:09.106875 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:09.106796    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:09.238221 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:09.238184    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hl57n"]
Jul 06 19:14:09.242092 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:14:09.242069    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod924512ba_ff1e_48dc_b4d4_cd3a42c70ab1.slice/crio-ae5744b126683873e44e6ab1161a2491179da7fc5454d2dd953eec836a2c6cb4 WatchSource:0}: Error finding container ae5744b126683873e44e6ab1161a2491179da7fc5454d2dd953eec836a2c6cb4: Status 404 returned error can't find the container with id ae5744b126683873e44e6ab1161a2491179da7fc5454d2dd953eec836a2c6cb4
Jul 06 19:14:09.804306 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:09.804268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n" event={"ID":"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1","Type":"ContainerStarted","Data":"ae5744b126683873e44e6ab1161a2491179da7fc5454d2dd953eec836a2c6cb4"}
Jul 06 19:14:11.814777 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:11.814739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n" event={"ID":"924512ba-ff1e-48dc-b4d4-cd3a42c70ab1","Type":"ContainerStarted","Data":"556e5fadee06dc6823dcefae2e6f078dfc50e9644348be71f3e5c1436698734a"}
Jul 06 19:14:11.815230 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:11.815003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:11.837846 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:11.837802    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n" podStartSLOduration=1.463052638 podStartE2EDuration="3.837787851s" totalImagesPullingTime="2.374735213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:11.835847038 +0000 UTC m=+511.586556297" watchObservedRunningTime="2026-07-06 19:14:11.837787851 +0000 UTC m=+511.588497097"
Jul 06 19:14:17.821953 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:17.821916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hl57n"
Jul 06 19:14:40.492136 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.492080    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"]
Jul 06 19:14:40.494682 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.494666    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.498177 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.498155    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:14:40.498294 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.498155    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:14:40.498294 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.498240    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g7rx\""
Jul 06 19:14:40.498410 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.498397    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:14:40.498831 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.498818    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:14:40.522528 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.522506    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"]
Jul 06 19:14:40.628027 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.627992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/540dd4d5-68fd-43cc-b8f8-06eefc407039-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.628027 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.628030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/540dd4d5-68fd-43cc-b8f8-06eefc407039-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.628236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.628064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/540dd4d5-68fd-43cc-b8f8-06eefc407039-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.628236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.628156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swxz\" (UniqueName: \"kubernetes.io/projected/540dd4d5-68fd-43cc-b8f8-06eefc407039-kube-api-access-2swxz\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.628236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.628193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/540dd4d5-68fd-43cc-b8f8-06eefc407039-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.728762 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.728729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/540dd4d5-68fd-43cc-b8f8-06eefc407039-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.728762 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.728765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/540dd4d5-68fd-43cc-b8f8-06eefc407039-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.728947 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.728787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/540dd4d5-68fd-43cc-b8f8-06eefc407039-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.728947 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.728813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swxz\" (UniqueName: \"kubernetes.io/projected/540dd4d5-68fd-43cc-b8f8-06eefc407039-kube-api-access-2swxz\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.728947 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.728841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/540dd4d5-68fd-43cc-b8f8-06eefc407039-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.729149 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.729100    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/540dd4d5-68fd-43cc-b8f8-06eefc407039-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.731120 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.731088    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/540dd4d5-68fd-43cc-b8f8-06eefc407039-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.734483 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.734464    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:14:40.742435 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.742378    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/540dd4d5-68fd-43cc-b8f8-06eefc407039-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.742435 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.742378    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/540dd4d5-68fd-43cc-b8f8-06eefc407039-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.747307 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.747288    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:14:40.757737 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.757721    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:14:40.768528 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.768506    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swxz\" (UniqueName: \"kubernetes.io/projected/540dd4d5-68fd-43cc-b8f8-06eefc407039-kube-api-access-2swxz\") pod \"opendatahub-operator-controller-manager-b48f9c585-4cvgp\" (UID: \"540dd4d5-68fd-43cc-b8f8-06eefc407039\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.808237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.808212    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g7rx\""
Jul 06 19:14:40.815134 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.815096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:40.960131 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:40.960074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"]
Jul 06 19:14:40.964037 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:14:40.963999    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540dd4d5_68fd_43cc_b8f8_06eefc407039.slice/crio-432bed91c6dab9077d3135974ef86dd47d119275976b72e77be54b18fbe8052e WatchSource:0}: Error finding container 432bed91c6dab9077d3135974ef86dd47d119275976b72e77be54b18fbe8052e: Status 404 returned error can't find the container with id 432bed91c6dab9077d3135974ef86dd47d119275976b72e77be54b18fbe8052e
Jul 06 19:14:41.939593 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:41.939536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerStarted","Data":"432bed91c6dab9077d3135974ef86dd47d119275976b72e77be54b18fbe8052e"}
Jul 06 19:14:43.950513 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:43.950477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerStarted","Data":"b467cbb5c68563d7e98ce424d9604d67a9b4d62a6e863e733326c5b3b0ae17ef"}
Jul 06 19:14:44.956034 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:44.955997    2561 generic.go:356] "Generic (PLEG): container finished" podID="540dd4d5-68fd-43cc-b8f8-06eefc407039" containerID="b467cbb5c68563d7e98ce424d9604d67a9b4d62a6e863e733326c5b3b0ae17ef" exitCode=0
Jul 06 19:14:44.956455 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:44.956085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerDied","Data":"b467cbb5c68563d7e98ce424d9604d67a9b4d62a6e863e733326c5b3b0ae17ef"}
Jul 06 19:14:45.962491 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:45.962453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerStarted","Data":"f26d4f91000c03f1c5143d9cbe1f31ff0076434657e7f0e86c52bcbe8857c9b0"}
Jul 06 19:14:45.962889 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:45.962591    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:14:45.989963 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:45.989906    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" podStartSLOduration=1.903624288 podStartE2EDuration="5.989892217s" totalImagesPullingTime="3.085907324s" totalInitContainerRuntime="1.000360605s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:45.98803348 +0000 UTC m=+545.738742745" watchObservedRunningTime="2026-07-06 19:14:45.989892217 +0000 UTC m=+545.740601464"
Jul 06 19:14:56.968856 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:14:56.968816    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:15:01.187761 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.187725    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"]
Jul 06 19:15:01.197981 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.197956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.201234 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.201209    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:15:01.201744 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.201720    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:15:01.204235 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.204213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b548v\""
Jul 06 19:15:01.209746 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.209724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"]
Jul 06 19:15:01.309412 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.309372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd33939c-5cd7-430d-883d-35b6fb33eddc-tmp\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.309569 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.309446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkl52\" (UniqueName: \"kubernetes.io/projected/dd33939c-5cd7-430d-883d-35b6fb33eddc-kube-api-access-nkl52\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.309569 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.309528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd33939c-5cd7-430d-883d-35b6fb33eddc-tls-certs\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.410149 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.410087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkl52\" (UniqueName: \"kubernetes.io/projected/dd33939c-5cd7-430d-883d-35b6fb33eddc-kube-api-access-nkl52\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.410319 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.410165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd33939c-5cd7-430d-883d-35b6fb33eddc-tls-certs\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.410319 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.410195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd33939c-5cd7-430d-883d-35b6fb33eddc-tmp\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.412706 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.412681    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd33939c-5cd7-430d-883d-35b6fb33eddc-tmp\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.412916 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.412897    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd33939c-5cd7-430d-883d-35b6fb33eddc-tls-certs\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.422448 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.422423    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkl52\" (UniqueName: \"kubernetes.io/projected/dd33939c-5cd7-430d-883d-35b6fb33eddc-kube-api-access-nkl52\") pod \"kube-auth-proxy-7f9b6c5cb8-pdzbw\" (UID: \"dd33939c-5cd7-430d-883d-35b6fb33eddc\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.512621 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.512591    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"
Jul 06 19:15:01.658639 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:01.658608    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw"]
Jul 06 19:15:01.661702 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:15:01.661670    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd33939c_5cd7_430d_883d_35b6fb33eddc.slice/crio-ad2b08ec182f764cc19ee2c81dc477b66cfe105f240843b0393cc9995e09817e WatchSource:0}: Error finding container ad2b08ec182f764cc19ee2c81dc477b66cfe105f240843b0393cc9995e09817e: Status 404 returned error can't find the container with id ad2b08ec182f764cc19ee2c81dc477b66cfe105f240843b0393cc9995e09817e
Jul 06 19:15:02.030881 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.030842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw" event={"ID":"dd33939c-5cd7-430d-883d-35b6fb33eddc","Type":"ContainerStarted","Data":"ad2b08ec182f764cc19ee2c81dc477b66cfe105f240843b0393cc9995e09817e"}
Jul 06 19:15:02.459057 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.458975    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qr2wf"]
Jul 06 19:15:02.461466 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.461440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:02.464067 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.463996    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:15:02.464363 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.464340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-clnlc\""
Jul 06 19:15:02.474920 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.474899    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qr2wf"]
Jul 06 19:15:02.518549 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.518518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc46c97e-f7d9-4ef5-82bf-123f025befcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:02.518723 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.518554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8frk5\" (UniqueName: \"kubernetes.io/projected/bc46c97e-f7d9-4ef5-82bf-123f025befcc-kube-api-access-8frk5\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:02.619914 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.619875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc46c97e-f7d9-4ef5-82bf-123f025befcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:02.619914 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.619918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8frk5\" (UniqueName: \"kubernetes.io/projected/bc46c97e-f7d9-4ef5-82bf-123f025befcc-kube-api-access-8frk5\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:02.620373 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:02.620343    2561 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 19:15:02.620511 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:02.620434    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc46c97e-f7d9-4ef5-82bf-123f025befcc-tls-certs podName:bc46c97e-f7d9-4ef5-82bf-123f025befcc nodeName:}" failed. No retries permitted until 2026-07-06 19:15:03.120412051 +0000 UTC m=+562.871121282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bc46c97e-f7d9-4ef5-82bf-123f025befcc-tls-certs") pod "model-serving-api-54d89bd5fc-qr2wf" (UID: "bc46c97e-f7d9-4ef5-82bf-123f025befcc") : secret "model-serving-api-tls" not found
Jul 06 19:15:02.651387 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.651347    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8frk5\" (UniqueName: \"kubernetes.io/projected/bc46c97e-f7d9-4ef5-82bf-123f025befcc-kube-api-access-8frk5\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:02.840090 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.840055    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"]
Jul 06 19:15:02.843018 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.842991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.849331 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.849299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:15:02.849475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.849341    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:15:02.849578 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.849557    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:15:02.849695 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.849616    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:15:02.849695 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.849632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jxzxl\""
Jul 06 19:15:02.873900 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.873869    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"]
Jul 06 19:15:02.923402 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.923610 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.923610 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.923733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f41fd1e-6679-4595-8223-4fb32a7de646-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.923733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.923733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:02.923733 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:02.923701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946sj\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-kube-api-access-946sj\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.024601 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.024795 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.024795 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f41fd1e-6679-4595-8223-4fb32a7de646-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.024795 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.024795 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.024795 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946sj\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-kube-api-access-946sj\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.025042 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.024811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.025787 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.025758    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.027307 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.027278    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f41fd1e-6679-4595-8223-4fb32a7de646-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.027480 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.027457    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.027587 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.027568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.028013 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.027991    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.043400 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.043358    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-946sj\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-kube-api-access-946sj\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.043513 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.043460    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvrnr\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.126002 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.125912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc46c97e-f7d9-4ef5-82bf-123f025befcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:03.128899 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.128865    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc46c97e-f7d9-4ef5-82bf-123f025befcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-qr2wf\" (UID: \"bc46c97e-f7d9-4ef5-82bf-123f025befcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:03.156533 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.156505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:03.342016 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.341919    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"]
Jul 06 19:15:03.344352 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:15:03.344319    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f41fd1e_6679_4595_8223_4fb32a7de646.slice/crio-13b0c5f5d5c6f9bfb587b2cfd447c006dc13953841e4bbb7fe5d74dedad48385 WatchSource:0}: Error finding container 13b0c5f5d5c6f9bfb587b2cfd447c006dc13953841e4bbb7fe5d74dedad48385: Status 404 returned error can't find the container with id 13b0c5f5d5c6f9bfb587b2cfd447c006dc13953841e4bbb7fe5d74dedad48385
Jul 06 19:15:03.376587 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.376512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:03.571366 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:03.571309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qr2wf"]
Jul 06 19:15:03.574488 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:15:03.574460    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc46c97e_f7d9_4ef5_82bf_123f025befcc.slice/crio-38a63c6eff57f85657bb777789a15bc958aa62c804d65861929c5b8575130dd0 WatchSource:0}: Error finding container 38a63c6eff57f85657bb777789a15bc958aa62c804d65861929c5b8575130dd0: Status 404 returned error can't find the container with id 38a63c6eff57f85657bb777789a15bc958aa62c804d65861929c5b8575130dd0
Jul 06 19:15:04.044552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:04.044503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf" event={"ID":"bc46c97e-f7d9-4ef5-82bf-123f025befcc","Type":"ContainerStarted","Data":"38a63c6eff57f85657bb777789a15bc958aa62c804d65861929c5b8575130dd0"}
Jul 06 19:15:04.046212 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:04.046182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" event={"ID":"0f41fd1e-6679-4595-8223-4fb32a7de646","Type":"ContainerStarted","Data":"13b0c5f5d5c6f9bfb587b2cfd447c006dc13953841e4bbb7fe5d74dedad48385"}
Jul 06 19:15:06.285230 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:06.285191    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:15:06.285509 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:06.285260    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:15:07.063583 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.063546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf" event={"ID":"bc46c97e-f7d9-4ef5-82bf-123f025befcc","Type":"ContainerStarted","Data":"7565492453b60a3e4e22984afc13091ce62f6b275e6dc9295200953426160406"}
Jul 06 19:15:07.063791 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.063638    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:07.065230 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.065204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" event={"ID":"0f41fd1e-6679-4595-8223-4fb32a7de646","Type":"ContainerStarted","Data":"eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b"}
Jul 06 19:15:07.065393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.065253    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:07.066901 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.066878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw" event={"ID":"dd33939c-5cd7-430d-883d-35b6fb33eddc","Type":"ContainerStarted","Data":"9953e2daa872bc6d30fc5ef86faa06a1401d5e089dcd0b81a950edc6720ad813"}
Jul 06 19:15:07.067218 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.067196    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hvrnr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:15:07.067271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.067245    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:15:07.105239 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.105175    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf" podStartSLOduration=2.392396761 podStartE2EDuration="5.10515369s" totalImagesPullingTime="2.712756929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:07.103550834 +0000 UTC m=+566.854260093" watchObservedRunningTime="2026-07-06 19:15:07.10515369 +0000 UTC m=+566.855862937"
Jul 06 19:15:07.215068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.215010    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" podStartSLOduration=2.277089157 podStartE2EDuration="5.214990735s" totalImagesPullingTime="2.937901578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:07.145462816 +0000 UTC m=+566.896172101" watchObservedRunningTime="2026-07-06 19:15:07.214990735 +0000 UTC m=+566.965699982"
Jul 06 19:15:07.216588 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:07.216544    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-pdzbw" podStartSLOduration=1.602461841 podStartE2EDuration="6.216532921s" totalImagesPullingTime="4.61407108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:07.214769996 +0000 UTC m=+566.965479256" watchObservedRunningTime="2026-07-06 19:15:07.216532921 +0000 UTC m=+566.967242168"
Jul 06 19:15:08.072082 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:08.072052    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hvrnr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:15:08.072478 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:08.072136    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:15:11.072334 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:11.072305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:16.658611 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.658572    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"]
Jul 06 19:15:16.660982 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.660965    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"]
Jul 06 19:15:16.661096 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.661076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:16.663280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.663260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:16.667317 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.667298    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 19:15:16.668419 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.668194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qwkd9\""
Jul 06 19:15:16.670691 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:16.670654    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kserve-controller-manager-d6f4b65b8-kzv7k\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7e09dbad-5ca8-4868-9916-8e6ef4b07aae" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:16.670929 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:16.670908    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret"
Jul 06 19:15:16.671227 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:16.671209    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-hfxfh\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hfxfh\"" type="*v1.Secret"
Jul 06 19:15:16.678532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.677957    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"]
Jul 06 19:15:16.680248 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.680227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"]
Jul 06 19:15:16.752631 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.752598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:16.752776 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.752645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfgn7\" (UniqueName: \"kubernetes.io/projected/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-kube-api-access-hfgn7\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:16.752776 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.752765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bkpd\" (UniqueName: \"kubernetes.io/projected/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-kube-api-access-2bkpd\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:16.752895 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.752826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:16.853879 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.853838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkpd\" (UniqueName: \"kubernetes.io/projected/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-kube-api-access-2bkpd\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:16.854074 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.853890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:16.854074 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.853928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:16.854074 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.853946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfgn7\" (UniqueName: \"kubernetes.io/projected/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-kube-api-access-hfgn7\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:16.854074 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:16.854065    2561 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 19:15:16.854296 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:16.854156    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-cert podName:65f40ce0-2d85-4f85-93f1-aa75afcd0e73 nodeName:}" failed. No retries permitted until 2026-07-06 19:15:17.354132805 +0000 UTC m=+577.104842048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-cert") pod "llmisvc-controller-manager-777c6bd7d5-5g4cq" (UID: "65f40ce0-2d85-4f85-93f1-aa75afcd0e73") : secret "llmisvc-webhook-server-cert" not found
Jul 06 19:15:16.871348 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.871312    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfgn7\" (UniqueName: \"kubernetes.io/projected/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-kube-api-access-hfgn7\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:16.891084 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:16.891041    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bkpd\" (UniqueName: \"kubernetes.io/projected/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-kube-api-access-2bkpd\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:17.358735 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.358694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:17.361196 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.361164    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f40ce0-2d85-4f85-93f1-aa75afcd0e73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5g4cq\" (UID: \"65f40ce0-2d85-4f85-93f1-aa75afcd0e73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:17.390649 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.390620    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"]
Jul 06 19:15:17.390864 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.390825    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerName="discovery" containerID="cri-o://eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b" gracePeriod=30
Jul 06 19:15:17.581243 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.581214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:17.740123 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.740081    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:17.772599 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.772572    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"]
Jul 06 19:15:17.776313 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:15:17.776288    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65f40ce0_2d85_4f85_93f1_aa75afcd0e73.slice/crio-ef05059f1e488c265abaae71688195a302cdbc6ac8f83e06a74a9d5d68c5a315 WatchSource:0}: Error finding container ef05059f1e488c265abaae71688195a302cdbc6ac8f83e06a74a9d5d68c5a315: Status 404 returned error can't find the container with id ef05059f1e488c265abaae71688195a302cdbc6ac8f83e06a74a9d5d68c5a315
Jul 06 19:15:17.854328 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:17.854288    2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:15:17.854481 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:17.854395    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-cert podName:7e09dbad-5ca8-4868-9916-8e6ef4b07aae nodeName:}" failed. No retries permitted until 2026-07-06 19:15:18.354379305 +0000 UTC m=+578.105088531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-cert") pod "kserve-controller-manager-d6f4b65b8-kzv7k" (UID: "7e09dbad-5ca8-4868-9916-8e6ef4b07aae") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:15:17.862673 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862650    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-token\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.862801 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-ca-configmap\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.862801 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862729    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-cacerts\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.862801 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862745    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-kubeconfig\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.862801 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862768    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-946sj\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-kube-api-access-946sj\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.862801 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862787    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f41fd1e-6679-4595-8223-4fb32a7de646-local-certs\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.863042 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.862816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-dns-cert\") pod \"0f41fd1e-6679-4595-8223-4fb32a7de646\" (UID: \"0f41fd1e-6679-4595-8223-4fb32a7de646\") "
Jul 06 19:15:17.863242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.863212    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:15:17.865682 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.865649    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:15:17.865780 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.865739    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:15:17.865834 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.865768    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f41fd1e-6679-4595-8223-4fb32a7de646-local-certs" (OuterVolumeSpecName: "local-certs") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:15:17.865834 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.865778    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:15:17.865834 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.865796    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-kube-api-access-946sj" (OuterVolumeSpecName: "kube-api-access-946sj") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "kube-api-access-946sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:15:17.865834 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.865781    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-cacerts" (OuterVolumeSpecName: "cacerts") pod "0f41fd1e-6679-4595-8223-4fb32a7de646" (UID: "0f41fd1e-6679-4595-8223-4fb32a7de646"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964441    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-token\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964475    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-ca-configmap\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964491    2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-cacerts\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964499    2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-kubeconfig\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964509    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-946sj\" (UniqueName: \"kubernetes.io/projected/0f41fd1e-6679-4595-8223-4fb32a7de646-kube-api-access-946sj\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964517    2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f41fd1e-6679-4595-8223-4fb32a7de646-local-certs\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:17.964531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:17.964525    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0f41fd1e-6679-4595-8223-4fb32a7de646-istio-csr-dns-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:15:18.075884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.075851    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qr2wf"
Jul 06 19:15:18.117667 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.117633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" event={"ID":"65f40ce0-2d85-4f85-93f1-aa75afcd0e73","Type":"ContainerStarted","Data":"ef05059f1e488c265abaae71688195a302cdbc6ac8f83e06a74a9d5d68c5a315"}
Jul 06 19:15:18.118839 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.118810    2561 generic.go:356] "Generic (PLEG): container finished" podID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerID="eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b" exitCode=0
Jul 06 19:15:18.118967 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.118856    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"
Jul 06 19:15:18.118967 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.118897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" event={"ID":"0f41fd1e-6679-4595-8223-4fb32a7de646","Type":"ContainerDied","Data":"eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b"}
Jul 06 19:15:18.118967 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.118951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr" event={"ID":"0f41fd1e-6679-4595-8223-4fb32a7de646","Type":"ContainerDied","Data":"13b0c5f5d5c6f9bfb587b2cfd447c006dc13953841e4bbb7fe5d74dedad48385"}
Jul 06 19:15:18.119145 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.118978    2561 scope.go:117] "RemoveContainer" containerID="eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b"
Jul 06 19:15:18.128078 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.128057    2561 scope.go:117] "RemoveContainer" containerID="eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b"
Jul 06 19:15:18.128369 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:15:18.128343    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b\": container with ID starting with eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b not found: ID does not exist" containerID="eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b"
Jul 06 19:15:18.128450 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.128390    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b"} err="failed to get container status \"eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b\": rpc error: code = NotFound desc = could not find container \"eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b\": container with ID starting with eea8637bc4e1a6226ce9ea33cc8bf42a35ebca5cc3677fabd34c45a4755d3f0b not found: ID does not exist"
Jul 06 19:15:18.171190 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.171166    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 19:15:18.180460 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.180437    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"]
Jul 06 19:15:18.188890 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.188862    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvrnr"]
Jul 06 19:15:18.234459 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.234434    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hfxfh\""
Jul 06 19:15:18.369321 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.369283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:18.372233 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.372209    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e09dbad-5ca8-4868-9916-8e6ef4b07aae-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzv7k\" (UID: \"7e09dbad-5ca8-4868-9916-8e6ef4b07aae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:18.472838 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.472806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:18.772061 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.772023    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"]
Jul 06 19:15:18.801757 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:15:18.801727    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e09dbad_5ca8_4868_9916_8e6ef4b07aae.slice/crio-7f7a7930b87488b91f1512050b8d21374277ed637f023741e7ed2b327c68c0a1 WatchSource:0}: Error finding container 7f7a7930b87488b91f1512050b8d21374277ed637f023741e7ed2b327c68c0a1: Status 404 returned error can't find the container with id 7f7a7930b87488b91f1512050b8d21374277ed637f023741e7ed2b327c68c0a1
Jul 06 19:15:18.883627 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:18.883548    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" path="/var/lib/kubelet/pods/0f41fd1e-6679-4595-8223-4fb32a7de646/volumes"
Jul 06 19:15:19.125990 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:19.125952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" event={"ID":"7e09dbad-5ca8-4868-9916-8e6ef4b07aae","Type":"ContainerStarted","Data":"7f7a7930b87488b91f1512050b8d21374277ed637f023741e7ed2b327c68c0a1"}
Jul 06 19:15:21.137608 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:21.137572    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" event={"ID":"65f40ce0-2d85-4f85-93f1-aa75afcd0e73","Type":"ContainerStarted","Data":"48908b955ee6f175dabc1f73b1ca16f4a58340ff06836c90e2864f4e77f8599e"}
Jul 06 19:15:21.137958 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:21.137700    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:21.196006 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:21.195962    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" podStartSLOduration=2.607167228 podStartE2EDuration="5.195947133s" totalImagesPullingTime="2.588779905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:21.19340836 +0000 UTC m=+580.944117635" watchObservedRunningTime="2026-07-06 19:15:21.195947133 +0000 UTC m=+580.946656420"
Jul 06 19:15:22.144181 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:22.144141    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" event={"ID":"7e09dbad-5ca8-4868-9916-8e6ef4b07aae","Type":"ContainerStarted","Data":"2d0343a43fc78e221672c7a6a42857a91d8fa259c91da4ea8c82c1eceed6d39f"}
Jul 06 19:15:22.144597 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:22.144361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:15:22.289897 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:22.289842    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" podStartSLOduration=3.930529607 podStartE2EDuration="6.289823498s" totalImagesPullingTime="2.359293891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:22.27853813 +0000 UTC m=+582.029247376" watchObservedRunningTime="2026-07-06 19:15:22.289823498 +0000 UTC m=+582.040532745"
Jul 06 19:15:40.704028 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:40.703996    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:15:40.704542 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:40.704237    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:15:52.146598 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:52.146564    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:15:53.154589 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:15:53.154561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:16:01.778928 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.778849    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dmqsf"]
Jul 06 19:16:01.779352 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.779336    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerName="discovery"
Jul 06 19:16:01.779395 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.779357    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerName="discovery"
Jul 06 19:16:01.779474 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.779463    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f41fd1e-6679-4595-8223-4fb32a7de646" containerName="discovery"
Jul 06 19:16:01.781567 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.781549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:01.785237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.785211    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:16:01.787574 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.787554    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-b9q85\""
Jul 06 19:16:01.788624 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.788294    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:16:01.807696 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.807671    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dmqsf"]
Jul 06 19:16:01.840277 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.840242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrk5c\" (UniqueName: \"kubernetes.io/projected/a59de494-99b7-4e6c-afdf-5e074ef83545-kube-api-access-wrk5c\") pod \"kuadrant-operator-catalog-dmqsf\" (UID: \"a59de494-99b7-4e6c-afdf-5e074ef83545\") " pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:01.941366 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.941329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrk5c\" (UniqueName: \"kubernetes.io/projected/a59de494-99b7-4e6c-afdf-5e074ef83545-kube-api-access-wrk5c\") pod \"kuadrant-operator-catalog-dmqsf\" (UID: \"a59de494-99b7-4e6c-afdf-5e074ef83545\") " pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:01.954533 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:01.954501    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrk5c\" (UniqueName: \"kubernetes.io/projected/a59de494-99b7-4e6c-afdf-5e074ef83545-kube-api-access-wrk5c\") pod \"kuadrant-operator-catalog-dmqsf\" (UID: \"a59de494-99b7-4e6c-afdf-5e074ef83545\") " pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:02.083073 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.082986    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dmqsf"]
Jul 06 19:16:02.083309 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.083294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:02.232199 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.232166    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dmqsf"]
Jul 06 19:16:02.236889 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:02.236862    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59de494_99b7_4e6c_afdf_5e074ef83545.slice/crio-07df2a41a7de6aa057e4e93f513ba81b7f099e02f1f98ae1f132ac78dc7a7ad8 WatchSource:0}: Error finding container 07df2a41a7de6aa057e4e93f513ba81b7f099e02f1f98ae1f132ac78dc7a7ad8: Status 404 returned error can't find the container with id 07df2a41a7de6aa057e4e93f513ba81b7f099e02f1f98ae1f132ac78dc7a7ad8
Jul 06 19:16:02.300647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.300614    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brpw5"]
Jul 06 19:16:02.306952 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.306924    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:02.329930 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.329903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf" event={"ID":"a59de494-99b7-4e6c-afdf-5e074ef83545","Type":"ContainerStarted","Data":"07df2a41a7de6aa057e4e93f513ba81b7f099e02f1f98ae1f132ac78dc7a7ad8"}
Jul 06 19:16:02.330913 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.330890    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brpw5"]
Jul 06 19:16:02.345331 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.345281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hkpg\" (UniqueName: \"kubernetes.io/projected/2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7-kube-api-access-9hkpg\") pod \"kuadrant-operator-catalog-brpw5\" (UID: \"2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7\") " pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:02.446479 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.446441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hkpg\" (UniqueName: \"kubernetes.io/projected/2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7-kube-api-access-9hkpg\") pod \"kuadrant-operator-catalog-brpw5\" (UID: \"2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7\") " pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:02.461304 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.461271    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hkpg\" (UniqueName: \"kubernetes.io/projected/2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7-kube-api-access-9hkpg\") pod \"kuadrant-operator-catalog-brpw5\" (UID: \"2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7\") " pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:02.616451 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.616366    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:02.770799 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:02.770774    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brpw5"]
Jul 06 19:16:02.802787 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:02.802747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3a8213_ecd4_4885_a3e0_3cab0c1d29d7.slice/crio-74d7e18f1b1ba9007f495c5e872fbc9176016a3016a3a1706620ce80c83586e0 WatchSource:0}: Error finding container 74d7e18f1b1ba9007f495c5e872fbc9176016a3016a3a1706620ce80c83586e0: Status 404 returned error can't find the container with id 74d7e18f1b1ba9007f495c5e872fbc9176016a3016a3a1706620ce80c83586e0
Jul 06 19:16:03.335637 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:03.335603    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brpw5" event={"ID":"2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7","Type":"ContainerStarted","Data":"74d7e18f1b1ba9007f495c5e872fbc9176016a3016a3a1706620ce80c83586e0"}
Jul 06 19:16:04.342886 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.342568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brpw5" event={"ID":"2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7","Type":"ContainerStarted","Data":"1708bdea176db009cbe4f1f79e8b5a917613fe0c88d17c9426646172c920ec1c"}
Jul 06 19:16:04.344186 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.344164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf" event={"ID":"a59de494-99b7-4e6c-afdf-5e074ef83545","Type":"ContainerStarted","Data":"38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106"}
Jul 06 19:16:04.344302 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.344245    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf" podUID="a59de494-99b7-4e6c-afdf-5e074ef83545" containerName="registry-server" containerID="cri-o://38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106" gracePeriod=2
Jul 06 19:16:04.410325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.410276    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-brpw5" podStartSLOduration=1.220655432 podStartE2EDuration="2.410260034s" totalImagesPullingTime="1.189604602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:04.387614058 +0000 UTC m=+624.138323305" watchObservedRunningTime="2026-07-06 19:16:04.410260034 +0000 UTC m=+624.160969280"
Jul 06 19:16:04.411826 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.411786    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf" podStartSLOduration=1.656740347 podStartE2EDuration="3.4117728s" totalImagesPullingTime="1.755032453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:04.409557178 +0000 UTC m=+624.160266438" watchObservedRunningTime="2026-07-06 19:16:04.4117728 +0000 UTC m=+624.162482046"
Jul 06 19:16:04.584607 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.584583    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:04.670340 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.670261    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrk5c\" (UniqueName: \"kubernetes.io/projected/a59de494-99b7-4e6c-afdf-5e074ef83545-kube-api-access-wrk5c\") pod \"a59de494-99b7-4e6c-afdf-5e074ef83545\" (UID: \"a59de494-99b7-4e6c-afdf-5e074ef83545\") "
Jul 06 19:16:04.672546 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.672519    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59de494-99b7-4e6c-afdf-5e074ef83545-kube-api-access-wrk5c" (OuterVolumeSpecName: "kube-api-access-wrk5c") pod "a59de494-99b7-4e6c-afdf-5e074ef83545" (UID: "a59de494-99b7-4e6c-afdf-5e074ef83545"). InnerVolumeSpecName "kube-api-access-wrk5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:04.771080 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:04.771048    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrk5c\" (UniqueName: \"kubernetes.io/projected/a59de494-99b7-4e6c-afdf-5e074ef83545-kube-api-access-wrk5c\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:16:05.350076 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.349982    2561 generic.go:356] "Generic (PLEG): container finished" podID="a59de494-99b7-4e6c-afdf-5e074ef83545" containerID="38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106" exitCode=0
Jul 06 19:16:05.350076 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.350031    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf"
Jul 06 19:16:05.350596 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.350069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf" event={"ID":"a59de494-99b7-4e6c-afdf-5e074ef83545","Type":"ContainerDied","Data":"38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106"}
Jul 06 19:16:05.350596 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.350172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dmqsf" event={"ID":"a59de494-99b7-4e6c-afdf-5e074ef83545","Type":"ContainerDied","Data":"07df2a41a7de6aa057e4e93f513ba81b7f099e02f1f98ae1f132ac78dc7a7ad8"}
Jul 06 19:16:05.350596 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.350206    2561 scope.go:117] "RemoveContainer" containerID="38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106"
Jul 06 19:16:05.359060 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.359045    2561 scope.go:117] "RemoveContainer" containerID="38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106"
Jul 06 19:16:05.359342 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:05.359321    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106\": container with ID starting with 38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106 not found: ID does not exist" containerID="38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106"
Jul 06 19:16:05.359393 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.359356    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106"} err="failed to get container status \"38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106\": rpc error: code = NotFound desc = could not find container \"38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106\": container with ID starting with 38751ea88a049b13cbf5c1a12dde03b1f76924fde2f1f1a5083348f49f7e3106 not found: ID does not exist"
Jul 06 19:16:05.378684 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.378661    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dmqsf"]
Jul 06 19:16:05.381261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:05.381240    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dmqsf"]
Jul 06 19:16:06.881993 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:06.881962    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59de494-99b7-4e6c-afdf-5e074ef83545" path="/var/lib/kubelet/pods/a59de494-99b7-4e6c-afdf-5e074ef83545/volumes"
Jul 06 19:16:12.617500 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:12.617460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:12.618141 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:12.617544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:12.640018 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:12.639983    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:13.407345 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:13.407314    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-brpw5"
Jul 06 19:16:29.063282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.063246    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"]
Jul 06 19:16:29.063675 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.063571    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59de494-99b7-4e6c-afdf-5e074ef83545" containerName="registry-server"
Jul 06 19:16:29.063675 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.063582    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59de494-99b7-4e6c-afdf-5e074ef83545" containerName="registry-server"
Jul 06 19:16:29.063675 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.063654    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59de494-99b7-4e6c-afdf-5e074ef83545" containerName="registry-server"
Jul 06 19:16:29.069548 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.069519    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:29.072810 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.072789    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:16:29.072899 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.072854    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xnkl5\""
Jul 06 19:16:29.101179 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.101156    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"]
Jul 06 19:16:29.184917 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.184883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfm64\" (UniqueName: \"kubernetes.io/projected/b2d06e2c-16da-4916-8be3-18f88584302b-kube-api-access-cfm64\") pod \"dns-operator-controller-manager-864dd78c4c-7sfs2\" (UID: \"b2d06e2c-16da-4916-8be3-18f88584302b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:29.286257 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.286220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfm64\" (UniqueName: \"kubernetes.io/projected/b2d06e2c-16da-4916-8be3-18f88584302b-kube-api-access-cfm64\") pod \"dns-operator-controller-manager-864dd78c4c-7sfs2\" (UID: \"b2d06e2c-16da-4916-8be3-18f88584302b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:29.302828 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.302790    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfm64\" (UniqueName: \"kubernetes.io/projected/b2d06e2c-16da-4916-8be3-18f88584302b-kube-api-access-cfm64\") pod \"dns-operator-controller-manager-864dd78c4c-7sfs2\" (UID: \"b2d06e2c-16da-4916-8be3-18f88584302b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:29.379464 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.379381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:29.539510 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:29.539485    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"]
Jul 06 19:16:29.541910 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:29.541880    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d06e2c_16da_4916_8be3_18f88584302b.slice/crio-8e811df6b5c13e570f0eaac33b890361432145cf011adce7f410be622d87c9cb WatchSource:0}: Error finding container 8e811df6b5c13e570f0eaac33b890361432145cf011adce7f410be622d87c9cb: Status 404 returned error can't find the container with id 8e811df6b5c13e570f0eaac33b890361432145cf011adce7f410be622d87c9cb
Jul 06 19:16:30.469050 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:30.468985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" event={"ID":"b2d06e2c-16da-4916-8be3-18f88584302b","Type":"ContainerStarted","Data":"8e811df6b5c13e570f0eaac33b890361432145cf011adce7f410be622d87c9cb"}
Jul 06 19:16:32.481729 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:32.481696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" event={"ID":"b2d06e2c-16da-4916-8be3-18f88584302b","Type":"ContainerStarted","Data":"4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f"}
Jul 06 19:16:32.482102 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:32.481820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:32.525197 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:32.525141    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" podStartSLOduration=1.417693259 podStartE2EDuration="3.525124581s" totalImagesPullingTime="2.107431322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:32.523210172 +0000 UTC m=+652.273919449" watchObservedRunningTime="2026-07-06 19:16:32.525124581 +0000 UTC m=+652.275833820"
Jul 06 19:16:34.584589 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.584551    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"]
Jul 06 19:16:34.588184 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.588164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.591461 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.591438    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k5svr\""
Jul 06 19:16:34.621018 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.620985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"]
Jul 06 19:16:34.626772 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.626744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v54w8\" (UniqueName: \"kubernetes.io/projected/d597f568-536a-4c64-ab3f-d5acc0bd39a7-kube-api-access-v54w8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.626902 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.626817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d597f568-536a-4c64-ab3f-d5acc0bd39a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.727884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.727847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d597f568-536a-4c64-ab3f-d5acc0bd39a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.728060 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.727930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v54w8\" (UniqueName: \"kubernetes.io/projected/d597f568-536a-4c64-ab3f-d5acc0bd39a7-kube-api-access-v54w8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.728258 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.728236    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d597f568-536a-4c64-ab3f-d5acc0bd39a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.739841 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.739819    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v54w8\" (UniqueName: \"kubernetes.io/projected/d597f568-536a-4c64-ab3f-d5acc0bd39a7-kube-api-access-v54w8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:34.898506 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:34.898429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:35.047908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:35.047875    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"]
Jul 06 19:16:35.049760 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:35.049732    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd597f568_536a_4c64_ab3f_d5acc0bd39a7.slice/crio-0a9010ea2182ea5ba145f3650f8c974472d0aed45ef488b0acab978a50ade924 WatchSource:0}: Error finding container 0a9010ea2182ea5ba145f3650f8c974472d0aed45ef488b0acab978a50ade924: Status 404 returned error can't find the container with id 0a9010ea2182ea5ba145f3650f8c974472d0aed45ef488b0acab978a50ade924
Jul 06 19:16:35.497229 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:35.497198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74" event={"ID":"d597f568-536a-4c64-ab3f-d5acc0bd39a7","Type":"ContainerStarted","Data":"0a9010ea2182ea5ba145f3650f8c974472d0aed45ef488b0acab978a50ade924"}
Jul 06 19:16:37.285562 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.285518    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"]
Jul 06 19:16:37.288746 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.288729    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:37.291862 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.291840    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kp6pc\""
Jul 06 19:16:37.307536 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.307475    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"]
Jul 06 19:16:37.357893 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.357859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxskm\" (UniqueName: \"kubernetes.io/projected/7f41d41a-4046-42a3-9807-e6e95ffdb651-kube-api-access-wxskm\") pod \"limitador-operator-controller-manager-859d7b78bd-dvd84\" (UID: \"7f41d41a-4046-42a3-9807-e6e95ffdb651\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:37.458241 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.458209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxskm\" (UniqueName: \"kubernetes.io/projected/7f41d41a-4046-42a3-9807-e6e95ffdb651-kube-api-access-wxskm\") pod \"limitador-operator-controller-manager-859d7b78bd-dvd84\" (UID: \"7f41d41a-4046-42a3-9807-e6e95ffdb651\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:37.488895 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.488858    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxskm\" (UniqueName: \"kubernetes.io/projected/7f41d41a-4046-42a3-9807-e6e95ffdb651-kube-api-access-wxskm\") pod \"limitador-operator-controller-manager-859d7b78bd-dvd84\" (UID: \"7f41d41a-4046-42a3-9807-e6e95ffdb651\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:37.599148 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.599052    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:37.749895 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:37.749869    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"]
Jul 06 19:16:37.751024 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:37.750996    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f41d41a_4046_42a3_9807_e6e95ffdb651.slice/crio-e78069f61304ca5b818af447b75181c78c4277c289120e1e61653f02c3dad958 WatchSource:0}: Error finding container e78069f61304ca5b818af447b75181c78c4277c289120e1e61653f02c3dad958: Status 404 returned error can't find the container with id e78069f61304ca5b818af447b75181c78c4277c289120e1e61653f02c3dad958
Jul 06 19:16:38.513631 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:38.513594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84" event={"ID":"7f41d41a-4046-42a3-9807-e6e95ffdb651","Type":"ContainerStarted","Data":"e78069f61304ca5b818af447b75181c78c4277c289120e1e61653f02c3dad958"}
Jul 06 19:16:40.527036 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:40.526997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84" event={"ID":"7f41d41a-4046-42a3-9807-e6e95ffdb651","Type":"ContainerStarted","Data":"952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674"}
Jul 06 19:16:40.527499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:40.527134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:40.528784 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:40.528756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74" event={"ID":"d597f568-536a-4c64-ab3f-d5acc0bd39a7","Type":"ContainerStarted","Data":"553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2"}
Jul 06 19:16:40.528915 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:40.528895    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:40.564230 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:40.564176    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84" podStartSLOduration=0.969089949 podStartE2EDuration="3.564157947s" totalImagesPullingTime="2.595067998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:40.563290881 +0000 UTC m=+660.314000140" watchObservedRunningTime="2026-07-06 19:16:40.564157947 +0000 UTC m=+660.314867195"
Jul 06 19:16:40.622519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:40.622416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74" podStartSLOduration=1.357489348 podStartE2EDuration="6.622399867s" totalImagesPullingTime="5.264910519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:40.622174021 +0000 UTC m=+660.372883294" watchObservedRunningTime="2026-07-06 19:16:40.622399867 +0000 UTC m=+660.373109113"
Jul 06 19:16:41.216205 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.216168    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"]
Jul 06 19:16:41.221042 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.221021    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:41.224383 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.224363    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xphvm\""
Jul 06 19:16:41.248280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.248253    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"]
Jul 06 19:16:41.288274 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.288248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xwj5\" (UniqueName: \"kubernetes.io/projected/2a2df57b-2e9d-48f3-be07-beb5631b6e68-kube-api-access-9xwj5\") pod \"authorino-operator-75cc8d5cb7-bjrd7\" (UID: \"2a2df57b-2e9d-48f3-be07-beb5631b6e68\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:41.389467 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.389436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xwj5\" (UniqueName: \"kubernetes.io/projected/2a2df57b-2e9d-48f3-be07-beb5631b6e68-kube-api-access-9xwj5\") pod \"authorino-operator-75cc8d5cb7-bjrd7\" (UID: \"2a2df57b-2e9d-48f3-be07-beb5631b6e68\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:41.404425 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.404403    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xwj5\" (UniqueName: \"kubernetes.io/projected/2a2df57b-2e9d-48f3-be07-beb5631b6e68-kube-api-access-9xwj5\") pod \"authorino-operator-75cc8d5cb7-bjrd7\" (UID: \"2a2df57b-2e9d-48f3-be07-beb5631b6e68\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:41.531449 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.531413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:41.682760 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:41.682731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"]
Jul 06 19:16:41.685349 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:41.685325    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2df57b_2e9d_48f3_be07_beb5631b6e68.slice/crio-ff16fdb70e995ca7954ee7649aeb8239c7b1d00e5ebb6a85b99f6bb1410a65d4 WatchSource:0}: Error finding container ff16fdb70e995ca7954ee7649aeb8239c7b1d00e5ebb6a85b99f6bb1410a65d4: Status 404 returned error can't find the container with id ff16fdb70e995ca7954ee7649aeb8239c7b1d00e5ebb6a85b99f6bb1410a65d4
Jul 06 19:16:42.543353 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:42.543316    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7" event={"ID":"2a2df57b-2e9d-48f3-be07-beb5631b6e68","Type":"ContainerStarted","Data":"ff16fdb70e995ca7954ee7649aeb8239c7b1d00e5ebb6a85b99f6bb1410a65d4"}
Jul 06 19:16:43.488506 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.488471    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:16:43.615879 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.615845    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"]
Jul 06 19:16:43.621563 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.621520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.626372 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.626344    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 19:16:43.626552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.626425    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btkqm\""
Jul 06 19:16:43.626975 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.626956    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 19:16:43.636932 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.636908    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"]
Jul 06 19:16:43.707494 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.707459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.707671 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.707545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nwj\" (UniqueName: \"kubernetes.io/projected/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-kube-api-access-j4nwj\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.707671 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.707593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.808034 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.807951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nwj\" (UniqueName: \"kubernetes.io/projected/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-kube-api-access-j4nwj\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.808034 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.808021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.808296 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.808063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.808866 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.808830    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.811097 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.811036    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.823838 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.823804    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nwj\" (UniqueName: \"kubernetes.io/projected/e713d344-2474-4be0-b4c4-7a9d5aef2bd7-kube-api-access-j4nwj\") pod \"kuadrant-console-plugin-66b5774985-689q6\" (UID: \"e713d344-2474-4be0-b4c4-7a9d5aef2bd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:43.936451 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:43.936412    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"
Jul 06 19:16:44.167129 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.167088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-689q6"]
Jul 06 19:16:44.169036 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:44.169010    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode713d344_2474_4be0_b4c4_7a9d5aef2bd7.slice/crio-f145b0c7a1b9c1aca62027a86ef748aa6ed19cd64de8c8aca1baf2fb7ffba67a WatchSource:0}: Error finding container f145b0c7a1b9c1aca62027a86ef748aa6ed19cd64de8c8aca1baf2fb7ffba67a: Status 404 returned error can't find the container with id f145b0c7a1b9c1aca62027a86ef748aa6ed19cd64de8c8aca1baf2fb7ffba67a
Jul 06 19:16:44.468213 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.468136    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66b4dbf4cb-4tkdf"]
Jul 06 19:16:44.471852 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.471836    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.500684 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.500654    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b4dbf4cb-4tkdf"]
Jul 06 19:16:44.512000 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.511970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pjlh\" (UniqueName: \"kubernetes.io/projected/1fb20209-4284-4baa-9220-72f596d2b412-kube-api-access-4pjlh\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.512196 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.512013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-trusted-ca-bundle\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.512196 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.512137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb20209-4284-4baa-9220-72f596d2b412-console-serving-cert\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.512196 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.512174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-oauth-serving-cert\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.512379 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.512200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-console-config\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.512379 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.512285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-service-ca\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.512485 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.512426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb20209-4284-4baa-9220-72f596d2b412-console-oauth-config\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.555851 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.555816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7" event={"ID":"2a2df57b-2e9d-48f3-be07-beb5631b6e68","Type":"ContainerStarted","Data":"c484bbbeb281a3c65a393e7e30b001748cfffb99a4db95b1bd5d879160b6e841"}
Jul 06 19:16:44.556024 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.555885    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:44.557008 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.556984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6" event={"ID":"e713d344-2474-4be0-b4c4-7a9d5aef2bd7","Type":"ContainerStarted","Data":"f145b0c7a1b9c1aca62027a86ef748aa6ed19cd64de8c8aca1baf2fb7ffba67a"}
Jul 06 19:16:44.581945 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.581902    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7" podStartSLOduration=1.23414398 podStartE2EDuration="3.581886415s" totalImagesPullingTime="2.347742435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:44.580787328 +0000 UTC m=+664.331496575" watchObservedRunningTime="2026-07-06 19:16:44.581886415 +0000 UTC m=+664.332595662"
Jul 06 19:16:44.613489 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb20209-4284-4baa-9220-72f596d2b412-console-oauth-config\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.613655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pjlh\" (UniqueName: \"kubernetes.io/projected/1fb20209-4284-4baa-9220-72f596d2b412-kube-api-access-4pjlh\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.613655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-trusted-ca-bundle\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.613655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb20209-4284-4baa-9220-72f596d2b412-console-serving-cert\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.613655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-oauth-serving-cert\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.613655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-console-config\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.613923 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.613674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-service-ca\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.614471 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.614445    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-console-config\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.614564 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.614449    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-oauth-serving-cert\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.614887 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.614863    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-service-ca\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.615181 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.615160    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb20209-4284-4baa-9220-72f596d2b412-trusted-ca-bundle\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.616043 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.616027    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb20209-4284-4baa-9220-72f596d2b412-console-serving-cert\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.616305 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.616137    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb20209-4284-4baa-9220-72f596d2b412-console-oauth-config\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.628080 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.628058    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pjlh\" (UniqueName: \"kubernetes.io/projected/1fb20209-4284-4baa-9220-72f596d2b412-kube-api-access-4pjlh\") pod \"console-66b4dbf4cb-4tkdf\" (UID: \"1fb20209-4284-4baa-9220-72f596d2b412\") " pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.783686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.783646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:44.955454 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:44.955425    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b4dbf4cb-4tkdf"]
Jul 06 19:16:44.956630 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:16:44.956599    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb20209_4284_4baa_9220_72f596d2b412.slice/crio-02004242b128b743ae7a0c2cf9fd83fdaa92f1194b154da300910cb2be72bbd8 WatchSource:0}: Error finding container 02004242b128b743ae7a0c2cf9fd83fdaa92f1194b154da300910cb2be72bbd8: Status 404 returned error can't find the container with id 02004242b128b743ae7a0c2cf9fd83fdaa92f1194b154da300910cb2be72bbd8
Jul 06 19:16:45.564647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:45.564607    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b4dbf4cb-4tkdf" event={"ID":"1fb20209-4284-4baa-9220-72f596d2b412","Type":"ContainerStarted","Data":"34bfd07cee3172aafafe1dd5cc8acbe5798f9ae9453614acbc8dfd54258be62c"}
Jul 06 19:16:45.564837 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:45.564660    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b4dbf4cb-4tkdf" event={"ID":"1fb20209-4284-4baa-9220-72f596d2b412","Type":"ContainerStarted","Data":"02004242b128b743ae7a0c2cf9fd83fdaa92f1194b154da300910cb2be72bbd8"}
Jul 06 19:16:45.598666 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:45.598606    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66b4dbf4cb-4tkdf" podStartSLOduration=1.598583802 podStartE2EDuration="1.598583802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:45.597379589 +0000 UTC m=+665.348088904" watchObservedRunningTime="2026-07-06 19:16:45.598583802 +0000 UTC m=+665.349293050"
Jul 06 19:16:51.535943 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:51.535902    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:51.536410 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:51.536046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.042704 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.042668    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"]
Jul 06 19:16:54.043137 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.042855    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" containerName="manager" containerID="cri-o://553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2" gracePeriod=2
Jul 06 19:16:54.057341 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.057310    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"]
Jul 06 19:16:54.079732 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.079609    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"]
Jul 06 19:16:54.080396 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.080323    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" containerName="manager" containerID="cri-o://952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674" gracePeriod=2
Jul 06 19:16:54.084544 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.084415    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.093641 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.093582    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"]
Jul 06 19:16:54.160254 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160222    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"]
Jul 06 19:16:54.160736 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160722    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" containerName="manager"
Jul 06 19:16:54.160808 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160740    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" containerName="manager"
Jul 06 19:16:54.160808 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160770    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" containerName="manager"
Jul 06 19:16:54.160808 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160778    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" containerName="manager"
Jul 06 19:16:54.160960 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160862    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" containerName="manager"
Jul 06 19:16:54.160960 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.160875    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" containerName="manager"
Jul 06 19:16:54.164094 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.164070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.176312 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.176271    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.178396 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.178334    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"]
Jul 06 19:16:54.180045 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.180019    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.182222 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.182197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:16:54.201361 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.201335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vkvd\" (UniqueName: \"kubernetes.io/projected/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-kube-api-access-4vkvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5sqn\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.201361 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.201379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5sqn\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.211023 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.210897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"]
Jul 06 19:16:54.227066 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.227028    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"]
Jul 06 19:16:54.260590 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.260557    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.262975 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.262938    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.302844 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.302774    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vkvd\" (UniqueName: \"kubernetes.io/projected/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-kube-api-access-4vkvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5sqn\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.302844 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.302832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5sqn\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.303033 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.302916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdshr\" (UniqueName: \"kubernetes.io/projected/be5d3c9b-b186-46f6-8b4c-938dd7f942de-kube-api-access-bdshr\") pod \"limitador-operator-controller-manager-859d7b78bd-lmgkb\" (UID: \"be5d3c9b-b186-46f6-8b4c-938dd7f942de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:16:54.303339 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.303314    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5sqn\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.323019 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.322993    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vkvd\" (UniqueName: \"kubernetes.io/projected/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-kube-api-access-4vkvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5sqn\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.351019 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.351000    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.353144 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.353128    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.356438 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.356417    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.358444 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.358421    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.361076 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.361058    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.364810 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.364790    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.404052 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.404026    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxskm\" (UniqueName: \"kubernetes.io/projected/7f41d41a-4046-42a3-9807-e6e95ffdb651-kube-api-access-wxskm\") pod \"7f41d41a-4046-42a3-9807-e6e95ffdb651\" (UID: \"7f41d41a-4046-42a3-9807-e6e95ffdb651\") "
Jul 06 19:16:54.404193 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.404073    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v54w8\" (UniqueName: \"kubernetes.io/projected/d597f568-536a-4c64-ab3f-d5acc0bd39a7-kube-api-access-v54w8\") pod \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") "
Jul 06 19:16:54.404193 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.404174    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d597f568-536a-4c64-ab3f-d5acc0bd39a7-extensions-socket-volume\") pod \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\" (UID: \"d597f568-536a-4c64-ab3f-d5acc0bd39a7\") "
Jul 06 19:16:54.404459 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.404440    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdshr\" (UniqueName: \"kubernetes.io/projected/be5d3c9b-b186-46f6-8b4c-938dd7f942de-kube-api-access-bdshr\") pod \"limitador-operator-controller-manager-859d7b78bd-lmgkb\" (UID: \"be5d3c9b-b186-46f6-8b4c-938dd7f942de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:16:54.405614 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.405569    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d597f568-536a-4c64-ab3f-d5acc0bd39a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d597f568-536a-4c64-ab3f-d5acc0bd39a7" (UID: "d597f568-536a-4c64-ab3f-d5acc0bd39a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:54.407315 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.407265    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d597f568-536a-4c64-ab3f-d5acc0bd39a7-kube-api-access-v54w8" (OuterVolumeSpecName: "kube-api-access-v54w8") pod "d597f568-536a-4c64-ab3f-d5acc0bd39a7" (UID: "d597f568-536a-4c64-ab3f-d5acc0bd39a7"). InnerVolumeSpecName "kube-api-access-v54w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:54.407404 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.407371    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f41d41a-4046-42a3-9807-e6e95ffdb651-kube-api-access-wxskm" (OuterVolumeSpecName: "kube-api-access-wxskm") pod "7f41d41a-4046-42a3-9807-e6e95ffdb651" (UID: "7f41d41a-4046-42a3-9807-e6e95ffdb651"). InnerVolumeSpecName "kube-api-access-wxskm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:54.424826 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.424800    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdshr\" (UniqueName: \"kubernetes.io/projected/be5d3c9b-b186-46f6-8b4c-938dd7f942de-kube-api-access-bdshr\") pod \"limitador-operator-controller-manager-859d7b78bd-lmgkb\" (UID: \"be5d3c9b-b186-46f6-8b4c-938dd7f942de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:16:54.476241 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.476209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:16:54.495664 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.495637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:16:54.506040 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.506006    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v54w8\" (UniqueName: \"kubernetes.io/projected/d597f568-536a-4c64-ab3f-d5acc0bd39a7-kube-api-access-v54w8\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:16:54.506040 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.506036    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d597f568-536a-4c64-ab3f-d5acc0bd39a7-extensions-socket-volume\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:16:54.506199 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.506052    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxskm\" (UniqueName: \"kubernetes.io/projected/7f41d41a-4046-42a3-9807-e6e95ffdb651-kube-api-access-wxskm\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:16:54.627647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.627493    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f41d41a-4046-42a3-9807-e6e95ffdb651" containerID="952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674" exitCode=0
Jul 06 19:16:54.627647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.627556    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.627647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.627591    2561 scope.go:117] "RemoveContainer" containerID="952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674"
Jul 06 19:16:54.630735 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.630701    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.635736 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.634715    2561 generic.go:356] "Generic (PLEG): container finished" podID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" containerID="553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2" exitCode=0
Jul 06 19:16:54.635736 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.634900    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.639975 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.639761    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.643988 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.643958    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.646731 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.646702    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.652389 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.652357    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.660869 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.660683    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.662741 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.662712    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.663051 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.663025    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"]
Jul 06 19:16:54.665222 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.665198    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.684485 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.684374    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"]
Jul 06 19:16:54.784011 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.783972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:54.784227 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.784051    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:54.789519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.789492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:54.831354 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.831252    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncn74\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncn74"
Jul 06 19:16:54.835461 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:16:54.835423    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvd84\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvd84"
Jul 06 19:16:54.885735 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.885160    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f41d41a-4046-42a3-9807-e6e95ffdb651" path="/var/lib/kubelet/pods/7f41d41a-4046-42a3-9807-e6e95ffdb651/volumes"
Jul 06 19:16:54.885735 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:54.885591    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d597f568-536a-4c64-ab3f-d5acc0bd39a7" path="/var/lib/kubelet/pods/d597f568-536a-4c64-ab3f-d5acc0bd39a7/volumes"
Jul 06 19:16:55.526351 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.526311    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"]
Jul 06 19:16:55.535740 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.535708    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.560364 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.560337    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"]
Jul 06 19:16:55.567226 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.567194    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:16:55.617198 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.617159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4rk\" (UniqueName: \"kubernetes.io/projected/6ffde4c1-5af1-441f-9736-91e917f877ab-kube-api-access-gl4rk\") pod \"kuadrant-operator-controller-manager-86878c769f-fz5kr\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.617360 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.617333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ffde4c1-5af1-441f-9736-91e917f877ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fz5kr\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.651689 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.650210    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66b4dbf4cb-4tkdf"
Jul 06 19:16:55.718925 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.718860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ffde4c1-5af1-441f-9736-91e917f877ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fz5kr\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.719149 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.718969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4rk\" (UniqueName: \"kubernetes.io/projected/6ffde4c1-5af1-441f-9736-91e917f877ab-kube-api-access-gl4rk\") pod \"kuadrant-operator-controller-manager-86878c769f-fz5kr\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.719503 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.719475    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ffde4c1-5af1-441f-9736-91e917f877ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fz5kr\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.732865 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.732841    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4rk\" (UniqueName: \"kubernetes.io/projected/6ffde4c1-5af1-441f-9736-91e917f877ab-kube-api-access-gl4rk\") pod \"kuadrant-operator-controller-manager-86878c769f-fz5kr\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:16:55.776999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.776304    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b659c5577-7gqpv"]
Jul 06 19:16:55.848127 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:16:55.848081    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:17:08.768974 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:17:08.768936    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4a100d_5cec_4f5c_b1f1_3d7b9fea0ed2.slice/crio-c2ad9c0e5b8b15f6887c29cd0dcab130f1ad4afa3a85b0f9cd24dc19c286b3b6 WatchSource:0}: Error finding container c2ad9c0e5b8b15f6887c29cd0dcab130f1ad4afa3a85b0f9cd24dc19c286b3b6: Status 404 returned error can't find the container with id c2ad9c0e5b8b15f6887c29cd0dcab130f1ad4afa3a85b0f9cd24dc19c286b3b6
Jul 06 19:17:08.769504 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:17:08.769425    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5d3c9b_b186_46f6_8b4c_938dd7f942de.slice/crio-36a8152006fa6e5ba2d47c6cd0005341adb8af32996fd5e7579d17dac4fc36e6 WatchSource:0}: Error finding container 36a8152006fa6e5ba2d47c6cd0005341adb8af32996fd5e7579d17dac4fc36e6: Status 404 returned error can't find the container with id 36a8152006fa6e5ba2d47c6cd0005341adb8af32996fd5e7579d17dac4fc36e6
Jul 06 19:17:08.772634 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:08.772605    2561 scope.go:117] "RemoveContainer" containerID="952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674"
Jul 06 19:17:08.773041 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:17:08.773011    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674\": container with ID starting with 952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674 not found: ID does not exist" containerID="952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674"
Jul 06 19:17:08.773102 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:08.773053    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674"} err="failed to get container status \"952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674\": rpc error: code = NotFound desc = could not find container \"952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674\": container with ID starting with 952ca1770f0726071f5d33c9193590d6a9337aa11de0f0d48d813c11c2997674 not found: ID does not exist"
Jul 06 19:17:08.773102 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:08.773080    2561 scope.go:117] "RemoveContainer" containerID="553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2"
Jul 06 19:17:08.832988 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:08.832484    2561 scope.go:117] "RemoveContainer" containerID="553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2"
Jul 06 19:17:08.832988 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:17:08.832902    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2\": container with ID starting with 553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2 not found: ID does not exist" containerID="553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2"
Jul 06 19:17:08.832988 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:08.833034    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2"} err="failed to get container status \"553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2\": rpc error: code = NotFound desc = could not find container \"553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2\": container with ID starting with 553f795d6b2cc371f7da9503d6c4b468c3ae59badb91f5086070fd7802f8b7e2 not found: ID does not exist"
Jul 06 19:17:08.932644 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:08.932619    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"]
Jul 06 19:17:08.934955 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:17:08.934924    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffde4c1_5af1_441f_9736_91e917f877ab.slice/crio-527834636d9b45f04a18a791d4d373fa96d6532d6a948001146269e3641a4885 WatchSource:0}: Error finding container 527834636d9b45f04a18a791d4d373fa96d6532d6a948001146269e3641a4885: Status 404 returned error can't find the container with id 527834636d9b45f04a18a791d4d373fa96d6532d6a948001146269e3641a4885
Jul 06 19:17:09.724320 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.724287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr" event={"ID":"6ffde4c1-5af1-441f-9736-91e917f877ab","Type":"ContainerStarted","Data":"fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362"}
Jul 06 19:17:09.724497 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.724339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr" event={"ID":"6ffde4c1-5af1-441f-9736-91e917f877ab","Type":"ContainerStarted","Data":"527834636d9b45f04a18a791d4d373fa96d6532d6a948001146269e3641a4885"}
Jul 06 19:17:09.724497 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.724391    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:17:09.726018 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.725975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn" event={"ID":"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2","Type":"ContainerStarted","Data":"7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7"}
Jul 06 19:17:09.726167 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.726037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn" event={"ID":"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2","Type":"ContainerStarted","Data":"c2ad9c0e5b8b15f6887c29cd0dcab130f1ad4afa3a85b0f9cd24dc19c286b3b6"}
Jul 06 19:17:09.726167 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.726059    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:17:09.728396 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.728364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6" event={"ID":"e713d344-2474-4be0-b4c4-7a9d5aef2bd7","Type":"ContainerStarted","Data":"bc61c74d1a1be1c354374d7cd3e5d9f0c5eb35817c5e32d548f9616bd65405b4"}
Jul 06 19:17:09.730100 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.730064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" event={"ID":"be5d3c9b-b186-46f6-8b4c-938dd7f942de","Type":"ContainerStarted","Data":"931358d5d92e04f83ae6781d28d9d495072b9e318aa038fccb3e170165168b21"}
Jul 06 19:17:09.730215 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.730133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" event={"ID":"be5d3c9b-b186-46f6-8b4c-938dd7f942de","Type":"ContainerStarted","Data":"36a8152006fa6e5ba2d47c6cd0005341adb8af32996fd5e7579d17dac4fc36e6"}
Jul 06 19:17:09.730282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.730246    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:17:09.752576 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.752528    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr" podStartSLOduration=14.752512109 podStartE2EDuration="14.752512109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:09.751075724 +0000 UTC m=+689.501784977" watchObservedRunningTime="2026-07-06 19:17:09.752512109 +0000 UTC m=+689.503221357"
Jul 06 19:17:09.778664 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.778621    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn" podStartSLOduration=15.77860726 podStartE2EDuration="15.77860726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:09.77686709 +0000 UTC m=+689.527576378" watchObservedRunningTime="2026-07-06 19:17:09.77860726 +0000 UTC m=+689.529316508"
Jul 06 19:17:09.804719 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.804679    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" podStartSLOduration=15.804670347 podStartE2EDuration="15.804670347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:09.803511088 +0000 UTC m=+689.554220338" watchObservedRunningTime="2026-07-06 19:17:09.804670347 +0000 UTC m=+689.555379593"
Jul 06 19:17:09.829266 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:09.829220    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-689q6" podStartSLOduration=2.124342143 podStartE2EDuration="26.829204682s" totalImagesPullingTime="24.704862539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:09.826898225 +0000 UTC m=+689.577607474" watchObservedRunningTime="2026-07-06 19:17:09.829204682 +0000 UTC m=+689.579913929"
Jul 06 19:17:20.736475 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:20.736436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:17:20.736979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:20.736755    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:17:20.736979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:20.736817    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:17:20.800859 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:20.800811    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b659c5577-7gqpv" podUID="977c4f79-124b-49df-957e-3481d2f21d63" containerName="console" containerID="cri-o://bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0" gracePeriod=15
Jul 06 19:17:20.840284 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:17:20.840239    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977c4f79_124b_49df_957e_3481d2f21d63.slice/crio-bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977c4f79_124b_49df_957e_3481d2f21d63.slice/crio-conmon-bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0.scope\": RecentStats: unable to find data in memory cache]"
Jul 06 19:17:20.842069 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:20.842041    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"]
Jul 06 19:17:20.842287 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:20.842256    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn" podUID="5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" containerName="manager" containerID="cri-o://7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7" gracePeriod=10
Jul 06 19:17:21.124035 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.124014    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:17:21.126180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.126160    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:17:21.247915 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.247880    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-trusted-ca-bundle\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.247944    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-service-ca\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.247966    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-extensions-socket-volume\") pod \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") "
Jul 06 19:17:21.248085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248024    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-console-config\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-serving-cert\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248069    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-oauth-config\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248395 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248105    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vkvd\" (UniqueName: \"kubernetes.io/projected/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-kube-api-access-4vkvd\") pod \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\" (UID: \"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2\") "
Jul 06 19:17:21.248395 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248165    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7hfx\" (UniqueName: \"kubernetes.io/projected/977c4f79-124b-49df-957e-3481d2f21d63-kube-api-access-t7hfx\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248395 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-oauth-serving-cert\") pod \"977c4f79-124b-49df-957e-3481d2f21d63\" (UID: \"977c4f79-124b-49df-957e-3481d2f21d63\") "
Jul 06 19:17:21.248545 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248442    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-console-config" (OuterVolumeSpecName: "console-config") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:17:21.248545 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248447    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:17:21.248545 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248482    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-service-ca" (OuterVolumeSpecName: "service-ca") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:17:21.248545 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248499    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" (UID: "5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:17:21.248782 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.248753    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:17:21.250413 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.250386    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-kube-api-access-4vkvd" (OuterVolumeSpecName: "kube-api-access-4vkvd") pod "5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" (UID: "5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2"). InnerVolumeSpecName "kube-api-access-4vkvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:17:21.250519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.250504    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977c4f79-124b-49df-957e-3481d2f21d63-kube-api-access-t7hfx" (OuterVolumeSpecName: "kube-api-access-t7hfx") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "kube-api-access-t7hfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:17:21.250567 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.250517    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:17:21.250605 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.250579    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "977c4f79-124b-49df-957e-3481d2f21d63" (UID: "977c4f79-124b-49df-957e-3481d2f21d63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349451    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-oauth-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349482    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vkvd\" (UniqueName: \"kubernetes.io/projected/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-kube-api-access-4vkvd\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349493    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7hfx\" (UniqueName: \"kubernetes.io/projected/977c4f79-124b-49df-957e-3481d2f21d63-kube-api-access-t7hfx\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349500    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-oauth-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349509    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-trusted-ca-bundle\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349517    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-service-ca\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349525    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2-extensions-socket-volume\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349533    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/977c4f79-124b-49df-957e-3481d2f21d63-console-config\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.349879 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.349548    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/977c4f79-124b-49df-957e-3481d2f21d63-console-serving-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:17:21.790082 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.790047    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" containerID="7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7" exitCode=0
Jul 06 19:17:21.790553 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.790090    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"
Jul 06 19:17:21.790553 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.790138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn" event={"ID":"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2","Type":"ContainerDied","Data":"7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7"}
Jul 06 19:17:21.790553 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.790196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn" event={"ID":"5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2","Type":"ContainerDied","Data":"c2ad9c0e5b8b15f6887c29cd0dcab130f1ad4afa3a85b0f9cd24dc19c286b3b6"}
Jul 06 19:17:21.790553 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.790220    2561 scope.go:117] "RemoveContainer" containerID="7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7"
Jul 06 19:17:21.791521 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.791489    2561 generic.go:356] "Generic (PLEG): container finished" podID="977c4f79-124b-49df-957e-3481d2f21d63" containerID="bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0" exitCode=0
Jul 06 19:17:21.791625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.791531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b659c5577-7gqpv" event={"ID":"977c4f79-124b-49df-957e-3481d2f21d63","Type":"ContainerDied","Data":"bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0"}
Jul 06 19:17:21.791625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.791566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b659c5577-7gqpv" event={"ID":"977c4f79-124b-49df-957e-3481d2f21d63","Type":"ContainerDied","Data":"f6df6670eed533ca4b117e382924e7644e266fcc9098096898a9edc8b37c7f96"}
Jul 06 19:17:21.791625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.791535    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b659c5577-7gqpv"
Jul 06 19:17:21.807770 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.807602    2561 scope.go:117] "RemoveContainer" containerID="7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7"
Jul 06 19:17:21.807929 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:17:21.807885    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7\": container with ID starting with 7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7 not found: ID does not exist" containerID="7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7"
Jul 06 19:17:21.807996 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.807921    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7"} err="failed to get container status \"7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7\": rpc error: code = NotFound desc = could not find container \"7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7\": container with ID starting with 7a430d4728836776348f425e50b83b2e0532b7f0f2926c7e8169a0447858d6e7 not found: ID does not exist"
Jul 06 19:17:21.807996 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.807945    2561 scope.go:117] "RemoveContainer" containerID="bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0"
Jul 06 19:17:21.822915 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.822897    2561 scope.go:117] "RemoveContainer" containerID="bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0"
Jul 06 19:17:21.823174 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:17:21.823154    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0\": container with ID starting with bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0 not found: ID does not exist" containerID="bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0"
Jul 06 19:17:21.823243 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.823186    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0"} err="failed to get container status \"bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0\": rpc error: code = NotFound desc = could not find container \"bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0\": container with ID starting with bf96186ad7eeba2b6db7ed02a9df7acc45229270ae934190eb8e8cc3b93996d0 not found: ID does not exist"
Jul 06 19:17:21.850861 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.850830    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b659c5577-7gqpv"]
Jul 06 19:17:21.858615 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.858586    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b659c5577-7gqpv"]
Jul 06 19:17:21.885960 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.885934    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"]
Jul 06 19:17:21.892585 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:21.892564    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5sqn"]
Jul 06 19:17:22.882774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:22.882743    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" path="/var/lib/kubelet/pods/5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2/volumes"
Jul 06 19:17:22.883161 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:22.883143    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977c4f79-124b-49df-957e-3481d2f21d63" path="/var/lib/kubelet/pods/977c4f79-124b-49df-957e-3481d2f21d63/volumes"
Jul 06 19:17:37.451971 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.451893    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"]
Jul 06 19:17:37.452454 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.452438    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" containerName="manager"
Jul 06 19:17:37.452496 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.452457    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" containerName="manager"
Jul 06 19:17:37.452496 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.452479    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977c4f79-124b-49df-957e-3481d2f21d63" containerName="console"
Jul 06 19:17:37.452496 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.452488    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="977c4f79-124b-49df-957e-3481d2f21d63" containerName="console"
Jul 06 19:17:37.452596 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.452585    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4a100d-5cec-4f5c-b1f1-3d7b9fea0ed2" containerName="manager"
Jul 06 19:17:37.452629 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.452603    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="977c4f79-124b-49df-957e-3481d2f21d63" containerName="console"
Jul 06 19:17:37.468257 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.468232    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.471746 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.471700    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:17:37.472067 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.472048    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q6ffc\""
Jul 06 19:17:37.477289 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.477264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"]
Jul 06 19:17:37.491884 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.491859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492001 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.491922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492052 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492102 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492173 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6gwr\" (UniqueName: \"kubernetes.io/projected/4a58243e-3f34-4ebd-9452-812c00fbaaab-kube-api-access-m6gwr\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492208 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a58243e-3f34-4ebd-9452-812c00fbaaab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492247 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.492315 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.492281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.592687 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.592857 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.592857 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.592857 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.592857 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593065 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6gwr\" (UniqueName: \"kubernetes.io/projected/4a58243e-3f34-4ebd-9452-812c00fbaaab-kube-api-access-m6gwr\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593065 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593065 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a58243e-3f34-4ebd-9452-812c00fbaaab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593065 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.592952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593288 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.593132    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593288 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.593192    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593389 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.593341    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.593452    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.593829 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.593767    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a58243e-3f34-4ebd-9452-812c00fbaaab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.595471 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.595450    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.595786 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.595766    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.605734 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.605703    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a58243e-3f34-4ebd-9452-812c00fbaaab-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.605908 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.605884    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6gwr\" (UniqueName: \"kubernetes.io/projected/4a58243e-3f34-4ebd-9452-812c00fbaaab-kube-api-access-m6gwr\") pod \"maas-default-gateway-openshift-default-56654dcf7-2t564\" (UID: \"4a58243e-3f34-4ebd-9452-812c00fbaaab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.781078 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.781042    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:37.967191 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:37.967099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"]
Jul 06 19:17:37.969856 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:17:37.969835    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a58243e_3f34_4ebd_9452_812c00fbaaab.slice/crio-ad463f59df0a847963b8de604e38787fc30018a0fb5a469808a469859e949abb WatchSource:0}: Error finding container ad463f59df0a847963b8de604e38787fc30018a0fb5a469808a469859e949abb: Status 404 returned error can't find the container with id ad463f59df0a847963b8de604e38787fc30018a0fb5a469808a469859e949abb
Jul 06 19:17:38.885585 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:38.885532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" event={"ID":"4a58243e-3f34-4ebd-9452-812c00fbaaab","Type":"ContainerStarted","Data":"ad463f59df0a847963b8de604e38787fc30018a0fb5a469808a469859e949abb"}
Jul 06 19:17:41.081349 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:41.081298    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:17:41.081647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:41.081388    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:17:41.081647 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:41.081417    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:17:41.902209 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:41.902174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" event={"ID":"4a58243e-3f34-4ebd-9452-812c00fbaaab","Type":"ContainerStarted","Data":"4398daa8d1b7fe876e60702bc81f6db665769b0dd0a4283c10e6b0ab4ca8be35"}
Jul 06 19:17:42.782248 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:42.782217    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:42.786946 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:42.786923    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:42.828845 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:42.828799    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" podStartSLOduration=2.719714461 podStartE2EDuration="5.828785016s" totalImagesPullingTime="3.109070555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:41.93583715 +0000 UTC m=+721.686546396" watchObservedRunningTime="2026-07-06 19:17:42.828785016 +0000 UTC m=+722.579494262"
Jul 06 19:17:42.906918 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:42.906894    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:42.907872 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:42.907839    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:17:43.739270 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.739237    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:17:43.743996 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.743974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:43.747726 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.747704    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:17:43.758209 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.758184    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:17:43.829605 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.829571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:17:43.851686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.851655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094-config-file\") pod \"limitador-limitador-54d6d988d5-2dbs2\" (UID: \"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:43.851817 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.851695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tlt2\" (UniqueName: \"kubernetes.io/projected/ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094-kube-api-access-4tlt2\") pod \"limitador-limitador-54d6d988d5-2dbs2\" (UID: \"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:43.953086 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.953053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094-config-file\") pod \"limitador-limitador-54d6d988d5-2dbs2\" (UID: \"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:43.953274 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.953122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlt2\" (UniqueName: \"kubernetes.io/projected/ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094-kube-api-access-4tlt2\") pod \"limitador-limitador-54d6d988d5-2dbs2\" (UID: \"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:43.953753 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.953732    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094-config-file\") pod \"limitador-limitador-54d6d988d5-2dbs2\" (UID: \"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:43.964700 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:43.964671    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlt2\" (UniqueName: \"kubernetes.io/projected/ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094-kube-api-access-4tlt2\") pod \"limitador-limitador-54d6d988d5-2dbs2\" (UID: \"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:44.054579 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:44.054495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:44.199397 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:44.199376    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:17:44.201470 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:17:44.201437    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0c2fa8_aef8_4c70_8ff2_c2e9b2653094.slice/crio-ea64a5132e97661a3fb3869050224e615a3d22191eaf7190fef03831ac9be18b WatchSource:0}: Error finding container ea64a5132e97661a3fb3869050224e615a3d22191eaf7190fef03831ac9be18b: Status 404 returned error can't find the container with id ea64a5132e97661a3fb3869050224e615a3d22191eaf7190fef03831ac9be18b
Jul 06 19:17:44.921218 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:44.921175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2" event={"ID":"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094","Type":"ContainerStarted","Data":"ea64a5132e97661a3fb3869050224e615a3d22191eaf7190fef03831ac9be18b"}
Jul 06 19:17:47.938394 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:47.938350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2" event={"ID":"ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094","Type":"ContainerStarted","Data":"7f3ba45306d80a15e219143f1e1af5eb7109183658b6f86aba5b9001ed329164"}
Jul 06 19:17:47.938774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:47.938479    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:17:47.973973 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:47.973931    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2" podStartSLOduration=2.083854234 podStartE2EDuration="4.973915797s" totalImagesPullingTime="2.890061563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:47.973630754 +0000 UTC m=+727.724340000" watchObservedRunningTime="2026-07-06 19:17:47.973915797 +0000 UTC m=+727.724625043"
Jul 06 19:17:58.944639 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:17:58.944606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"
Jul 06 19:19:01.261966 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:01.261865    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:19:09.334128 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:09.334062    2561 generic.go:356] "Generic (PLEG): container finished" podID="4a58243e-3f34-4ebd-9452-812c00fbaaab" containerID="4398daa8d1b7fe876e60702bc81f6db665769b0dd0a4283c10e6b0ab4ca8be35" exitCode=0
Jul 06 19:19:09.334543 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:09.334133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" event={"ID":"4a58243e-3f34-4ebd-9452-812c00fbaaab","Type":"ContainerDied","Data":"4398daa8d1b7fe876e60702bc81f6db665769b0dd0a4283c10e6b0ab4ca8be35"}
Jul 06 19:19:09.334543 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:09.334479    2561 scope.go:117] "RemoveContainer" containerID="4398daa8d1b7fe876e60702bc81f6db665769b0dd0a4283c10e6b0ab4ca8be35"
Jul 06 19:19:09.335483 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:09.335456    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:19:09.335566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:09.335524    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:19:09.335566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:09.335555    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:19:10.343812 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:10.343778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" event={"ID":"4a58243e-3f34-4ebd-9452-812c00fbaaab","Type":"ContainerStarted","Data":"441315d6c04b26516033ca4c521f16607ae446db1199daa5587a4832d7240b1f"}
Jul 06 19:19:10.781781 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:10.781744    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:19:10.782928 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:10.782899    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2t564 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 06 19:19:10.783039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:10.782953    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" podUID="4a58243e-3f34-4ebd-9452-812c00fbaaab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 06 19:19:11.782181 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:11.782141    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2t564 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 06 19:19:11.782576 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:11.782198    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" podUID="4a58243e-3f34-4ebd-9452-812c00fbaaab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 06 19:19:12.782185 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:12.782149    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2t564 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 06 19:19:12.782577 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:12.782205    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" podUID="4a58243e-3f34-4ebd-9452-812c00fbaaab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 06 19:19:12.907753 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:12.907722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:19:13.782395 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:13.782359    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2t564 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 06 19:19:13.782872 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:13.782428    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564" podUID="4a58243e-3f34-4ebd-9452-812c00fbaaab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 06 19:19:14.786035 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:14.786002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:19:14.786935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:14.786913    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2t564"
Jul 06 19:19:24.246284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:24.246243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:19:41.327577 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:41.327541    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:19:56.518692 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:19:56.518651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:20:04.013887 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.013851    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"]
Jul 06 19:20:04.016533 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.016515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.022151 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.022099    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 19:20:04.022151 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.022099    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:20:04.025891 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.025872    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:20:04.026756 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.026737    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2bj8l\""
Jul 06 19:20:04.054482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.054457    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"]
Jul 06 19:20:04.088702 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.088673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8e6e28-4745-45a8-acd9-db5353c9806b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.088840 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.088711    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.088840 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.088732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.088840 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.088783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.088959 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.088871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jsw\" (UniqueName: \"kubernetes.io/projected/ac8e6e28-4745-45a8-acd9-db5353c9806b-kube-api-access-s5jsw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.088959 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.088945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190004 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.189972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jsw\" (UniqueName: \"kubernetes.io/projected/ac8e6e28-4745-45a8-acd9-db5353c9806b-kube-api-access-s5jsw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8e6e28-4745-45a8-acd9-db5353c9806b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190487 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190487 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190478    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.190553 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.190518    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.192339 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.192316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac8e6e28-4745-45a8-acd9-db5353c9806b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.192619 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.192595    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8e6e28-4745-45a8-acd9-db5353c9806b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.204063 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.204031    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jsw\" (UniqueName: \"kubernetes.io/projected/ac8e6e28-4745-45a8-acd9-db5353c9806b-kube-api-access-s5jsw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb\" (UID: \"ac8e6e28-4745-45a8-acd9-db5353c9806b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.327181 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.327077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:04.474690 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.474661    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"]
Jul 06 19:20:04.476758 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:20:04.476731    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8e6e28_4745_45a8_acd9_db5353c9806b.slice/crio-ec28192249d3957a73a648ac9d96b5ef4cbd3da9ae67c9764879b336c24875f0 WatchSource:0}: Error finding container ec28192249d3957a73a648ac9d96b5ef4cbd3da9ae67c9764879b336c24875f0: Status 404 returned error can't find the container with id ec28192249d3957a73a648ac9d96b5ef4cbd3da9ae67c9764879b336c24875f0
Jul 06 19:20:04.477994 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.477978    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:20:04.612821 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:04.612734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb" event={"ID":"ac8e6e28-4745-45a8-acd9-db5353c9806b","Type":"ContainerStarted","Data":"ec28192249d3957a73a648ac9d96b5ef4cbd3da9ae67c9764879b336c24875f0"}
Jul 06 19:20:05.798189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:05.798155    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:20:06.625574 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:06.625534    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb" event={"ID":"ac8e6e28-4745-45a8-acd9-db5353c9806b","Type":"ContainerStarted","Data":"b23c9b8f7cfbc368f9f02157a59c9ae19c1b098d331dfcef1645a115cac5cc6d"}
Jul 06 19:20:06.652555 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:06.652506    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb" podStartSLOduration=2.495558127 podStartE2EDuration="3.652489989s" totalImagesPullingTime="1.156931862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:06.649860758 +0000 UTC m=+866.400570006" watchObservedRunningTime="2026-07-06 19:20:06.652489989 +0000 UTC m=+866.403199235"
Jul 06 19:20:08.783667 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.783631    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"]
Jul 06 19:20:08.786657 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.786632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.790217 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.790188    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 19:20:08.802280 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.802257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"]
Jul 06 19:20:08.833846 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.833806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.833846 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.833845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.834047 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.833872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmdm\" (UniqueName: \"kubernetes.io/projected/4f8902ba-e780-4b95-8db0-93feec69c2cd-kube-api-access-wwmdm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.834047 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.833962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.834047 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.833990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8902ba-e780-4b95-8db0-93feec69c2cd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.834189 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.834052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935120 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmdm\" (UniqueName: \"kubernetes.io/projected/4f8902ba-e780-4b95-8db0-93feec69c2cd-kube-api-access-wwmdm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8902ba-e780-4b95-8db0-93feec69c2cd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935751 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935481    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935751 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935601    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.935953 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.935761    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.937624 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.937597    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f8902ba-e780-4b95-8db0-93feec69c2cd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.937941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.937922    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8902ba-e780-4b95-8db0-93feec69c2cd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:08.947223 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:08.947194    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmdm\" (UniqueName: \"kubernetes.io/projected/4f8902ba-e780-4b95-8db0-93feec69c2cd-kube-api-access-wwmdm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rtwq\" (UID: \"4f8902ba-e780-4b95-8db0-93feec69c2cd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:09.097905 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:09.097818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:09.243231 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:09.243207    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"]
Jul 06 19:20:09.245163 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:20:09.245136    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8902ba_e780_4b95_8db0_93feec69c2cd.slice/crio-d2ba69b4c326e33baee4eafa399c506798a9ef873db75abe27d99dcfaadf3639 WatchSource:0}: Error finding container d2ba69b4c326e33baee4eafa399c506798a9ef873db75abe27d99dcfaadf3639: Status 404 returned error can't find the container with id d2ba69b4c326e33baee4eafa399c506798a9ef873db75abe27d99dcfaadf3639
Jul 06 19:20:09.643815 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:09.643776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq" event={"ID":"4f8902ba-e780-4b95-8db0-93feec69c2cd","Type":"ContainerStarted","Data":"87bf6a5d0788f610313f57b90a0bb040745812b0448ca52e94e138d3cf9107a5"}
Jul 06 19:20:09.643983 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:09.643836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq" event={"ID":"4f8902ba-e780-4b95-8db0-93feec69c2cd","Type":"ContainerStarted","Data":"d2ba69b4c326e33baee4eafa399c506798a9ef873db75abe27d99dcfaadf3639"}
Jul 06 19:20:09.673965 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:09.673893    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq" podStartSLOduration=1.4921428589999999 podStartE2EDuration="1.673878974s" totalImagesPullingTime="181.736115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:09.673269643 +0000 UTC m=+869.423978891" watchObservedRunningTime="2026-07-06 19:20:09.673878974 +0000 UTC m=+869.424588220"
Jul 06 19:20:11.510656 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:11.510623    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:20:14.328042 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:14.328000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:14.328551 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:14.328079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:14.340606 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:14.340582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:14.679930 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:14.679853    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb"
Jul 06 19:20:19.098200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:19.098160    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:19.098599 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:19.098221    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:19.110615 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:19.110588    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:19.703455 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:19.703427    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rtwq"
Jul 06 19:20:23.098481 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.098446    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"]
Jul 06 19:20:23.101571 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.101553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.107122 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.107092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 19:20:23.115753 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.115728    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"]
Jul 06 19:20:23.168429 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.168394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.168619 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.168443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.168619 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.168463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.168619 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.168561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.168768 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.168640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.168768 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.168668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jzwt\" (UniqueName: \"kubernetes.io/projected/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-kube-api-access-8jzwt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.269762 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.269716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.269951 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.269769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.269951 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.269811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.269951 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.269878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.269951 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.269901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jzwt\" (UniqueName: \"kubernetes.io/projected/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-kube-api-access-8jzwt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.270190 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.269986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.270348 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.270314    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.270348 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.270355    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.270549 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.270497    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.272709 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.272687    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.273045 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.273027    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.283234 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.283215    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jzwt\" (UniqueName: \"kubernetes.io/projected/de36f74b-c9c7-4ddd-91dc-e33ca035c8ea-kube-api-access-8jzwt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw\" (UID: \"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.411086 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.411013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:23.562642 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.562619    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"]
Jul 06 19:20:23.564874 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:20:23.564847    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde36f74b_c9c7_4ddd_91dc_e33ca035c8ea.slice/crio-8126ae70667203651281a435b5861bf735c8b151c2c0a4f4e746b60cf2ef1bc2 WatchSource:0}: Error finding container 8126ae70667203651281a435b5861bf735c8b151c2c0a4f4e746b60cf2ef1bc2: Status 404 returned error can't find the container with id 8126ae70667203651281a435b5861bf735c8b151c2c0a4f4e746b60cf2ef1bc2
Jul 06 19:20:23.712746 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:23.712661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw" event={"ID":"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea","Type":"ContainerStarted","Data":"8126ae70667203651281a435b5861bf735c8b151c2c0a4f4e746b60cf2ef1bc2"}
Jul 06 19:20:24.719236 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:24.719196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw" event={"ID":"de36f74b-c9c7-4ddd-91dc-e33ca035c8ea","Type":"ContainerStarted","Data":"d38efb68724f35b5896182436e14ae4c8f5361d412156fb742979d653c6e76bc"}
Jul 06 19:20:24.752184 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:24.752128    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw" podStartSLOduration=1.5622408239999999 podStartE2EDuration="1.752088906s" totalImagesPullingTime="189.848082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:24.751763457 +0000 UTC m=+884.502472705" watchObservedRunningTime="2026-07-06 19:20:24.752088906 +0000 UTC m=+884.502798193"
Jul 06 19:20:25.714342 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:25.714309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:20:33.412185 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:33.412087    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:33.412185 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:33.412161    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:33.425153 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:33.425125    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:33.778531 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:33.778500    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw"
Jul 06 19:20:40.732202 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:40.732175    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:20:40.733458 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:20:40.733433    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:22:08.310080 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:22:08.310042    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:22:18.586318 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:22:18.586273    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:22:29.898933 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:22:29.898896    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:22:38.515911 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:22:38.515861    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:22:49.530125 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:22:49.530085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:23:16.004858 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:23:16.004828    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:23:29.006128 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:23:29.006070    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:24:08.700371 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:24:08.700257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:24:18.211749 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:24:18.211714    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:24:27.094686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:24:27.094654    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:24:38.010090 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:24:38.010052    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:24:47.794977 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:24:47.794935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:25:03.507330 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:03.507260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:25:10.919297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:10.919257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:25:18.607129 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:18.607067    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:25:40.763045 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:40.763009    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:25:40.765644 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:40.765622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:25:40.902484 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:40.902454    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:25:52.610125 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:25:52.610076    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:26:20.975045 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:26:20.975010    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:26:37.516941 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:26:37.516855    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:26:48.328311 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:26:48.328279    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:27:09.110016 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:27:09.109982    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:27:21.402205 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:27:21.402164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:27:30.798893 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:27:30.798857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:27:59.988680 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:27:59.988640    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"]
Jul 06 19:27:59.989284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:27:59.988878    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr" podUID="6ffde4c1-5af1-441f-9736-91e917f877ab" containerName="manager" containerID="cri-o://fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362" gracePeriod=10
Jul 06 19:28:04.064517 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:28:04.064487    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffde4c1_5af1_441f_9736_91e917f877ab.slice/crio-conmon-fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362.scope\": RecentStats: unable to find data in memory cache]"
Jul 06 19:28:04.242899 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.242874    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:28:04.341807 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.341713    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ffde4c1-5af1-441f-9736-91e917f877ab-extensions-socket-volume\") pod \"6ffde4c1-5af1-441f-9736-91e917f877ab\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") "
Jul 06 19:28:04.341807 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.341773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4rk\" (UniqueName: \"kubernetes.io/projected/6ffde4c1-5af1-441f-9736-91e917f877ab-kube-api-access-gl4rk\") pod \"6ffde4c1-5af1-441f-9736-91e917f877ab\" (UID: \"6ffde4c1-5af1-441f-9736-91e917f877ab\") "
Jul 06 19:28:04.342252 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.342220    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ffde4c1-5af1-441f-9736-91e917f877ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ffde4c1-5af1-441f-9736-91e917f877ab" (UID: "6ffde4c1-5af1-441f-9736-91e917f877ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:28:04.344343 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.344306    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ffde4c1-5af1-441f-9736-91e917f877ab-kube-api-access-gl4rk" (OuterVolumeSpecName: "kube-api-access-gl4rk") pod "6ffde4c1-5af1-441f-9736-91e917f877ab" (UID: "6ffde4c1-5af1-441f-9736-91e917f877ab"). InnerVolumeSpecName "kube-api-access-gl4rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:04.443488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.443455    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ffde4c1-5af1-441f-9736-91e917f877ab-extensions-socket-volume\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:28:04.443488 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:04.443483    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4rk\" (UniqueName: \"kubernetes.io/projected/6ffde4c1-5af1-441f-9736-91e917f877ab-kube-api-access-gl4rk\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:28:05.072762 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.072730    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ffde4c1-5af1-441f-9736-91e917f877ab" containerID="fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362" exitCode=0
Jul 06 19:28:05.073202 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.072773    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"
Jul 06 19:28:05.073202 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.072808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr" event={"ID":"6ffde4c1-5af1-441f-9736-91e917f877ab","Type":"ContainerDied","Data":"fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362"}
Jul 06 19:28:05.073202 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.072863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr" event={"ID":"6ffde4c1-5af1-441f-9736-91e917f877ab","Type":"ContainerDied","Data":"527834636d9b45f04a18a791d4d373fa96d6532d6a948001146269e3641a4885"}
Jul 06 19:28:05.073202 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.072887    2561 scope.go:117] "RemoveContainer" containerID="fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362"
Jul 06 19:28:05.083088 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.083072    2561 scope.go:117] "RemoveContainer" containerID="fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362"
Jul 06 19:28:05.083394 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:28:05.083370    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362\": container with ID starting with fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362 not found: ID does not exist" containerID="fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362"
Jul 06 19:28:05.083499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.083405    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362"} err="failed to get container status \"fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362\": rpc error: code = NotFound desc = could not find container \"fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362\": container with ID starting with fc0d77c8f4512f50b8c0dfb1a2e258c127abb15ef630fd0a7e5a51c49f597362 not found: ID does not exist"
Jul 06 19:28:05.101294 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.101270    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"]
Jul 06 19:28:05.108046 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:05.108026    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz5kr"]
Jul 06 19:28:06.882981 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:28:06.882948    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ffde4c1-5af1-441f-9736-91e917f877ab" path="/var/lib/kubelet/pods/6ffde4c1-5af1-441f-9736-91e917f877ab/volumes"
Jul 06 19:29:01.273225 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.273187    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"]
Jul 06 19:29:01.273683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.273599    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ffde4c1-5af1-441f-9736-91e917f877ab" containerName="manager"
Jul 06 19:29:01.273683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.273613    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ffde4c1-5af1-441f-9736-91e917f877ab" containerName="manager"
Jul 06 19:29:01.273683 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.273672    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ffde4c1-5af1-441f-9736-91e917f877ab" containerName="manager"
Jul 06 19:29:01.277660 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.277642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.281567 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.281543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k5svr\""
Jul 06 19:29:01.305649 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.305618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"]
Jul 06 19:29:01.345933 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.345890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d7cfb91-a126-4804-9cdf-925be60ef3a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z2qqx\" (UID: \"1d7cfb91-a126-4804-9cdf-925be60ef3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.346197 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.345950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5fmm\" (UniqueName: \"kubernetes.io/projected/1d7cfb91-a126-4804-9cdf-925be60ef3a3-kube-api-access-l5fmm\") pod \"kuadrant-operator-controller-manager-86878c769f-z2qqx\" (UID: \"1d7cfb91-a126-4804-9cdf-925be60ef3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.447479 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.447437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d7cfb91-a126-4804-9cdf-925be60ef3a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z2qqx\" (UID: \"1d7cfb91-a126-4804-9cdf-925be60ef3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.447655 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.447496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5fmm\" (UniqueName: \"kubernetes.io/projected/1d7cfb91-a126-4804-9cdf-925be60ef3a3-kube-api-access-l5fmm\") pod \"kuadrant-operator-controller-manager-86878c769f-z2qqx\" (UID: \"1d7cfb91-a126-4804-9cdf-925be60ef3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.447861 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.447839    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d7cfb91-a126-4804-9cdf-925be60ef3a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z2qqx\" (UID: \"1d7cfb91-a126-4804-9cdf-925be60ef3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.466200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.466173    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5fmm\" (UniqueName: \"kubernetes.io/projected/1d7cfb91-a126-4804-9cdf-925be60ef3a3-kube-api-access-l5fmm\") pod \"kuadrant-operator-controller-manager-86878c769f-z2qqx\" (UID: \"1d7cfb91-a126-4804-9cdf-925be60ef3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.587499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.587403    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:01.757927 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:29:01.757886    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7cfb91_a126_4804_9cdf_925be60ef3a3.slice/crio-132e4f95e054a11792d0d4e3ed94b3dc20493c2a38f919884f7d6fb2f3caa8ae WatchSource:0}: Error finding container 132e4f95e054a11792d0d4e3ed94b3dc20493c2a38f919884f7d6fb2f3caa8ae: Status 404 returned error can't find the container with id 132e4f95e054a11792d0d4e3ed94b3dc20493c2a38f919884f7d6fb2f3caa8ae
Jul 06 19:29:01.758446 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:01.758417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"]
Jul 06 19:29:02.356801 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:02.356759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" event={"ID":"1d7cfb91-a126-4804-9cdf-925be60ef3a3","Type":"ContainerStarted","Data":"03c0c6e4af2b0418f3fe66f315ab805d12c0bfd7077cd31372f4b391cf009424"}
Jul 06 19:29:02.357237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:02.356822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" event={"ID":"1d7cfb91-a126-4804-9cdf-925be60ef3a3","Type":"ContainerStarted","Data":"132e4f95e054a11792d0d4e3ed94b3dc20493c2a38f919884f7d6fb2f3caa8ae"}
Jul 06 19:29:02.357237 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:02.356871    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:02.394141 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:02.394079    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" podStartSLOduration=1.3940645919999999 podStartE2EDuration="1.394064592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:02.39394045 +0000 UTC m=+1402.144649696" watchObservedRunningTime="2026-07-06 19:29:02.394064592 +0000 UTC m=+1402.144773838"
Jul 06 19:29:13.364689 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:13.364656    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:29:21.197952 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:21.197909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:29:33.286729 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:33.286641    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:29:44.992072 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:44.992030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:29:45.082851 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:45.082801    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" podUID="f5d35cca57c2f2c6fe15afe949f8be24" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:29:52.619695 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:52.619653    2561 generic.go:356] "Generic (PLEG): container finished" podID="540dd4d5-68fd-43cc-b8f8-06eefc407039" containerID="f26d4f91000c03f1c5143d9cbe1f31ff0076434657e7f0e86c52bcbe8857c9b0" exitCode=1
Jul 06 19:29:52.620231 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:52.619718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerDied","Data":"f26d4f91000c03f1c5143d9cbe1f31ff0076434657e7f0e86c52bcbe8857c9b0"}
Jul 06 19:29:52.620231 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:52.620163    2561 scope.go:117] "RemoveContainer" containerID="f26d4f91000c03f1c5143d9cbe1f31ff0076434657e7f0e86c52bcbe8857c9b0"
Jul 06 19:29:52.620478 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:52.620463    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:29:53.627380 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:53.627341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerStarted","Data":"c802540e2daeb1d47ab9bdce72a25adca7ef95977296ac8f79b3ddd8d0d54430"}
Jul 06 19:29:53.627776 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:53.627624    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:29:54.849303 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:29:54.849262    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:30:04.634478 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:04.634442    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:30:16.620284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:16.620239    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:30:30.510341 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:30.510298    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:30:40.790986 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:40.790953    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:30:40.795638 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:40.795613    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:30:41.822154 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:41.822102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:30:52.204933 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:30:52.204895    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:31:01.826329 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:31:01.826246    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:31:15.511980 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:31:15.511943    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:31:37.884797 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:31:37.884759    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:31:45.186267 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:31:45.186238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:31:54.288539 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:31:54.288502    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:32:05.688172 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:32:05.688134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:32:21.186979 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:32:21.186941    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:32:30.281092 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:32:30.281053    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:32:38.901943 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:32:38.901912    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:32:49.299292 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:32:49.299248    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:32:58.632308 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:32:58.632265    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:33:07.689771 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:33:07.689735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:33:20.385921 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:33:20.385883    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:33:29.197595 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:33:29.197554    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:33:40.089200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:33:40.089163    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:33:49.302674 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:33:49.302636    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:34:02.288380 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:34:02.288299    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:34:10.190200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:34:10.190158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:34:21.919073 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:34:21.919032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:34:33.785588 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:34:33.785556    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:34:44.997450 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:34:44.997410    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:34:53.503408 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:34:53.503372    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:35:06.825079 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:06.825034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:35:14.731618 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:14.731583    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:35:39.489625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:39.489587    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:35:40.821728 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:40.821694    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:35:40.829151 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:40.829101    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:35:50.693802 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:50.693765    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:35:59.880186 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:35:59.880144    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:36:08.184220 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:36:08.184181    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:37:34.188677 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:37:34.188645    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:37:41.688806 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:37:41.688763    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:37:49.413271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:37:49.413228    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:38:00.505519 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:38:00.505465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:38:08.490059 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:38:08.490027    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:38:43.694218 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:38:43.694133    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:38:52.586750 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:38:52.586709    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:39:13.690297 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:39:13.690259    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:39:22.784917 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:39:22.784883    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:39:34.485543 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:39:34.485499    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:40:12.491331 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:40:12.491295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:40:25.479003 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:40:25.478966    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:40:34.409255 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:40:34.409219    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:40:40.851006 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:40:40.850974    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:40:40.857768 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:40:40.857745    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:41:23.995357 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:23.995315    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:41:34.588544 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:34.588459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:41:41.011927 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.011897    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"]
Jul 06 19:41:41.015696 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.015673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.019357 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.019328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c985ce\"/\"kube-root-ca.crt\""
Jul 06 19:41:41.019537 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.019517    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c985ce\"/\"openshift-service-ca.crt\""
Jul 06 19:41:41.019615 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.019593    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c985ce\"/\"default-dockercfg-4ks9z\""
Jul 06 19:41:41.020333 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.020315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c985ce\"/\"test-model-c985ce-kserve-self-signed-certs\""
Jul 06 19:41:41.027944 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.027916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"]
Jul 06 19:41:41.091524 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.091490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8a77478-0fdc-4d19-a34b-a4d80baad094-tls-certs\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.091693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.091529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8tnm\" (UniqueName: \"kubernetes.io/projected/c8a77478-0fdc-4d19-a34b-a4d80baad094-kube-api-access-l8tnm\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.091693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.091617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-dshm\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.091693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.091660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-model-cache\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.091693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.091687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-home\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.091851 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.091724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-tmp-dir\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193102 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8a77478-0fdc-4d19-a34b-a4d80baad094-tls-certs\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8tnm\" (UniqueName: \"kubernetes.io/projected/c8a77478-0fdc-4d19-a34b-a4d80baad094-kube-api-access-l8tnm\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-dshm\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-model-cache\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-home\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-tmp-dir\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193698 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193669    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-model-cache\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193698 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193691    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-home\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.193827 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.193744    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-tmp-dir\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.195642 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.195617    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-dshm\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.195882 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.195866    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8a77478-0fdc-4d19-a34b-a4d80baad094-tls-certs\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.204625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.204599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8tnm\" (UniqueName: \"kubernetes.io/projected/c8a77478-0fdc-4d19-a34b-a4d80baad094-kube-api-access-l8tnm\") pod \"test-model-c985ce-kserve-54dc97bfcf-8rcgm\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") " pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.326261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.326174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:41.472842 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:41.472811    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"]
Jul 06 19:41:41.474660 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:41:41.474635    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8a77478_0fdc_4d19_a34b_a4d80baad094.slice/crio-0ea29ac871053cdda3c6518b5c0fd9e9cee95ef010cd6e8a7e7a35fb28f66951 WatchSource:0}: Error finding container 0ea29ac871053cdda3c6518b5c0fd9e9cee95ef010cd6e8a7e7a35fb28f66951: Status 404 returned error can't find the container with id 0ea29ac871053cdda3c6518b5c0fd9e9cee95ef010cd6e8a7e7a35fb28f66951
Jul 06 19:41:42.214182 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:42.214145    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm" event={"ID":"c8a77478-0fdc-4d19-a34b-a4d80baad094","Type":"ContainerStarted","Data":"ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671"}
Jul 06 19:41:42.214609 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:42.214199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm" event={"ID":"c8a77478-0fdc-4d19-a34b-a4d80baad094","Type":"ContainerStarted","Data":"0ea29ac871053cdda3c6518b5c0fd9e9cee95ef010cd6e8a7e7a35fb28f66951"}
Jul 06 19:41:42.238392 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:42.238344    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm" podStartSLOduration=2.23832945 podStartE2EDuration="2.23832945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:42.236920029 +0000 UTC m=+2161.987629280" watchObservedRunningTime="2026-07-06 19:41:42.23832945 +0000 UTC m=+2161.989038696"
Jul 06 19:41:45.879240 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:45.879195    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:41:51.326417 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:51.326371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:51.326417 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:51.326425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:51.338893 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:51.338867    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:52.274362 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:52.274336    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:41:56.394794 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:41:56.394755    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:42:20.386916 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:20.386871    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:42:38.540541 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:38.540503    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"]
Jul 06 19:42:44.102066 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:44.102022    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:42:53.560934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.560869    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm" podUID="c8a77478-0fdc-4d19-a34b-a4d80baad094" containerName="main" containerID="cri-o://ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671" gracePeriod=45
Jul 06 19:42:53.814612 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.814547    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:42:53.867532 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867500    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8a77478-0fdc-4d19-a34b-a4d80baad094-tls-certs\") pod \"c8a77478-0fdc-4d19-a34b-a4d80baad094\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") "
Jul 06 19:42:53.867693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867559    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-model-cache\") pod \"c8a77478-0fdc-4d19-a34b-a4d80baad094\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") "
Jul 06 19:42:53.867693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867615    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-home\") pod \"c8a77478-0fdc-4d19-a34b-a4d80baad094\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") "
Jul 06 19:42:53.867693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867637    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-tmp-dir\") pod \"c8a77478-0fdc-4d19-a34b-a4d80baad094\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") "
Jul 06 19:42:53.867693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867657    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-dshm\") pod \"c8a77478-0fdc-4d19-a34b-a4d80baad094\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") "
Jul 06 19:42:53.867693 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867682    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8tnm\" (UniqueName: \"kubernetes.io/projected/c8a77478-0fdc-4d19-a34b-a4d80baad094-kube-api-access-l8tnm\") pod \"c8a77478-0fdc-4d19-a34b-a4d80baad094\" (UID: \"c8a77478-0fdc-4d19-a34b-a4d80baad094\") "
Jul 06 19:42:53.867938 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867818    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8a77478-0fdc-4d19-a34b-a4d80baad094" (UID: "c8a77478-0fdc-4d19-a34b-a4d80baad094"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:53.867938 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867890    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8a77478-0fdc-4d19-a34b-a4d80baad094" (UID: "c8a77478-0fdc-4d19-a34b-a4d80baad094"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:53.867938 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867912    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-home" (OuterVolumeSpecName: "home") pod "c8a77478-0fdc-4d19-a34b-a4d80baad094" (UID: "c8a77478-0fdc-4d19-a34b-a4d80baad094"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:53.868180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867983    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-model-cache\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:42:53.868180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.867994    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-home\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:42:53.868180 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.868003    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-tmp-dir\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:42:53.869976 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.869941    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-dshm" (OuterVolumeSpecName: "dshm") pod "c8a77478-0fdc-4d19-a34b-a4d80baad094" (UID: "c8a77478-0fdc-4d19-a34b-a4d80baad094"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:53.870093 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.869995    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8a77478-0fdc-4d19-a34b-a4d80baad094-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8a77478-0fdc-4d19-a34b-a4d80baad094" (UID: "c8a77478-0fdc-4d19-a34b-a4d80baad094"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:42:53.870093 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.869996    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a77478-0fdc-4d19-a34b-a4d80baad094-kube-api-access-l8tnm" (OuterVolumeSpecName: "kube-api-access-l8tnm") pod "c8a77478-0fdc-4d19-a34b-a4d80baad094" (UID: "c8a77478-0fdc-4d19-a34b-a4d80baad094"). InnerVolumeSpecName "kube-api-access-l8tnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:42:53.968940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.968903    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8a77478-0fdc-4d19-a34b-a4d80baad094-tls-certs\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:42:53.968940 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.968933    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8a77478-0fdc-4d19-a34b-a4d80baad094-dshm\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:42:53.969200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:53.968955    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8tnm\" (UniqueName: \"kubernetes.io/projected/c8a77478-0fdc-4d19-a34b-a4d80baad094-kube-api-access-l8tnm\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:42:54.580568 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.580536    2561 generic.go:356] "Generic (PLEG): container finished" podID="c8a77478-0fdc-4d19-a34b-a4d80baad094" containerID="ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671" exitCode=0
Jul 06 19:42:54.580999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.580587    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"
Jul 06 19:42:54.580999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.580591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm" event={"ID":"c8a77478-0fdc-4d19-a34b-a4d80baad094","Type":"ContainerDied","Data":"ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671"}
Jul 06 19:42:54.580999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.580669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm" event={"ID":"c8a77478-0fdc-4d19-a34b-a4d80baad094","Type":"ContainerDied","Data":"0ea29ac871053cdda3c6518b5c0fd9e9cee95ef010cd6e8a7e7a35fb28f66951"}
Jul 06 19:42:54.580999 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.580689    2561 scope.go:117] "RemoveContainer" containerID="ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671"
Jul 06 19:42:54.590206 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.590187    2561 scope.go:117] "RemoveContainer" containerID="ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671"
Jul 06 19:42:54.590487 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:42:54.590466    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671\": container with ID starting with ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671 not found: ID does not exist" containerID="ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671"
Jul 06 19:42:54.590539 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.590495    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671"} err="failed to get container status \"ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671\": rpc error: code = NotFound desc = could not find container \"ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671\": container with ID starting with ae29c600c03e1e0087909706d1938c7edce6472e461fe372132cb1d675792671 not found: ID does not exist"
Jul 06 19:42:54.604934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.604909    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"]
Jul 06 19:42:54.611213 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.611191    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c985ce/test-model-c985ce-kserve-54dc97bfcf-8rcgm"]
Jul 06 19:42:54.884472 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:42:54.884382    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a77478-0fdc-4d19-a34b-a4d80baad094" path="/var/lib/kubelet/pods/c8a77478-0fdc-4d19-a34b-a4d80baad094/volumes"
Jul 06 19:43:27.385848 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:43:27.385807    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:43:40.693441 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:43:40.693407    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:43:53.393435 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:43:53.393396    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:44:06.811338 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:44:06.811303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:44:19.796057 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:44:19.796016    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:44:32.185866 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:44:32.185788    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:44:39.387098 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:44:39.387057    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:45:09.481428 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.481388    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"]
Jul 06 19:45:09.482101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.482046    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a77478-0fdc-4d19-a34b-a4d80baad094" containerName="main"
Jul 06 19:45:09.482101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.482069    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a77478-0fdc-4d19-a34b-a4d80baad094" containerName="main"
Jul 06 19:45:09.482246 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.482232    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a77478-0fdc-4d19-a34b-a4d80baad094" containerName="main"
Jul 06 19:45:09.485391 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.485375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.488988 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.488963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"default-dockercfg-l648m\""
Jul 06 19:45:09.488988 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.488985    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"auth-test-model-9293de-kserve-self-signed-certs\""
Jul 06 19:45:09.489201 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.489002    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"kube-root-ca.crt\""
Jul 06 19:45:09.489201 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.489012    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"openshift-service-ca.crt\""
Jul 06 19:45:09.495477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.495454    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"]
Jul 06 19:45:09.544933 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.544901    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-dshm\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.545118 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.544939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dabdd53-6ee9-413e-be72-191c7049f066-tls-certs\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.545118 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.544961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gncx\" (UniqueName: \"kubernetes.io/projected/6dabdd53-6ee9-413e-be72-191c7049f066-kube-api-access-2gncx\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.545118 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.545057    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-home\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.545118 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.545087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-model-cache\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.545281 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.545123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-tmp-dir\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.645828 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.645791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-dshm\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.645828 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.645830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dabdd53-6ee9-413e-be72-191c7049f066-tls-certs\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646077 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.645852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gncx\" (UniqueName: \"kubernetes.io/projected/6dabdd53-6ee9-413e-be72-191c7049f066-kube-api-access-2gncx\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646077 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.645897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-home\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646077 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.646014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-model-cache\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646077 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.646065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-tmp-dir\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646317 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.646296    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-home\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646381 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.646358    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-model-cache\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.646446 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.646428    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-tmp-dir\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.648299 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.648275    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-dshm\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.648625 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.648608    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dabdd53-6ee9-413e-be72-191c7049f066-tls-certs\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.657845 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.657819    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gncx\" (UniqueName: \"kubernetes.io/projected/6dabdd53-6ee9-413e-be72-191c7049f066-kube-api-access-2gncx\") pod \"auth-test-model-9293de-kserve-5887fd6dc-99bm4\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") " pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.795596 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.795506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:09.950648 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:09.950612    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"]
Jul 06 19:45:09.952183 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:45:09.952155    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dabdd53_6ee9_413e_be72_191c7049f066.slice/crio-b2ad3874ac56250f5b2eca96a0be6a35f3075eeec46fad48d4e6267bab5e53ec WatchSource:0}: Error finding container b2ad3874ac56250f5b2eca96a0be6a35f3075eeec46fad48d4e6267bab5e53ec: Status 404 returned error can't find the container with id b2ad3874ac56250f5b2eca96a0be6a35f3075eeec46fad48d4e6267bab5e53ec
Jul 06 19:45:10.274769 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:10.274729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4" event={"ID":"6dabdd53-6ee9-413e-be72-191c7049f066","Type":"ContainerStarted","Data":"674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222"}
Jul 06 19:45:10.274954 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:10.274780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4" event={"ID":"6dabdd53-6ee9-413e-be72-191c7049f066","Type":"ContainerStarted","Data":"b2ad3874ac56250f5b2eca96a0be6a35f3075eeec46fad48d4e6267bab5e53ec"}
Jul 06 19:45:10.299638 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:10.299586    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4" podStartSLOduration=1.299572813 podStartE2EDuration="1.299572813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:10.297905577 +0000 UTC m=+2370.048614861" watchObservedRunningTime="2026-07-06 19:45:10.299572813 +0000 UTC m=+2370.050282060"
Jul 06 19:45:13.078240 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:13.078200    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:45:19.795675 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:19.795636    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:19.796086 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:19.795696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:19.808071 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:19.808042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:20.335338 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:20.335310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:45:30.203744 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:30.203707    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:45:40.880653 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:40.880622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:45:40.888428 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:40.888405    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:45:45.199151 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:45:45.199085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:46:01.895838 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:46:01.895741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:46:17.627879 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:46:17.627849    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:46:32.883569 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:46:32.883542    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:46:49.212217 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:46:49.212175    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:47:04.892546 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:04.892511    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:47:09.510355 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:09.510323    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"]
Jul 06 19:47:21.594511 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:21.594471    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:47:24.531463 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.531424    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4" podUID="6dabdd53-6ee9-413e-be72-191c7049f066" containerName="main" containerID="cri-o://674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222" gracePeriod=45
Jul 06 19:47:24.782613 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.782550    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:47:24.894136 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894086    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-dshm\") pod \"6dabdd53-6ee9-413e-be72-191c7049f066\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") "
Jul 06 19:47:24.894313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894179    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-home\") pod \"6dabdd53-6ee9-413e-be72-191c7049f066\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") "
Jul 06 19:47:24.894313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-tmp-dir\") pod \"6dabdd53-6ee9-413e-be72-191c7049f066\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") "
Jul 06 19:47:24.894313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gncx\" (UniqueName: \"kubernetes.io/projected/6dabdd53-6ee9-413e-be72-191c7049f066-kube-api-access-2gncx\") pod \"6dabdd53-6ee9-413e-be72-191c7049f066\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") "
Jul 06 19:47:24.894313 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894285    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-model-cache\") pod \"6dabdd53-6ee9-413e-be72-191c7049f066\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") "
Jul 06 19:47:24.894552 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894319    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dabdd53-6ee9-413e-be72-191c7049f066-tls-certs\") pod \"6dabdd53-6ee9-413e-be72-191c7049f066\" (UID: \"6dabdd53-6ee9-413e-be72-191c7049f066\") "
Jul 06 19:47:24.894609 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894546    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6dabdd53-6ee9-413e-be72-191c7049f066" (UID: "6dabdd53-6ee9-413e-be72-191c7049f066"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.894609 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894556    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-model-cache" (OuterVolumeSpecName: "model-cache") pod "6dabdd53-6ee9-413e-be72-191c7049f066" (UID: "6dabdd53-6ee9-413e-be72-191c7049f066"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.894807 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.894749    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-home" (OuterVolumeSpecName: "home") pod "6dabdd53-6ee9-413e-be72-191c7049f066" (UID: "6dabdd53-6ee9-413e-be72-191c7049f066"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.896495 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.896472    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-dshm" (OuterVolumeSpecName: "dshm") pod "6dabdd53-6ee9-413e-be72-191c7049f066" (UID: "6dabdd53-6ee9-413e-be72-191c7049f066"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.896618 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.896585    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dabdd53-6ee9-413e-be72-191c7049f066-kube-api-access-2gncx" (OuterVolumeSpecName: "kube-api-access-2gncx") pod "6dabdd53-6ee9-413e-be72-191c7049f066" (UID: "6dabdd53-6ee9-413e-be72-191c7049f066"). InnerVolumeSpecName "kube-api-access-2gncx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:47:24.896666 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.896613    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dabdd53-6ee9-413e-be72-191c7049f066-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6dabdd53-6ee9-413e-be72-191c7049f066" (UID: "6dabdd53-6ee9-413e-be72-191c7049f066"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:47:24.973256 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.973220    2561 generic.go:356] "Generic (PLEG): container finished" podID="6dabdd53-6ee9-413e-be72-191c7049f066" containerID="674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222" exitCode=0
Jul 06 19:47:24.973405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.973265    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"
Jul 06 19:47:24.973405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.973306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4" event={"ID":"6dabdd53-6ee9-413e-be72-191c7049f066","Type":"ContainerDied","Data":"674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222"}
Jul 06 19:47:24.973405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.973341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4" event={"ID":"6dabdd53-6ee9-413e-be72-191c7049f066","Type":"ContainerDied","Data":"b2ad3874ac56250f5b2eca96a0be6a35f3075eeec46fad48d4e6267bab5e53ec"}
Jul 06 19:47:24.973405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.973358    2561 scope.go:117] "RemoveContainer" containerID="674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222"
Jul 06 19:47:24.989660 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.989638    2561 scope.go:117] "RemoveContainer" containerID="674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222"
Jul 06 19:47:24.989917 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:47:24.989897    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222\": container with ID starting with 674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222 not found: ID does not exist" containerID="674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222"
Jul 06 19:47:24.989963 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.989925    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222"} err="failed to get container status \"674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222\": rpc error: code = NotFound desc = could not find container \"674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222\": container with ID starting with 674a902b08382d8bedec0fd03d01c2187f0cdf2d798c2d071ac9226436b39222 not found: ID does not exist"
Jul 06 19:47:24.995266 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.995247    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-home\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.995266 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.995267    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-tmp-dir\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.995432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.995276    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gncx\" (UniqueName: \"kubernetes.io/projected/6dabdd53-6ee9-413e-be72-191c7049f066-kube-api-access-2gncx\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.995432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.995286    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-model-cache\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.995432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.995295    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dabdd53-6ee9-413e-be72-191c7049f066-tls-certs\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.995432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:24.995302    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dabdd53-6ee9-413e-be72-191c7049f066-dshm\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:47:25.006075 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:25.006051    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"]
Jul 06 19:47:25.012205 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:25.012184    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/auth-test-model-9293de-kserve-5887fd6dc-99bm4"]
Jul 06 19:47:26.883022 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:26.882985    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dabdd53-6ee9-413e-be72-191c7049f066" path="/var/lib/kubelet/pods/6dabdd53-6ee9-413e-be72-191c7049f066/volumes"
Jul 06 19:47:50.682380 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:47:50.682334    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:48:04.308527 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.308483    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"]
Jul 06 19:48:04.309148 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.309050    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dabdd53-6ee9-413e-be72-191c7049f066" containerName="main"
Jul 06 19:48:04.309148 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.309070    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dabdd53-6ee9-413e-be72-191c7049f066" containerName="main"
Jul 06 19:48:04.309291 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.309210    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dabdd53-6ee9-413e-be72-191c7049f066" containerName="main"
Jul 06 19:48:04.312378 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.312356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.316595 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.316573    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"kube-root-ca.crt\""
Jul 06 19:48:04.316723 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.316600    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"sub-test-model-9293de-kserve-self-signed-certs\""
Jul 06 19:48:04.316723 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.316576    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"default-dockercfg-l648m\""
Jul 06 19:48:04.316906 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.316727    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"openshift-service-ca.crt\""
Jul 06 19:48:04.324047 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.324027    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"]
Jul 06 19:48:04.447839 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.447804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tmp-dir\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.448003 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.447847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dwg\" (UniqueName: \"kubernetes.io/projected/919433f3-5dab-4f9c-afb7-f3dda8e7032c-kube-api-access-99dwg\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.448003 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.447871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-model-cache\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.448003 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.447925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tls-certs\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.448174 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.448012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-home\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.448174 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.448041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-dshm\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549261 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tmp-dir\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99dwg\" (UniqueName: \"kubernetes.io/projected/919433f3-5dab-4f9c-afb7-f3dda8e7032c-kube-api-access-99dwg\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-model-cache\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tls-certs\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-home\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-dshm\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549728 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549707    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-model-cache\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549785 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549727    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tmp-dir\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.549785 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.549758    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-home\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.551792 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.551770    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-dshm\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.552049 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.552029    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tls-certs\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.559695 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.559630    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dwg\" (UniqueName: \"kubernetes.io/projected/919433f3-5dab-4f9c-afb7-f3dda8e7032c-kube-api-access-99dwg\") pod \"sub-test-model-9293de-kserve-85f86d5f-x282v\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") " pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.622325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.622285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:04.762712 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:04.762687    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"]
Jul 06 19:48:04.764647 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:48:04.764619    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod919433f3_5dab_4f9c_afb7_f3dda8e7032c.slice/crio-e6d50dee3ea3b347d15206489aba2c9c4ca0353ce6012e95999325b5cc951719 WatchSource:0}: Error finding container e6d50dee3ea3b347d15206489aba2c9c4ca0353ce6012e95999325b5cc951719: Status 404 returned error can't find the container with id e6d50dee3ea3b347d15206489aba2c9c4ca0353ce6012e95999325b5cc951719
Jul 06 19:48:05.179935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:05.179838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v" event={"ID":"919433f3-5dab-4f9c-afb7-f3dda8e7032c","Type":"ContainerStarted","Data":"02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783"}
Jul 06 19:48:05.179935 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:05.179884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v" event={"ID":"919433f3-5dab-4f9c-afb7-f3dda8e7032c","Type":"ContainerStarted","Data":"e6d50dee3ea3b347d15206489aba2c9c4ca0353ce6012e95999325b5cc951719"}
Jul 06 19:48:05.202015 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:05.201962    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v" podStartSLOduration=1.201947247 podStartE2EDuration="1.201947247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:48:05.199628806 +0000 UTC m=+2544.950338080" watchObservedRunningTime="2026-07-06 19:48:05.201947247 +0000 UTC m=+2544.952656523"
Jul 06 19:48:08.398096 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:08.398057    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:48:14.623009 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:14.622972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:14.623405 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:14.623037    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:14.635725 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:14.635698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:15.239621 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:15.239589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:48:31.692585 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:31.692544    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:48:49.290171 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:49.290138    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:48:55.469499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:48:55.469467    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"]
Jul 06 19:49:04.683677 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.683641    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"]
Jul 06 19:49:04.687344 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.687323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.691144 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.691102    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"default-dockercfg-4clmw\""
Jul 06 19:49:04.691144 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.691103    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"openshift-service-ca.crt\""
Jul 06 19:49:04.691327 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.691102    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"kube-root-ca.crt\""
Jul 06 19:49:04.691327 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.691269    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"rate-test-model-f22821-kserve-self-signed-certs\""
Jul 06 19:49:04.697883 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.697860    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"]
Jul 06 19:49:04.811163 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.811130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-dshm\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.811163 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.811161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-model-cache\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.811387 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.811186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tmp-dir\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.811387 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.811204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8bs\" (UniqueName: \"kubernetes.io/projected/f29c63df-2ab0-4620-a98e-e91ae4855fbb-kube-api-access-rl8bs\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.811387 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.811297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-home\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.811387 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.811335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tls-certs\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.912834 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.912801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-dshm\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.912838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-model-cache\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.912872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tmp-dir\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.912897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8bs\" (UniqueName: \"kubernetes.io/projected/f29c63df-2ab0-4620-a98e-e91ae4855fbb-kube-api-access-rl8bs\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.912962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-home\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.912992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tls-certs\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913357 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.913298    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-model-cache\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913463 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.913444    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tmp-dir\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.913636 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.913617    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-home\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.915848 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.915817    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tls-certs\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.915970 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.915912    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-dshm\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.923221 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.923193    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8bs\" (UniqueName: \"kubernetes.io/projected/f29c63df-2ab0-4620-a98e-e91ae4855fbb-kube-api-access-rl8bs\") pod \"rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") " pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:04.997499 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:04.997461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:05.143652 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:05.143622    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"]
Jul 06 19:49:05.145746 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:49:05.145720    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf29c63df_2ab0_4620_a98e_e91ae4855fbb.slice/crio-32e83c26e10b0eeb3695f8fb55ea0e0aca5a622767d2dd05aaf817a0eb05b6cd WatchSource:0}: Error finding container 32e83c26e10b0eeb3695f8fb55ea0e0aca5a622767d2dd05aaf817a0eb05b6cd: Status 404 returned error can't find the container with id 32e83c26e10b0eeb3695f8fb55ea0e0aca5a622767d2dd05aaf817a0eb05b6cd
Jul 06 19:49:05.489057 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:05.489017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg" event={"ID":"f29c63df-2ab0-4620-a98e-e91ae4855fbb","Type":"ContainerStarted","Data":"836c7473f3a6eda3c6e72ad07d075e702fb728592a81c64520fb8f6d103d3083"}
Jul 06 19:49:05.489057 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:05.489064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg" event={"ID":"f29c63df-2ab0-4620-a98e-e91ae4855fbb","Type":"ContainerStarted","Data":"32e83c26e10b0eeb3695f8fb55ea0e0aca5a622767d2dd05aaf817a0eb05b6cd"}
Jul 06 19:49:05.511517 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:05.511418    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg" podStartSLOduration=1.511402055 podStartE2EDuration="1.511402055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:49:05.509377966 +0000 UTC m=+2605.260087238" watchObservedRunningTime="2026-07-06 19:49:05.511402055 +0000 UTC m=+2605.262111303"
Jul 06 19:49:08.395740 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:08.395701    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:49:10.490029 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.489964    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v" podUID="919433f3-5dab-4f9c-afb7-f3dda8e7032c" containerName="main" containerID="cri-o://02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783" gracePeriod=45
Jul 06 19:49:10.739682 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.739659    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:49:10.868282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868195    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-model-cache\") pod \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") "
Jul 06 19:49:10.868282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868228    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-dshm\") pod \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") "
Jul 06 19:49:10.868282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868266    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tmp-dir\") pod \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") "
Jul 06 19:49:10.868616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868299    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99dwg\" (UniqueName: \"kubernetes.io/projected/919433f3-5dab-4f9c-afb7-f3dda8e7032c-kube-api-access-99dwg\") pod \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") "
Jul 06 19:49:10.868616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-home\") pod \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") "
Jul 06 19:49:10.868616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868511    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-model-cache" (OuterVolumeSpecName: "model-cache") pod "919433f3-5dab-4f9c-afb7-f3dda8e7032c" (UID: "919433f3-5dab-4f9c-afb7-f3dda8e7032c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:10.868616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tls-certs\") pod \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\" (UID: \"919433f3-5dab-4f9c-afb7-f3dda8e7032c\") "
Jul 06 19:49:10.868616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868557    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "919433f3-5dab-4f9c-afb7-f3dda8e7032c" (UID: "919433f3-5dab-4f9c-afb7-f3dda8e7032c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:10.868616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868613    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-home" (OuterVolumeSpecName: "home") pod "919433f3-5dab-4f9c-afb7-f3dda8e7032c" (UID: "919433f3-5dab-4f9c-afb7-f3dda8e7032c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:10.868934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868913    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-model-cache\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:49:10.868934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868936    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tmp-dir\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:49:10.869039 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.868945    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-home\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:49:10.870429 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.870402    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-dshm" (OuterVolumeSpecName: "dshm") pod "919433f3-5dab-4f9c-afb7-f3dda8e7032c" (UID: "919433f3-5dab-4f9c-afb7-f3dda8e7032c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:10.870641 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.870620    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919433f3-5dab-4f9c-afb7-f3dda8e7032c-kube-api-access-99dwg" (OuterVolumeSpecName: "kube-api-access-99dwg") pod "919433f3-5dab-4f9c-afb7-f3dda8e7032c" (UID: "919433f3-5dab-4f9c-afb7-f3dda8e7032c"). InnerVolumeSpecName "kube-api-access-99dwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:49:10.870726 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.870710    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "919433f3-5dab-4f9c-afb7-f3dda8e7032c" (UID: "919433f3-5dab-4f9c-afb7-f3dda8e7032c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:49:10.970036 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.969989    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/919433f3-5dab-4f9c-afb7-f3dda8e7032c-tls-certs\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:49:10.970036 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.970029    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/919433f3-5dab-4f9c-afb7-f3dda8e7032c-dshm\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:49:10.970036 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:10.970043    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99dwg\" (UniqueName: \"kubernetes.io/projected/919433f3-5dab-4f9c-afb7-f3dda8e7032c-kube-api-access-99dwg\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:49:11.519524 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.519485    2561 generic.go:356] "Generic (PLEG): container finished" podID="919433f3-5dab-4f9c-afb7-f3dda8e7032c" containerID="02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783" exitCode=0
Jul 06 19:49:11.519934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.519535    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"
Jul 06 19:49:11.519934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.519535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v" event={"ID":"919433f3-5dab-4f9c-afb7-f3dda8e7032c","Type":"ContainerDied","Data":"02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783"}
Jul 06 19:49:11.519934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.519657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v" event={"ID":"919433f3-5dab-4f9c-afb7-f3dda8e7032c","Type":"ContainerDied","Data":"e6d50dee3ea3b347d15206489aba2c9c4ca0353ce6012e95999325b5cc951719"}
Jul 06 19:49:11.519934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.519679    2561 scope.go:117] "RemoveContainer" containerID="02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783"
Jul 06 19:49:11.531503 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.531478    2561 scope.go:117] "RemoveContainer" containerID="02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783"
Jul 06 19:49:11.532000 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:49:11.531976    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783\": container with ID starting with 02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783 not found: ID does not exist" containerID="02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783"
Jul 06 19:49:11.532085 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.532008    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783"} err="failed to get container status \"02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783\": rpc error: code = NotFound desc = could not find container \"02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783\": container with ID starting with 02418b1bc37f0ed0be23826edcbf1448b2693fb7902a637457e35153b88c4783 not found: ID does not exist"
Jul 06 19:49:11.554946 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:11.554920    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"]
Jul 06 19:49:12.069101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:12.069068    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/sub-test-model-9293de-kserve-85f86d5f-x282v"]
Jul 06 19:49:12.883562 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:12.883535    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="919433f3-5dab-4f9c-afb7-f3dda8e7032c" path="/var/lib/kubelet/pods/919433f3-5dab-4f9c-afb7-f3dda8e7032c/volumes"
Jul 06 19:49:14.998413 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:14.998366    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:14.998822 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:14.998423    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:15.010998 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:15.010962    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:15.553821 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:15.553794    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:49:40.283231 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:40.283190    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:49:45.083375 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:45.083329    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" podUID="f5d35cca57c2f2c6fe15afe949f8be24" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Jul 06 19:49:51.727692 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.727654    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a2df57b-2e9d-48f3-be07-beb5631b6e68" containerID="c484bbbeb281a3c65a393e7e30b001748cfffb99a4db95b1bd5d879160b6e841" exitCode=1
Jul 06 19:49:51.728074 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.727731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7" event={"ID":"2a2df57b-2e9d-48f3-be07-beb5631b6e68","Type":"ContainerDied","Data":"c484bbbeb281a3c65a393e7e30b001748cfffb99a4db95b1bd5d879160b6e841"}
Jul 06 19:49:51.728200 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.728182    2561 scope.go:117] "RemoveContainer" containerID="c484bbbeb281a3c65a393e7e30b001748cfffb99a4db95b1bd5d879160b6e841"
Jul 06 19:49:51.729435 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.729416    2561 generic.go:356] "Generic (PLEG): container finished" podID="7e09dbad-5ca8-4868-9916-8e6ef4b07aae" containerID="2d0343a43fc78e221672c7a6a42857a91d8fa259c91da4ea8c82c1eceed6d39f" exitCode=1
Jul 06 19:49:51.729550 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.729496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" event={"ID":"7e09dbad-5ca8-4868-9916-8e6ef4b07aae","Type":"ContainerDied","Data":"2d0343a43fc78e221672c7a6a42857a91d8fa259c91da4ea8c82c1eceed6d39f"}
Jul 06 19:49:51.729877 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.729849    2561 scope.go:117] "RemoveContainer" containerID="2d0343a43fc78e221672c7a6a42857a91d8fa259c91da4ea8c82c1eceed6d39f"
Jul 06 19:49:51.730194 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.730180    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:49:51.733944 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.733884    2561 generic.go:356] "Generic (PLEG): container finished" podID="be5d3c9b-b186-46f6-8b4c-938dd7f942de" containerID="931358d5d92e04f83ae6781d28d9d495072b9e318aa038fccb3e170165168b21" exitCode=1
Jul 06 19:49:51.734011 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.733958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" event={"ID":"be5d3c9b-b186-46f6-8b4c-938dd7f942de","Type":"ContainerDied","Data":"931358d5d92e04f83ae6781d28d9d495072b9e318aa038fccb3e170165168b21"}
Jul 06 19:49:51.734282 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.734263    2561 scope.go:117] "RemoveContainer" containerID="931358d5d92e04f83ae6781d28d9d495072b9e318aa038fccb3e170165168b21"
Jul 06 19:49:51.735892 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.735873    2561 generic.go:356] "Generic (PLEG): container finished" podID="65f40ce0-2d85-4f85-93f1-aa75afcd0e73" containerID="48908b955ee6f175dabc1f73b1ca16f4a58340ff06836c90e2864f4e77f8599e" exitCode=1
Jul 06 19:49:51.735978 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.735943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" event={"ID":"65f40ce0-2d85-4f85-93f1-aa75afcd0e73","Type":"ContainerDied","Data":"48908b955ee6f175dabc1f73b1ca16f4a58340ff06836c90e2864f4e77f8599e"}
Jul 06 19:49:51.736275 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.736256    2561 scope.go:117] "RemoveContainer" containerID="48908b955ee6f175dabc1f73b1ca16f4a58340ff06836c90e2864f4e77f8599e"
Jul 06 19:49:51.737810 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.737792    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2d06e2c-16da-4916-8be3-18f88584302b" containerID="4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f" exitCode=1
Jul 06 19:49:51.737904 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.737868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" event={"ID":"b2d06e2c-16da-4916-8be3-18f88584302b","Type":"ContainerDied","Data":"4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f"}
Jul 06 19:49:51.738163 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.738145    2561 scope.go:117] "RemoveContainer" containerID="4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f"
Jul 06 19:49:51.739572 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.739552    2561 generic.go:356] "Generic (PLEG): container finished" podID="1d7cfb91-a126-4804-9cdf-925be60ef3a3" containerID="03c0c6e4af2b0418f3fe66f315ab805d12c0bfd7077cd31372f4b391cf009424" exitCode=0
Jul 06 19:49:51.739666 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.739587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" event={"ID":"1d7cfb91-a126-4804-9cdf-925be60ef3a3","Type":"ContainerDied","Data":"03c0c6e4af2b0418f3fe66f315ab805d12c0bfd7077cd31372f4b391cf009424"}
Jul 06 19:49:51.739855 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:51.739838    2561 scope.go:117] "RemoveContainer" containerID="03c0c6e4af2b0418f3fe66f315ab805d12c0bfd7077cd31372f4b391cf009424"
Jul 06 19:49:52.144373 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.144350    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:49:52.741918 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:49:52.741882    2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod dns-operator-controller-manager-864dd78c4c-7sfs2_kuadrant-system(b2d06e2c-16da-4916-8be3-18f88584302b): CreateContainerConfigError: failed to sync configmap cache: timed out waiting for the condition" logger="UnhandledError"
Jul 06 19:49:52.742319 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:49:52.741928    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CreateContainerConfigError: \"failed to sync configmap cache: timed out waiting for the condition\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" podUID="b2d06e2c-16da-4916-8be3-18f88584302b"
Jul 06 19:49:52.747473 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.747439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" event={"ID":"7e09dbad-5ca8-4868-9916-8e6ef4b07aae","Type":"ContainerStarted","Data":"637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70"}
Jul 06 19:49:52.747665 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.747650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:49:52.749245 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.749219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" event={"ID":"be5d3c9b-b186-46f6-8b4c-938dd7f942de","Type":"ContainerStarted","Data":"ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe"}
Jul 06 19:49:52.749421 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.749408    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:49:52.750890 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.750868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" event={"ID":"65f40ce0-2d85-4f85-93f1-aa75afcd0e73","Type":"ContainerStarted","Data":"c31fa0a74ab7221fc595f8a1f47fe6cd9423cbafd8af00110643bc2c4205c772"}
Jul 06 19:49:52.750995 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.750906    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:49:52.752648 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.752629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" event={"ID":"1d7cfb91-a126-4804-9cdf-925be60ef3a3","Type":"ContainerStarted","Data":"f4cc7ff150da03255acca8d142ee173f7c9fd6d5056f60381f70f9b47150c026"}
Jul 06 19:49:52.752809 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.752794    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:49:52.757407 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.757386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7" event={"ID":"2a2df57b-2e9d-48f3-be07-beb5631b6e68","Type":"ContainerStarted","Data":"2ad7e6a8028f46091bea2a4715e8533cfc7d4b61eba505bbc6d12cb58b1a76ea"}
Jul 06 19:49:52.757572 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:52.757557    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:49:53.486173 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:53.486134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:49:53.763578 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:53.763504    2561 scope.go:117] "RemoveContainer" containerID="4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f"
Jul 06 19:49:53.763913 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:49:53.763644    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-7sfs2_kuadrant-system(b2d06e2c-16da-4916-8be3-18f88584302b)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" podUID="b2d06e2c-16da-4916-8be3-18f88584302b"
Jul 06 19:49:56.077712 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:49:56.077678    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:50:03.765324 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:03.765287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:50:03.765798 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:03.765366    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:50:03.765798 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:03.765546    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bjrd7"
Jul 06 19:50:04.876502 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:04.876431    2561 scope.go:117] "RemoveContainer" containerID="4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f"
Jul 06 19:50:05.829866 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:05.829831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" event={"ID":"b2d06e2c-16da-4916-8be3-18f88584302b","Type":"ContainerStarted","Data":"65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e"}
Jul 06 19:50:05.830101 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:05.830080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:50:16.837068 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:16.837031    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:50:23.768296 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:23.768262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:50:23.913646 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:23.913612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:50:40.910459 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:40.910378    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:50:40.921119 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:40.921086    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:50:53.977396 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:53.977361    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"]
Jul 06 19:50:57.360014 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:50:57.359954    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:51:08.999242 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:08.999202    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg" podUID="f29c63df-2ab0-4620-a98e-e91ae4855fbb" containerName="main" containerID="cri-o://836c7473f3a6eda3c6e72ad07d075e702fb728592a81c64520fb8f6d103d3083" gracePeriod=45
Jul 06 19:51:09.152644 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.152610    2561 generic.go:356] "Generic (PLEG): container finished" podID="f29c63df-2ab0-4620-a98e-e91ae4855fbb" containerID="836c7473f3a6eda3c6e72ad07d075e702fb728592a81c64520fb8f6d103d3083" exitCode=0
Jul 06 19:51:09.152790 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.152673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg" event={"ID":"f29c63df-2ab0-4620-a98e-e91ae4855fbb","Type":"ContainerDied","Data":"836c7473f3a6eda3c6e72ad07d075e702fb728592a81c64520fb8f6d103d3083"}
Jul 06 19:51:09.258219 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.258157    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:51:09.349128 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349078    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-home\") pod \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") "
Jul 06 19:51:09.349284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349146    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-model-cache\") pod \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") "
Jul 06 19:51:09.349284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349202    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tls-certs\") pod \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") "
Jul 06 19:51:09.349284 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349268    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl8bs\" (UniqueName: \"kubernetes.io/projected/f29c63df-2ab0-4620-a98e-e91ae4855fbb-kube-api-access-rl8bs\") pod \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") "
Jul 06 19:51:09.349425 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349315    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tmp-dir\") pod \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") "
Jul 06 19:51:09.349425 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349386    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-home" (OuterVolumeSpecName: "home") pod "f29c63df-2ab0-4620-a98e-e91ae4855fbb" (UID: "f29c63df-2ab0-4620-a98e-e91ae4855fbb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:09.349512 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349429    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-model-cache" (OuterVolumeSpecName: "model-cache") pod "f29c63df-2ab0-4620-a98e-e91ae4855fbb" (UID: "f29c63df-2ab0-4620-a98e-e91ae4855fbb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:09.349512 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349453    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-dshm\") pod \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\" (UID: \"f29c63df-2ab0-4620-a98e-e91ae4855fbb\") "
Jul 06 19:51:09.349601 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349520    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f29c63df-2ab0-4620-a98e-e91ae4855fbb" (UID: "f29c63df-2ab0-4620-a98e-e91ae4855fbb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:09.349751 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349727    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tmp-dir\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:51:09.349751 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349752    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-home\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:51:09.349904 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.349765    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-model-cache\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:51:09.351527 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.351501    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-dshm" (OuterVolumeSpecName: "dshm") pod "f29c63df-2ab0-4620-a98e-e91ae4855fbb" (UID: "f29c63df-2ab0-4620-a98e-e91ae4855fbb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:09.351611 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.351550    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f29c63df-2ab0-4620-a98e-e91ae4855fbb" (UID: "f29c63df-2ab0-4620-a98e-e91ae4855fbb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:51:09.351681 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.351658    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f29c63df-2ab0-4620-a98e-e91ae4855fbb-kube-api-access-rl8bs" (OuterVolumeSpecName: "kube-api-access-rl8bs") pod "f29c63df-2ab0-4620-a98e-e91ae4855fbb" (UID: "f29c63df-2ab0-4620-a98e-e91ae4855fbb"). InnerVolumeSpecName "kube-api-access-rl8bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:09.450521 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.450493    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29c63df-2ab0-4620-a98e-e91ae4855fbb-tls-certs\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:51:09.450521 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.450519    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl8bs\" (UniqueName: \"kubernetes.io/projected/f29c63df-2ab0-4620-a98e-e91ae4855fbb-kube-api-access-rl8bs\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:51:09.450695 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:09.450528    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29c63df-2ab0-4620-a98e-e91ae4855fbb-dshm\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\""
Jul 06 19:51:10.159254 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:10.159224    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"
Jul 06 19:51:10.159726 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:10.159243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg" event={"ID":"f29c63df-2ab0-4620-a98e-e91ae4855fbb","Type":"ContainerDied","Data":"32e83c26e10b0eeb3695f8fb55ea0e0aca5a622767d2dd05aaf817a0eb05b6cd"}
Jul 06 19:51:10.159726 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:10.159305    2561 scope.go:117] "RemoveContainer" containerID="836c7473f3a6eda3c6e72ad07d075e702fb728592a81c64520fb8f6d103d3083"
Jul 06 19:51:10.201513 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:10.201446    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"]
Jul 06 19:51:10.204403 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:10.204380    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/rate-test-model-f22821-kserve-7c6c5cdcc9-n2qlg"]
Jul 06 19:51:10.883477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:10.883441    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f29c63df-2ab0-4620-a98e-e91ae4855fbb" path="/var/lib/kubelet/pods/f29c63df-2ab0-4620-a98e-e91ae4855fbb/volumes"
Jul 06 19:51:36.042728 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:36.042684    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:51:48.451911 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:51:48.451876    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:52:29.498033 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:29.497995    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2dbs2"]
Jul 06 19:52:42.065089 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:42.065062    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kzv7k_7e09dbad-5ca8-4868-9916-8e6ef4b07aae/manager/1.log"
Jul 06 19:52:42.194432 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:42.194395    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5g4cq_65f40ce0-2d85-4f85-93f1-aa75afcd0e73/manager/1.log"
Jul 06 19:52:42.812572 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:42.812541    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qr2wf_bc46c97e-f7d9-4ef5-82bf-123f025befcc/server/0.log"
Jul 06 19:52:43.189566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:43.189474    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b48f9c585-4cvgp_540dd4d5-68fd-43cc-b8f8-06eefc407039/copy-manifests/0.log"
Jul 06 19:52:43.204045 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:43.204019    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b48f9c585-4cvgp_540dd4d5-68fd-43cc-b8f8-06eefc407039/manager/1.log"
Jul 06 19:52:44.921804 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:44.921776    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bjrd7_2a2df57b-2e9d-48f3-be07-beb5631b6e68/manager/1.log"
Jul 06 19:52:45.042700 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:45.042674    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7sfs2_b2d06e2c-16da-4916-8be3-18f88584302b/manager/1.log"
Jul 06 19:52:45.161642 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:45.161615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-689q6_e713d344-2474-4be0-b4c4-7a9d5aef2bd7/kuadrant-console-plugin/0.log"
Jul 06 19:52:45.279194 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:45.279166    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-brpw5_2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7/registry-server/0.log"
Jul 06 19:52:45.414530 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:45.414495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z2qqx_1d7cfb91-a126-4804-9cdf-925be60ef3a3/manager/1.log"
Jul 06 19:52:45.530562 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:45.530480    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2dbs2_ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094/limitador/0.log"
Jul 06 19:52:45.882806 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:45.882724    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lmgkb_be5d3c9b-b186-46f6-8b4c-938dd7f942de/manager/1.log"
Jul 06 19:52:46.485221 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:46.485183    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-pdzbw_dd33939c-5cd7-430d-883d-35b6fb33eddc/kube-auth-proxy/0.log"
Jul 06 19:52:46.730566 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:46.730534    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/1.log"
Jul 06 19:52:47.455581 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:47.455550    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66f45d6fc7-4846p_3df4cb41-be07-4684-afc6-c906b0a1c917/router/0.log"
Jul 06 19:52:48.190609 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:48.190579    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85ldb_ac8e6e28-4745-45a8-acd9-db5353c9806b/main/0.log"
Jul 06 19:52:48.308688 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:48.308658    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5rtwq_4f8902ba-e780-4b95-8db0-93feec69c2cd/main/0.log"
Jul 06 19:52:48.426429 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:52:48.426402    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-hnsdw_de36f74b-c9c7-4ddd-91dc-e33ca035c8ea/main/0.log"
Jul 06 19:53:10.370836 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:10.370802    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9r7wx_f5cb2f5b-6bd6-4687-9df3-a0471d2e39d7/global-pull-secret-syncer/0.log"
Jul 06 19:53:20.658057 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:20.658030    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4ds4k_d789442a-f602-4d5b-871c-731b864abea4/konnectivity-agent/0.log"
Jul 06 19:53:20.784724 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:20.784693    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-64.ec2.internal_f5d35cca57c2f2c6fe15afe949f8be24/haproxy/0.log"
Jul 06 19:53:45.083866 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:45.083760    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" podUID="f5d35cca57c2f2c6fe15afe949f8be24" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:53:47.582578 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.582531    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" podUID="65f40ce0-2d85-4f85-93f1-aa75afcd0e73" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.30:8081/healthz\": dial tcp 10.134.0.30:8081: connect: connection refused"
Jul 06 19:53:47.983853 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.983816    2561 generic.go:356] "Generic (PLEG): container finished" podID="65f40ce0-2d85-4f85-93f1-aa75afcd0e73" containerID="c31fa0a74ab7221fc595f8a1f47fe6cd9423cbafd8af00110643bc2c4205c772" exitCode=1
Jul 06 19:53:47.984038 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.983887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" event={"ID":"65f40ce0-2d85-4f85-93f1-aa75afcd0e73","Type":"ContainerDied","Data":"c31fa0a74ab7221fc595f8a1f47fe6cd9423cbafd8af00110643bc2c4205c772"}
Jul 06 19:53:47.984038 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.983950    2561 scope.go:117] "RemoveContainer" containerID="48908b955ee6f175dabc1f73b1ca16f4a58340ff06836c90e2864f4e77f8599e"
Jul 06 19:53:47.984324 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.984302    2561 scope.go:117] "RemoveContainer" containerID="c31fa0a74ab7221fc595f8a1f47fe6cd9423cbafd8af00110643bc2c4205c772"
Jul 06 19:53:47.984535 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:47.984511    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-777c6bd7d5-5g4cq_opendatahub(65f40ce0-2d85-4f85-93f1-aa75afcd0e73)\"" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" podUID="65f40ce0-2d85-4f85-93f1-aa75afcd0e73"
Jul 06 19:53:47.985934 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.985914    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2d06e2c-16da-4916-8be3-18f88584302b" containerID="65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e" exitCode=1
Jul 06 19:53:47.986004 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.985982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" event={"ID":"b2d06e2c-16da-4916-8be3-18f88584302b","Type":"ContainerDied","Data":"65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e"}
Jul 06 19:53:47.986325 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.986307    2561 scope.go:117] "RemoveContainer" containerID="65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e"
Jul 06 19:53:47.986546 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:47.986527    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-7sfs2_kuadrant-system(b2d06e2c-16da-4916-8be3-18f88584302b)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" podUID="b2d06e2c-16da-4916-8be3-18f88584302b"
Jul 06 19:53:47.987767 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.987749    2561 generic.go:356] "Generic (PLEG): container finished" podID="1d7cfb91-a126-4804-9cdf-925be60ef3a3" containerID="f4cc7ff150da03255acca8d142ee173f7c9fd6d5056f60381f70f9b47150c026" exitCode=0
Jul 06 19:53:47.987844 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.987820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" event={"ID":"1d7cfb91-a126-4804-9cdf-925be60ef3a3","Type":"ContainerDied","Data":"f4cc7ff150da03255acca8d142ee173f7c9fd6d5056f60381f70f9b47150c026"}
Jul 06 19:53:47.988096 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.988084    2561 scope.go:117] "RemoveContainer" containerID="f4cc7ff150da03255acca8d142ee173f7c9fd6d5056f60381f70f9b47150c026"
Jul 06 19:53:47.988287 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:47.988265    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-86878c769f-z2qqx_kuadrant-system(1d7cfb91-a126-4804-9cdf-925be60ef3a3)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" podUID="1d7cfb91-a126-4804-9cdf-925be60ef3a3"
Jul 06 19:53:47.990066 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.990048    2561 generic.go:356] "Generic (PLEG): container finished" podID="540dd4d5-68fd-43cc-b8f8-06eefc407039" containerID="c802540e2daeb1d47ab9bdce72a25adca7ef95977296ac8f79b3ddd8d0d54430" exitCode=1
Jul 06 19:53:47.990177 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.990145    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerDied","Data":"c802540e2daeb1d47ab9bdce72a25adca7ef95977296ac8f79b3ddd8d0d54430"}
Jul 06 19:53:47.990482 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.990465    2561 scope.go:117] "RemoveContainer" containerID="c802540e2daeb1d47ab9bdce72a25adca7ef95977296ac8f79b3ddd8d0d54430"
Jul 06 19:53:47.992031 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.992010    2561 generic.go:356] "Generic (PLEG): container finished" podID="7e09dbad-5ca8-4868-9916-8e6ef4b07aae" containerID="637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70" exitCode=1
Jul 06 19:53:47.992128 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.992082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" event={"ID":"7e09dbad-5ca8-4868-9916-8e6ef4b07aae","Type":"ContainerDied","Data":"637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70"}
Jul 06 19:53:47.992408 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.992393    2561 scope.go:117] "RemoveContainer" containerID="637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70"
Jul 06 19:53:47.992650 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:47.992622    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d6f4b65b8-kzv7k_opendatahub(7e09dbad-5ca8-4868-9916-8e6ef4b07aae)\"" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" podUID="7e09dbad-5ca8-4868-9916-8e6ef4b07aae"
Jul 06 19:53:47.994166 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.994144    2561 generic.go:356] "Generic (PLEG): container finished" podID="be5d3c9b-b186-46f6-8b4c-938dd7f942de" containerID="ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe" exitCode=1
Jul 06 19:53:47.994267 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.994179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" event={"ID":"be5d3c9b-b186-46f6-8b4c-938dd7f942de","Type":"ContainerDied","Data":"ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe"}
Jul 06 19:53:47.994477 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.994460    2561 scope.go:117] "RemoveContainer" containerID="ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe"
Jul 06 19:53:47.994653 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:47.994634    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=limitador-operator-controller-manager-859d7b78bd-lmgkb_kuadrant-system(be5d3c9b-b186-46f6-8b4c-938dd7f942de)\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" podUID="be5d3c9b-b186-46f6-8b4c-938dd7f942de"
Jul 06 19:53:47.996963 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:47.996945    2561 scope.go:117] "RemoveContainer" containerID="4ea11a6a9b0693853807e446301a811a8db74d847af379050369c6783059a50f"
Jul 06 19:53:48.008988 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.008971    2561 scope.go:117] "RemoveContainer" containerID="03c0c6e4af2b0418f3fe66f315ab805d12c0bfd7077cd31372f4b391cf009424"
Jul 06 19:53:48.021264 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.021249    2561 scope.go:117] "RemoveContainer" containerID="f26d4f91000c03f1c5143d9cbe1f31ff0076434657e7f0e86c52bcbe8857c9b0"
Jul 06 19:53:48.035327 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.035305    2561 scope.go:117] "RemoveContainer" containerID="2d0343a43fc78e221672c7a6a42857a91d8fa259c91da4ea8c82c1eceed6d39f"
Jul 06 19:53:48.046505 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.046483    2561 scope.go:117] "RemoveContainer" containerID="931358d5d92e04f83ae6781d28d9d495072b9e318aa038fccb3e170165168b21"
Jul 06 19:53:48.473191 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.473170    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:53:48.763264 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.763234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:53:48.763657 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:48.763315    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:53:49.002949 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:49.002921    2561 scope.go:117] "RemoveContainer" containerID="c31fa0a74ab7221fc595f8a1f47fe6cd9423cbafd8af00110643bc2c4205c772"
Jul 06 19:53:49.003184 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:49.003163    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-777c6bd7d5-5g4cq_opendatahub(65f40ce0-2d85-4f85-93f1-aa75afcd0e73)\"" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" podUID="65f40ce0-2d85-4f85-93f1-aa75afcd0e73"
Jul 06 19:53:49.007812 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:49.007788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp" event={"ID":"540dd4d5-68fd-43cc-b8f8-06eefc407039","Type":"ContainerStarted","Data":"6380fa1a6e37cd407f525e4fa3077c2b79a1653f35fc1a2a55a6a87215f0df60"}
Jul 06 19:53:49.008034 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:49.008017    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:53:49.009295 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:49.009278    2561 scope.go:117] "RemoveContainer" containerID="637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70"
Jul 06 19:53:49.009432 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:49.009416    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d6f4b65b8-kzv7k_opendatahub(7e09dbad-5ca8-4868-9916-8e6ef4b07aae)\"" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" podUID="7e09dbad-5ca8-4868-9916-8e6ef4b07aae"
Jul 06 19:53:49.380605 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:49.380551    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:53:49.381048 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:49.381027    2561 scope.go:117] "RemoveContainer" containerID="65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e"
Jul 06 19:53:49.381305 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:49.381279    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-7sfs2_kuadrant-system(b2d06e2c-16da-4916-8be3-18f88584302b)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" podUID="b2d06e2c-16da-4916-8be3-18f88584302b"
Jul 06 19:53:50.014960 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:50.014930    2561 scope.go:117] "RemoveContainer" containerID="637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70"
Jul 06 19:53:50.015375 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:50.015152    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d6f4b65b8-kzv7k_opendatahub(7e09dbad-5ca8-4868-9916-8e6ef4b07aae)\"" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" podUID="7e09dbad-5ca8-4868-9916-8e6ef4b07aae"
Jul 06 19:53:53.763778 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:53.763738    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:53:53.764217 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:53.763815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:53:53.764277 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:53.764214    2561 scope.go:117] "RemoveContainer" containerID="ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe"
Jul 06 19:53:53.764323 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:53.764310    2561 scope.go:117] "RemoveContainer" containerID="f4cc7ff150da03255acca8d142ee173f7c9fd6d5056f60381f70f9b47150c026"
Jul 06 19:53:53.764451 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:53.764431    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=limitador-operator-controller-manager-859d7b78bd-lmgkb_kuadrant-system(be5d3c9b-b186-46f6-8b4c-938dd7f942de)\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" podUID="be5d3c9b-b186-46f6-8b4c-938dd7f942de"
Jul 06 19:53:53.764513 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:53.764493    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-86878c769f-z2qqx_kuadrant-system(1d7cfb91-a126-4804-9cdf-925be60ef3a3)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" podUID="1d7cfb91-a126-4804-9cdf-925be60ef3a3"
Jul 06 19:53:54.496271 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:54.496235    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:53:54.496585 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:54.496570    2561 scope.go:117] "RemoveContainer" containerID="ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe"
Jul 06 19:53:54.496751 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:54.496731    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=limitador-operator-controller-manager-859d7b78bd-lmgkb_kuadrant-system(be5d3c9b-b186-46f6-8b4c-938dd7f942de)\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" podUID="be5d3c9b-b186-46f6-8b4c-938dd7f942de"
Jul 06 19:53:56.834804 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:56.834772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:53:56.835206 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:56.835137    2561 scope.go:117] "RemoveContainer" containerID="65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e"
Jul 06 19:53:56.835354 ip-10-0-130-64 kubenswrapper[2561]: E0706 19:53:56.835335    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-7sfs2_kuadrant-system(b2d06e2c-16da-4916-8be3-18f88584302b)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" podUID="b2d06e2c-16da-4916-8be3-18f88584302b"
Jul 06 19:53:57.581491 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:57.581456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:53:57.581891 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:57.581874    2561 scope.go:117] "RemoveContainer" containerID="c31fa0a74ab7221fc595f8a1f47fe6cd9423cbafd8af00110643bc2c4205c772"
Jul 06 19:53:59.062030 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:59.061993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq" event={"ID":"65f40ce0-2d85-4f85-93f1-aa75afcd0e73","Type":"ContainerStarted","Data":"98310f978c785a8250e155c0e8f6afbe5a1a4c9af17f6785c38a8cc7177f9905"}
Jul 06 19:53:59.062423 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:53:59.062219    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:54:00.016731 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:00.016701    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-4cvgp"
Jul 06 19:54:01.588336 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:01.588304    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:54:01.588824 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:01.588808    2561 scope.go:117] "RemoveContainer" containerID="f4cc7ff150da03255acca8d142ee173f7c9fd6d5056f60381f70f9b47150c026"
Jul 06 19:54:02.079947 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:02.079904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx" event={"ID":"1d7cfb91-a126-4804-9cdf-925be60ef3a3","Type":"ContainerStarted","Data":"b73dc0a969a21bfb23a78969face4e7aea17fa848da8fcfc111a9c6ecb5734ee"}
Jul 06 19:54:02.080179 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:02.080160    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:54:04.877295 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:04.877258    2561 scope.go:117] "RemoveContainer" containerID="637c9c1cf99f0fe85c0eebf1ed6db0d0ae7070e28be61e774d89e92ab0e64e70"
Jul 06 19:54:05.876853 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:05.876808    2561 scope.go:117] "RemoveContainer" containerID="ab7601ccf41370e2384171f5e4db0ac9e770b3142c054922346da86ea6000bbe"
Jul 06 19:54:06.101662 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:06.101621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k" event={"ID":"7e09dbad-5ca8-4868-9916-8e6ef4b07aae","Type":"ContainerStarted","Data":"84f4d55207bd3fb095f5785247f55c4c0f96b699e1ccc2eca17960b64425b7d6"}
Jul 06 19:54:06.102161 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:06.101865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:54:06.103518 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:06.103490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb" event={"ID":"be5d3c9b-b186-46f6-8b4c-938dd7f942de","Type":"ContainerStarted","Data":"5782789a95c36372b62d5295de21b6025f2bd56f588d9a30b74c04b6f84350bd"}
Jul 06 19:54:06.103686 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:06.103669    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:54:08.876990 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:08.876957    2561 scope.go:117] "RemoveContainer" containerID="65cc85d33167a312e5c6566f9c5f4349599696c8ba3fb033fbb7877c795d7d7e"
Jul 06 19:54:09.120796 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:09.120767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2" event={"ID":"b2d06e2c-16da-4916-8be3-18f88584302b","Type":"ContainerStarted","Data":"7880f2184b0c313a0e17d3c73c0fd3c78ea67053c1e76e1d1e00eca4c692dc92"}
Jul 06 19:54:09.120980 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:09.120964    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:54:13.087289 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:13.087252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z2qqx"
Jul 06 19:54:17.111799 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:17.111768    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lmgkb"
Jul 06 19:54:20.128577 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:20.128545    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sfs2"
Jul 06 19:54:26.723323 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723294    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"]
Jul 06 19:54:26.723706 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723693    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919433f3-5dab-4f9c-afb7-f3dda8e7032c" containerName="main"
Jul 06 19:54:26.723752 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723707    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="919433f3-5dab-4f9c-afb7-f3dda8e7032c" containerName="main"
Jul 06 19:54:26.723752 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723717    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f29c63df-2ab0-4620-a98e-e91ae4855fbb" containerName="main"
Jul 06 19:54:26.723752 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723722    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f29c63df-2ab0-4620-a98e-e91ae4855fbb" containerName="main"
Jul 06 19:54:26.723856 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723782    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="919433f3-5dab-4f9c-afb7-f3dda8e7032c" containerName="main"
Jul 06 19:54:26.723856 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.723792    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f29c63df-2ab0-4620-a98e-e91ae4855fbb" containerName="main"
Jul 06 19:54:26.729293 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.727931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.744717 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.744690    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mrhbq\"/\"default-dockercfg-8w4wr\""
Jul 06 19:54:26.744846 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.744773    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrhbq\"/\"kube-root-ca.crt\""
Jul 06 19:54:26.754506 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.754482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrhbq\"/\"openshift-service-ca.crt\""
Jul 06 19:54:26.809309 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.809272    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"]
Jul 06 19:54:26.857583 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.857543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-podres\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.857763 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.857591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-proc\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.857763 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.857625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2686\" (UniqueName: \"kubernetes.io/projected/42c3d7a3-248b-47ec-b53b-d934246ced7c-kube-api-access-w2686\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.857763 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.857732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-sys\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.857892 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.857833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-lib-modules\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958426 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-sys\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958594 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-lib-modules\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958594 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958510    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-sys\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958594 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-podres\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958594 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-proc\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958594 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2686\" (UniqueName: \"kubernetes.io/projected/42c3d7a3-248b-47ec-b53b-d934246ced7c-kube-api-access-w2686\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958634    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-podres\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-lib-modules\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:26.958774 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:26.958679    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42c3d7a3-248b-47ec-b53b-d934246ced7c-proc\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:27.036662 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:27.036628    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2686\" (UniqueName: \"kubernetes.io/projected/42c3d7a3-248b-47ec-b53b-d934246ced7c-kube-api-access-w2686\") pod \"perf-node-gather-daemonset-sp4k7\" (UID: \"42c3d7a3-248b-47ec-b53b-d934246ced7c\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:27.044505 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:27.044453    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:27.479010 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:27.478980    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"]
Jul 06 19:54:27.482383 ip-10-0-130-64 kubenswrapper[2561]: W0706 19:54:27.482357    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42c3d7a3_248b_47ec_b53b_d934246ced7c.slice/crio-f1efc33c76f5004e6a19fc058c8dc1c24407ecfce4f4953ea5df4ccd2a8c5a37 WatchSource:0}: Error finding container f1efc33c76f5004e6a19fc058c8dc1c24407ecfce4f4953ea5df4ccd2a8c5a37: Status 404 returned error can't find the container with id f1efc33c76f5004e6a19fc058c8dc1c24407ecfce4f4953ea5df4ccd2a8c5a37
Jul 06 19:54:28.219621 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:28.219574    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7" event={"ID":"42c3d7a3-248b-47ec-b53b-d934246ced7c","Type":"ContainerStarted","Data":"1ff575e6033f1076ec1df0bb899df4989f1c59baa9e4037cc1fb5072bf4e3ce8"}
Jul 06 19:54:28.220061 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:28.219651    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:28.220061 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:28.219679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7" event={"ID":"42c3d7a3-248b-47ec-b53b-d934246ced7c","Type":"ContainerStarted","Data":"f1efc33c76f5004e6a19fc058c8dc1c24407ecfce4f4953ea5df4ccd2a8c5a37"}
Jul 06 19:54:28.284486 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:28.284436    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7" podStartSLOduration=6.28441915 podStartE2EDuration="6.28441915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:28.281714593 +0000 UTC m=+2928.032423847" watchObservedRunningTime="2026-07-06 19:54:28.28441915 +0000 UTC m=+2928.035128458"
Jul 06 19:54:29.260749 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.260719    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bjrd7_2a2df57b-2e9d-48f3-be07-beb5631b6e68/manager/1.log"
Jul 06 19:54:29.263012 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.262990    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bjrd7_2a2df57b-2e9d-48f3-be07-beb5631b6e68/manager/0.log"
Jul 06 19:54:29.361543 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.361510    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7sfs2_b2d06e2c-16da-4916-8be3-18f88584302b/manager/2.log"
Jul 06 19:54:29.361701 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.361601    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7sfs2_b2d06e2c-16da-4916-8be3-18f88584302b/manager/1.log"
Jul 06 19:54:29.425980 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.425948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-689q6_e713d344-2474-4be0-b4c4-7a9d5aef2bd7/kuadrant-console-plugin/0.log"
Jul 06 19:54:29.491319 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.491286    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-brpw5_2d3a8213-ecd4-4885-a3e0-3cab0c1d29d7/registry-server/0.log"
Jul 06 19:54:29.550315 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.550231    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z2qqx_1d7cfb91-a126-4804-9cdf-925be60ef3a3/manager/2.log"
Jul 06 19:54:29.552616 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.552599    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z2qqx_1d7cfb91-a126-4804-9cdf-925be60ef3a3/manager/1.log"
Jul 06 19:54:29.630699 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.630673    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2dbs2_ba0c2fa8-aef8-4c70-8ff2-c2e9b2653094/limitador/0.log"
Jul 06 19:54:29.734772 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.734741    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lmgkb_be5d3c9b-b186-46f6-8b4c-938dd7f942de/manager/2.log"
Jul 06 19:54:29.766867 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:29.766841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lmgkb_be5d3c9b-b186-46f6-8b4c-938dd7f942de/manager/1.log"
Jul 06 19:54:30.113928 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:30.113897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5g4cq"
Jul 06 19:54:32.883703 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:32.883668    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-qsfc2_75584f33-dde1-41dc-a320-5e33cd86f1c4/kube-state-metrics/0.log"
Jul 06 19:54:32.941571 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:32.941545    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-qsfc2_75584f33-dde1-41dc-a320-5e33cd86f1c4/kube-rbac-proxy-main/0.log"
Jul 06 19:54:32.992176 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:32.992149    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-qsfc2_75584f33-dde1-41dc-a320-5e33cd86f1c4/kube-rbac-proxy-self/0.log"
Jul 06 19:54:33.111640 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:33.111612    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lphws_0c6212a6-9e09-4a6a-8840-13307d3c9b9a/monitoring-plugin/0.log"
Jul 06 19:54:33.469254 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:33.469224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scdhv_00eed00a-0677-4630-813f-dbc16bf2e3ce/node-exporter/0.log"
Jul 06 19:54:33.509374 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:33.509344    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scdhv_00eed00a-0677-4630-813f-dbc16bf2e3ce/kube-rbac-proxy/0.log"
Jul 06 19:54:33.557156 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:33.557131    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scdhv_00eed00a-0677-4630-813f-dbc16bf2e3ce/init-textfile/0.log"
Jul 06 19:54:34.082535 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:34.082499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-6k2xz_b88fc981-49e4-43ea-9518-215fd3e6eab1/prometheus-operator/0.log"
Jul 06 19:54:34.234823 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:34.234795    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-sp4k7"
Jul 06 19:54:34.734452 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:34.734423    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-6k2xz_b88fc981-49e4-43ea-9518-215fd3e6eab1/kube-rbac-proxy/0.log"
Jul 06 19:54:37.113931 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:37.113901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzv7k"
Jul 06 19:54:37.672849 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:37.672825    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/2.log"
Jul 06 19:54:37.677057 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:37.677038    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jdlx8_67b47669-a105-4779-879f-997de9f6dfe1/console-operator/3.log"
Jul 06 19:54:38.473633 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:38.473609    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-pdzbw_dd33939c-5cd7-430d-883d-35b6fb33eddc/kube-auth-proxy/0.log"
Jul 06 19:54:38.533103 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:38.533076    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b4dbf4cb-4tkdf_1fb20209-4284-4baa-9220-72f596d2b412/console/0.log"
Jul 06 19:54:38.612621 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:38.612593    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/0.log"
Jul 06 19:54:38.637862 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:38.637830    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/1.log"
Jul 06 19:54:38.726260 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:38.726228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-7n5dd_d4f36103-e992-46f1-af97-90b276ccdc95/download-server/0.log"
Jul 06 19:54:38.821517 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:38.821488    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66f45d6fc7-4846p_3df4cb41-be07-4684-afc6-c906b0a1c917/router/0.log"
Jul 06 19:54:40.516759 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:40.516728    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-pdzbw_dd33939c-5cd7-430d-883d-35b6fb33eddc/kube-auth-proxy/0.log"
Jul 06 19:54:40.626912 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:40.626881    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/0.log"
Jul 06 19:54:40.650373 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:40.650320    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/1.log"
Jul 06 19:54:40.926932 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:40.926898    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66f45d6fc7-4846p_3df4cb41-be07-4684-afc6-c906b0a1c917/router/0.log"
Jul 06 19:54:41.554397 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:41.554370    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fh4xd_0d6b5338-13bf-41f6-89e9-302b27d2abfc/dns/0.log"
Jul 06 19:54:41.622905 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:41.622869    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fh4xd_0d6b5338-13bf-41f6-89e9-302b27d2abfc/kube-rbac-proxy/0.log"
Jul 06 19:54:41.817177 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:41.817071    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dkqg4_1de5e4a6-395d-47a9-8f97-e3df63ec715e/dns-node-resolver/0.log"
Jul 06 19:54:42.836727 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:42.836701    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-754c49c7d6-vrvp9_f4a2c9fe-5258-47bc-9f32-a8e314bf93d5/registry/0.log"
Jul 06 19:54:42.925585 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:42.925554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n9fn_6dadbfed-32a7-4d11-90f7-8c26da9d38f4/node-ca/0.log"
Jul 06 19:54:44.304617 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:44.304591    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-pdzbw_dd33939c-5cd7-430d-883d-35b6fb33eddc/kube-auth-proxy/0.log"
Jul 06 19:54:44.412704 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:44.412673    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/0.log"
Jul 06 19:54:44.437676 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:44.437640    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2t564_4a58243e-3f34-4ebd-9452-812c00fbaaab/istio-proxy/1.log"
Jul 06 19:54:44.643417 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:44.643319    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66f45d6fc7-4846p_3df4cb41-be07-4684-afc6-c906b0a1c917/router/0.log"
Jul 06 19:54:45.567172 ip-10-0-130-64 kubenswrapper[2561]: I0706 19:54:45.567128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z2g8d_887c074b-d3e3-42fe-9a5b-ddee82884a6a/serve-healthcheck-canary/0.log"