Jul 03 20:35:19.690009 ip-10-0-128-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 03 20:35:19.690018 ip-10-0-128-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 03 20:35:19.690024 ip-10-0-128-87 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 03 20:35:19.690267 ip-10-0-128-87 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 03 20:35:29.910332 ip-10-0-128-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 03 20:35:29.910348 ip-10-0-128-87 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 48a85e9ad4bf45a99c4a55864a509d1a --
Jul 03 20:37:14.121224 ip-10-0-128-87 systemd[1]: Starting Kubernetes Kubelet...
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.533375    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538698    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538711    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538714    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538718    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538722    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538725    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538728    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 20:37:14.653165 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538731    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 20:37:14.609488 ip-10-0-128-87 systemd[1]: Started Kubernetes Kubelet.
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538734    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538737    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538740    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538742    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538745    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538747    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538750    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538752    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538755    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538757    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538760    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538763    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538770    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538773    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538776    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538778    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538782    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538785    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538788    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 20:37:14.657870 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538791    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538795    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538798    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538802    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538804    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538810    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538813    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538816    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538819    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538822    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538824    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538827    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538829    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538832    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538834    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538837    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538839    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538842    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538844    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 20:37:14.658713 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538847    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538849    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538852    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538854    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538857    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538859    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538863    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538867    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538870    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538874    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538877    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538880    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538883    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538886    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538890    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538893    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538896    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538899    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538901    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538908    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 20:37:14.659777 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538910    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538913    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538916    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538919    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538922    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538925    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538928    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538931    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538934    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538953    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538956    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538959    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538962    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538964    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538967    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538970    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538972    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538975    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538977    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 20:37:14.660819 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538980    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538983    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538985    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538987    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538990    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538993    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538996    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.538999    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.539001    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.539004    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.539007    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.539009    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.539012    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.539014    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540313    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540320    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540324    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540328    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540331    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540334    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 20:37:14.661903 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540337    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540340    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540343    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540345    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540347    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540350    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540353    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540356    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540359    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540361    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540364    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540368    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540372    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540375    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540379    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540382    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540385    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540388    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540390    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 20:37:14.662911 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540393    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540396    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540400    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540403    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540406    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540409    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540411    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540414    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540417    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540420    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540422    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540425    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540427    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540430    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540433    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540436    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540440    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540443    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540445    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 20:37:14.663992 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540448    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540451    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540454    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540456    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540459    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540461    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540464    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540467    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540470    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540473    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540475    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540477    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540480    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540483    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540486    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540489    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540492    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540495    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540497    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 20:37:14.665022 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540500    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540503    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540505    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540508    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540511    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540513    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540516    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540519    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540522    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540525    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540527    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540530    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540532    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540535    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540540    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540542    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540545    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540547    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540549    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540552    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 20:37:14.666062 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540554    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540557    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540560    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540563    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540566    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540568    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540571    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540574    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540576    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540579    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540581    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540584    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540586    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540589    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540591    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.540594    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541004    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541010    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541014    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541017    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541021    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 20:37:14.667095 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541028    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541031    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541034    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541037    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541039    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541044    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541046    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541049    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541052    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541054    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541057    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541059    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541062    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541064    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541067    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541069    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541072    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541075    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541077    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541080    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 20:37:14.668143 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541083    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541085    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541088    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541090    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541093    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541097    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541101    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541104    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541106    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541109    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541112    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541114    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541125    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541127    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541130    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541132    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541137    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541142    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541145    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 20:37:14.669218 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541147    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541150    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541153    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541155    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541158    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541160    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541163    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541165    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541168    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541170    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541173    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541176    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541178    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541181    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541184    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541186    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541188    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541191    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541194    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541196    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 20:37:14.670154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541199    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541202    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541205    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541207    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541209    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541213    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541216    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541218    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541221    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541224    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541228    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541230    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541233    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541235    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541238    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541240    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541243    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541245    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541249    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 20:37:14.671199 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541252    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541255    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541259    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541262    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541264    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541267    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541269    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541272    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541274    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541277    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541280    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541282    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541285    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541287    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541290    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.541292    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541359    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541365    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541373    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541378    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541382    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 03 20:37:14.672209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541385    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541390    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541395    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541398    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541401    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541404    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541408    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541411    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541414    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541416    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541419    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541422    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541425    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541429    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541432    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541435    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541438    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541441    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541445    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541448    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541451    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541453    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541457    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541459    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 03 20:37:14.673264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541462    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541465    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541468    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541472    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541475    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541478    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541481    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541484    2569 flags.go:64] FLAG: --enable-server="true"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541488    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541492    2569 flags.go:64] FLAG: --event-burst="100"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541497    2569 flags.go:64] FLAG: --event-qps="50"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541500    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541503    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541506    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541510    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541513    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541515    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541518    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541521    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541524    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541527    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541530    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541532    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541535    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541555    2569 flags.go:64] FLAG: --feature-gates=""
Jul 03 20:37:14.674333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541582    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541588    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541592    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541597    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541600    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541604    2569 flags.go:64] FLAG: --help="false"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541608    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-128-87.ec2.internal"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541611    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541615    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541618    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541621    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541626    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541629    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541632    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541635    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541637    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541641    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541644    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541647    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541650    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541653    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541657    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541659    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541662    2569 flags.go:64] FLAG: --lock-file=""
Jul 03 20:37:14.675376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541665    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541668    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541671    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541677    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541680    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541686    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541689    2569 flags.go:64] FLAG: --logging-format="text"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541699    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541705    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541708    2569 flags.go:64] FLAG: --manifest-url=""
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541711    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541715    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541718    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541722    2569 flags.go:64] FLAG: --max-pods="110"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541725    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541729    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541731    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541734    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541737    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541740    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541743    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541754    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541757    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541760    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 03 20:37:14.676467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541763    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541766    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541771    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541774    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541777    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541780    2569 flags.go:64] FLAG: --port="10250"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541783    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541786    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c98c63e4d3bc946a"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541789    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541792    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541795    2569 flags.go:64] FLAG: --register-node="true"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541798    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541801    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541804    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541808    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541811    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541816    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541820    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541823    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541826    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541828    2569 flags.go:64] FLAG: --runonce="false"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541831    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541834    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541838    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541841    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 03 20:37:14.681617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541843    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541847    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541850    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541853    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541856    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541858    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541861    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541864    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541867    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541870    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541873    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541879    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541882    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541885    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541890    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541893    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541896    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541898    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541901    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541904    2569 flags.go:64] FLAG: --v="2"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541908    2569 flags.go:64] FLAG: --version="false"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541913    2569 flags.go:64] FLAG: --vmodule=""
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541916    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.541921    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 03 20:37:14.682702 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542055    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542062    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542065    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542068    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542071    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542074    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542077    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542095    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542099    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542102    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542105    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542108    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542111    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542114    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542116    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542119    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542122    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542124    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542127    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 20:37:14.793651 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542130    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542133    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542135    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542138    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542140    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542143    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542146    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542148    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542151    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542153    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542157    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542160    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542164    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542167    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542169    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542173    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542175    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542178    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542180    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542183    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 20:37:14.794700 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542186    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542188    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542191    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542193    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542196    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542198    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542201    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542205    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542208    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542211    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542214    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542216    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542220    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542223    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542227    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542229    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542232    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542235    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542237    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 20:37:14.795712 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542240    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542242    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542245    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542249    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542251    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542256    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542259    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542261    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542264    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542267    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542270    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542272    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542275    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542277    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542280    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542282    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542285    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542288    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542290    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542293    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 20:37:14.796764 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542295    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542297    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542300    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542303    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542306    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542308    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542310    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542313    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542315    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542318    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542321    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542323    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542326    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542328    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542331    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542334    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542337    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542341    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542344    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542346    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 20:37:14.797786 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.542349    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.543113    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.549806    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.549821    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.549840    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.549845    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549900    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549905    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549908    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549911    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549914    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549917    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549920    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549923    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549926    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 20:37:14.798836 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549929    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549932    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549934    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549952    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549955    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549958    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549961    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549963    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549966    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549969    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549971    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549974    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549977    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549980    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549982    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549985    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549987    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549990    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.549996    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550000    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 20:37:14.799862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550003    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550006    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550008    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550012    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550014    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550017    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550020    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550022    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550025    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550027    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550030    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550032    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550035    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550037    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550040    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550042    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550045    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550048    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550051    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550053    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 20:37:14.800896 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550056    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550059    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550061    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550064    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550066    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550069    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550071    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550074    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550077    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550079    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550084    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550086    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550091    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550094    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550096    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550099    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550101    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550104    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550106    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550108    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 20:37:14.801924 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550111    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550115    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550120    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550123    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550126    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550128    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550131    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550133    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550136    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550138    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550141    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550143    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550146    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550148    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550150    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550153    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550156    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550158    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550161    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 20:37:14.802983 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550163    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550166    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550168    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550172    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550175    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550177    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550182    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550185    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550188    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550191    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550193    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.550198    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550303    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550308    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 20:37:14.803995 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550312    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550315    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550318    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550321    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550324    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550328    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550332    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550338    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550341    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550344    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550346    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550349    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550352    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550354    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550357    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550359    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550362    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550364    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550367    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 20:37:14.805006 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550369    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550372    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550374    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550379    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550382    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550385    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550389    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550391    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550394    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550397    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550399    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550402    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550404    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550407    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550409    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550412    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550414    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550417    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550419    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 20:37:14.806008 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550422    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550425    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550428    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550430    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550433    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550435    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550437    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550440    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550443    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550445    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550448    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550450    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550453    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550455    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550458    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550460    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550464    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550466    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550469    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550472    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 20:37:14.807050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550474    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550477    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550479    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550482    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550485    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550487    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550489    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550492    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550494    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550497    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550499    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550502    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550504    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550508    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550510    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550513    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550515    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550518    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550521    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550523    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 20:37:14.808060 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550525    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550528    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550530    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550533    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550535    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550538    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550540    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550543    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550546    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550549    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550552    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550554    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550557    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550560    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550562    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550565    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550567    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550569    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 20:37:14.809111 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:14.550572    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.550577    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.550670    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.555034    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.556410    2569 server.go:1019] "Starting client certificate rotation"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.556514    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.556560    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.559814    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.560894    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.572582    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.574559    2569 log.go:25] "Validated CRI v1 image API"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.575411    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 03 20:37:14.810115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.580609    2569 fs.go:135] Filesystem UUIDs: map[333413ce-2d23-4a68-ab16-5c656d9b95e3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a5ab3614-909c-4481-8d93-364e9f9a3c44:/dev/nvme0n1p3]
Jul 03 20:37:14.811119 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.580631    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.586017    2569 manager.go:216] Machine: {Timestamp:2026-07-03 20:37:14.585342806 +0000 UTC m=+0.334348837 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099909 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27becc50bc44c602317af20a9ecd9d SystemUUID:ec27becc-50bc-44c6-0231-7af20a9ecd9d BootID:48a85e9a-d4bf-45a9-9c4a-55864a509d1a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:6d:81:5e:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:6d:81:5e:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:c7:ec:e9:cd:25 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.586146    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.586234    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.589182    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.589208    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.589911    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.589921    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 03 20:37:14.811552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.589929    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.590723    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.591966    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.594730    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.594848    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.595448    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.595459    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.595475    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.595484    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.595493    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.597416    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.597446    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.600045    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.602102    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.602138    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603443    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603899    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603915    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603924    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603933    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603959    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603968    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603979    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603987    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.603996    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.604004    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.604017    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.604025    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.604881    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.604891    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.608585    2569 server.go:1268] "Started kubelet"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.608682    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.608667    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.608792    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.609494    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.610092    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.610141    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.610590    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 03 20:37:14.812086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.610650    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.613423    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-87.ec2.internal.18bee209e4ec1335  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-87.ec2.internal,UID:ip-10-0-128-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-87.ec2.internal,},FirstTimestamp:2026-07-03 20:37:14.608554805 +0000 UTC m=+0.357560835,LastTimestamp:2026-07-03 20:37:14.608554805 +0000 UTC m=+0.357560835,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-87.ec2.internal,}"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.615285    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.617828    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.617846    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.617891    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.618402    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.618427    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.618441    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.618543    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.618569    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619253    2569 factory.go:153] Registering CRI-O factory
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619264    2569 factory.go:223] Registration of the crio container factory successfully
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619313    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619325    2569 factory.go:55] Registering systemd factory
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619334    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619355    2569 factory.go:103] Registering Raw factory
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619368    2569 manager.go:1196] Started watching for new ooms in manager
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.619743    2569 manager.go:349] Starting recovery of all containers
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.627054    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.632038    2569 manager.go:354] Recovery completed
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.635572    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:14.635721    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.639903    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.641644    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffj27"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.641806    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.641828    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.641838    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.642355    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.642364    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.642378    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.642413    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:14.819571 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.643145    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.643168    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.643178    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.643717    2569 policy_none.go:49] "None policy: Start"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.643730    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.643740    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.644790    2569 policy_none.go:47] "Start"
Jul 03 20:37:14.821105 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:14.649396    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffj27"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.076262    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.081702    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-87.ec2.internal\" not found" node="ip-10-0-128-87.ec2.internal"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.095600    2569 manager.go:337] "Starting Device Plugin manager"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.095638    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.095650    2569 server.go:87] "Starting device plugin registration server"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.095912    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.095924    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.096028    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.096173    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.096184    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.096783    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 03 20:37:15.166330 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.096849    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-87.ec2.internal\" not found"
Jul 03 20:37:15.184987 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.179813    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 03 20:37:15.184987 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.179853    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 03 20:37:15.184987 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.179881    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 03 20:37:15.184987 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.179920    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 03 20:37:15.184987 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.182246    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 20:37:15.201171 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.196161    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:15.201171 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.196964    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:15.201171 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.196990    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:15.201171 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.197008    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:15.201171 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.197033    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-87.ec2.internal"
Jul 03 20:37:15.640656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.640494    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"]
Jul 03 20:37:15.640656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.640534    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 03 20:37:15.640656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.640578    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:15.642110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.640748    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 20:37:15.643725 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.642224    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-87.ec2.internal"
Jul 03 20:37:15.643725 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:15.642247    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-87.ec2.internal\": node \"ip-10-0-128-87.ec2.internal\" not found"
Jul 03 20:37:15.643725 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.642638    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:15.643725 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.642664    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:15.643725 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.642686    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644042    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644220    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644912    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644926    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644949    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644967    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.644967    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:15.645853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.645036    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.646143    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.646162    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.646737    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.646751    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.646759    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.654216    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 20:32:14 +0000 UTC" deadline="2028-02-25 02:21:58.854845127 +0000 UTC"
Jul 03 20:37:15.740912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:15.654239    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14429h44m43.200608466s"
Jul 03 20:37:16.420039 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.419966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ea9d48208bb56a32156494e4cb83cfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"0ea9d48208bb56a32156494e4cb83cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.420039 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.420005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea9d48208bb56a32156494e4cb83cfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"0ea9d48208bb56a32156494e4cb83cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.420189 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.420033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9dec68b5fc70760505a8e888fd282a0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" (UID: \"f9dec68b5fc70760505a8e888fd282a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.433973 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.433923    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 20:37:16.434087 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.433974    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 20:37:16.439994 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.439938    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 20:37:16.445820 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.445800    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.450611 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.450598    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.456383 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.456369    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 20:37:16.459432 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.459418    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 20:37:16.518514 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.518495    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.520730 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.520715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea9d48208bb56a32156494e4cb83cfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"0ea9d48208bb56a32156494e4cb83cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.520777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.520743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9dec68b5fc70760505a8e888fd282a0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" (UID: \"f9dec68b5fc70760505a8e888fd282a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.520777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.520760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ea9d48208bb56a32156494e4cb83cfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"0ea9d48208bb56a32156494e4cb83cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.520843 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.520792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ea9d48208bb56a32156494e4cb83cfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"0ea9d48208bb56a32156494e4cb83cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.520843 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.520819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea9d48208bb56a32156494e4cb83cfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"0ea9d48208bb56a32156494e4cb83cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.520904 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.520821    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9dec68b5fc70760505a8e888fd282a0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" (UID: \"f9dec68b5fc70760505a8e888fd282a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.525169 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.525155    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 20:37:16.525206 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.525195    2569 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.525234 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.525209    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.534593 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.534578    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 20:37:16.534639 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.534606    2569 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.540212 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.540199    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 20:37:16.641557 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.641521    2569 apiserver.go:52] "Watching apiserver"
Jul 03 20:37:16.641557 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.641538    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 03 20:37:16.646086 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.646070    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 03 20:37:16.646427 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.646409    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g","openshift-cluster-node-tuning-operator/tuned-vlcc2","openshift-dns/node-resolver-99rzh","openshift-image-registry/node-ca-2cq2r","openshift-multus/multus-wrbt4","openshift-multus/network-metrics-daemon-9sckp","openshift-ovn-kubernetes/ovnkube-node-kx87t","kube-system/global-pull-secret-syncer-mf6t2","kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-nwc49","openshift-network-diagnostics/network-check-target-rgnz6","openshift-network-operator/iptables-alerter-c2qlg","kube-system/konnectivity-agent-cdbfr"]
Jul 03 20:37:16.648207 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.648194    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.649561 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.649540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.650091 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650067    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.650209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650093    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.650209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650125    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 03 20:37:16.650209 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650174    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pj9df\""
Jul 03 20:37:16.650420 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650227    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 03 20:37:16.650420 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650309    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 20:37:16.650534 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.650505    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 03 20:37:16.651397 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.651379    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.651527 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.651511    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 03 20:37:16.651707 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.651692    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.651775 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.651757    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 03 20:37:16.651857 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.651793    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.651857 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.651827    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rplcp\""
Jul 03 20:37:16.652729 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.652710    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.655098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.654108    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89j8v\""
Jul 03 20:37:16.655098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.654233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.655098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.654346    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.655098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.654751    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.655098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.654875    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.655098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.654967    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 03 20:37:16.655526 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.655509    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nf6t\""
Jul 03 20:37:16.655744 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.655728    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.656651 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.656633    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.657032 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.657008    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:16.657129 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.657105    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:16.657235 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.657218    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mw6zl\""
Jul 03 20:37:16.657290 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.657243    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 03 20:37:16.657290 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.657225    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 03 20:37:16.657480 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.657467    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.658257 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.658245    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.659483 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.659468    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.659837 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.659801    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 03 20:37:16.659922 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.659865    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tqqw7\""
Jul 03 20:37:16.659922 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.659897    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 03 20:37:16.660664 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.660643    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.661047 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.661030    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 03 20:37:16.661642 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.661624    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-78s8j\""
Jul 03 20:37:16.661642 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.661636    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.661747 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.661666    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.661958 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.661931    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.662035 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.662023    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:16.662783 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.662767    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 03 20:37:16.662845 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.662804    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bdxth\""
Jul 03 20:37:16.662905 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.662866    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 03 20:37:16.663316 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.663296    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.664340 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.664320    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:16.664534 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.664370    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:16.664938 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.664918    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tlrfb\""
Jul 03 20:37:16.665031 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.664927    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 03 20:37:16.665085 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.665061    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 03 20:37:16.677289 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.677241    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mk98v"
Jul 03 20:37:16.685500 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.685485    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mk98v"
Jul 03 20:37:16.719419 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.719403    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 03 20:37:16.722015 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-hostroot\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-multus-certs\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-socket-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.722081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-os-release\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722070    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-cni-binary-copy\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722222 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-etc-selinux\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.722222 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722111    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-lib-modules\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.722222 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722143    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-host\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.722222 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cd6d036-9a5b-42d0-b428-861c82202bff-dbus\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.722222 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.722222 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722219    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-var-lib-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f5d0788-6048-437e-b01b-bab9557f948e-serviceca\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-kubelet\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzpfw\" (UniqueName: \"kubernetes.io/projected/9022ab2d-fd3c-4739-b911-d257554cca54-kube-api-access-hzpfw\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-device-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-sys\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722378    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-os-release\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-node-log\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722435 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31443663-2252-44bd-af2e-6b6408ecd69c-hosts-file\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kc5d\" (UniqueName: \"kubernetes.io/projected/9f5d0788-6048-437e-b01b-bab9557f948e-kube-api-access-9kc5d\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htj8p\" (UniqueName: \"kubernetes.io/projected/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-kube-api-access-htj8p\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722492    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9ck\" (UniqueName: \"kubernetes.io/projected/0650390e-fcae-415a-9ba8-57737e01556a-kube-api-access-5b9ck\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysconfig\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-cnibin\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722549    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-kubelet\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-ovn\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-conf-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722601    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca34b1ae-390f-48d0-aff6-524260a1ed19-agent-certs\") pod \"konnectivity-agent-cdbfr\" (UID: \"ca34b1ae-390f-48d0-aff6-524260a1ed19\") " pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysctl-conf\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722631    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-cni-netd\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-ovnkube-config\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.722682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-var-lib-kubelet\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-system-cni-dir\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-ovnkube-script-lib\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-cni-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-cnibin\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-kubernetes\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-systemd-units\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722826    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-env-overrides\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722874    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31443663-2252-44bd-af2e-6b6408ecd69c-tmp-dir\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/31443663-2252-44bd-af2e-6b6408ecd69c-kube-api-access-bhvd9\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-netns\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff65a204-91a1-41be-8986-464ae109a4a3-etc-tuned\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.722999    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a49a070d-9b32-46f7-ad88-9338451f0b8f-host-slash\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723013    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-registration-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-sys-fs\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-etc-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-socket-dir-parent\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-cni-bin\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-systemd\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-etc-kubernetes\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723169    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-cni-multus\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-daemon-config\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.723442 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-modprobe-d\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723245    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-slash\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-run-ovn-kubernetes\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723289    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca34b1ae-390f-48d0-aff6-524260a1ed19-konnectivity-ca\") pod \"konnectivity-agent-cdbfr\" (UID: \"ca34b1ae-390f-48d0-aff6-524260a1ed19\") " pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff65a204-91a1-41be-8986-464ae109a4a3-tmp\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9sdw\" (UniqueName: \"kubernetes.io/projected/ff65a204-91a1-41be-8986-464ae109a4a3-kube-api-access-z9sdw\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723331    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-systemd\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-run\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggmr\" (UniqueName: \"kubernetes.io/projected/474329be-b0d8-4922-a5bc-bc5d62fc63be-kube-api-access-vggmr\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723378    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a49a070d-9b32-46f7-ad88-9338451f0b8f-iptables-alerter-script\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723406    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-run-netns\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.723798 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-cni-bin\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723431    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5de24734-fb4c-4871-b17e-069347aaeb37-ovn-node-metrics-cert\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prlbw\" (UniqueName: \"kubernetes.io/projected/a49a070d-9b32-46f7-ad88-9338451f0b8f-kube-api-access-prlbw\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-system-cni-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysctl-d\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cd6d036-9a5b-42d0-b428-861c82202bff-kubelet-config\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-log-socket\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bglj\" (UniqueName: \"kubernetes.io/projected/5de24734-fb4c-4871-b17e-069347aaeb37-kube-api-access-4bglj\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723573    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f5d0788-6048-437e-b01b-bab9557f948e-host\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.724183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.723590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-k8s-cni-cncf-io\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.760219 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.760199    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.762057 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.762040    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Jul 03 20:37:16.823969 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.823931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-etc-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824080 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.823975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-socket-dir-parent\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824080 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.823992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-cni-bin\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824080 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.823988    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-etc-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824080 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-systemd\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824080 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824051    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-systemd\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824073    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-cni-bin\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824083    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-etc-kubernetes\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824109    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-socket-dir-parent\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824119    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-etc-kubernetes\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-cni-multus\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-daemon-config\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-modprobe-d\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824197    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.824232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-slash\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824242    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-run-ovn-kubernetes\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca34b1ae-390f-48d0-aff6-524260a1ed19-konnectivity-ca\") pod \"konnectivity-agent-cdbfr\" (UID: \"ca34b1ae-390f-48d0-aff6-524260a1ed19\") " pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824279    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-run-ovn-kubernetes\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff65a204-91a1-41be-8986-464ae109a4a3-tmp\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.824304    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824315    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-slash\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.824375    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:37:17.324353597 +0000 UTC m=+3.073359641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824369    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-cni-multus\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824388    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-modprobe-d\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824306    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9sdw\" (UniqueName: \"kubernetes.io/projected/ff65a204-91a1-41be-8986-464ae109a4a3-kube-api-access-z9sdw\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-systemd\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-run\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.824646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vggmr\" (UniqueName: \"kubernetes.io/projected/474329be-b0d8-4922-a5bc-bc5d62fc63be-kube-api-access-vggmr\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a49a070d-9b32-46f7-ad88-9338451f0b8f-iptables-alerter-script\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-systemd\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824545    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-run\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-run-netns\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824599    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-cni-bin\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5de24734-fb4c-4871-b17e-069347aaeb37-ovn-node-metrics-cert\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824628    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prlbw\" (UniqueName: \"kubernetes.io/projected/a49a070d-9b32-46f7-ad88-9338451f0b8f-kube-api-access-prlbw\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-system-cni-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysctl-d\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cd6d036-9a5b-42d0-b428-861c82202bff-kubelet-config\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-log-socket\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bglj\" (UniqueName: \"kubernetes.io/projected/5de24734-fb4c-4871-b17e-069347aaeb37-kube-api-access-4bglj\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.825370 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-run-netns\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824838    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-cni-bin\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f5d0788-6048-437e-b01b-bab9557f948e-host\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-k8s-cni-cncf-io\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824878    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-daemon-config\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824878    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca34b1ae-390f-48d0-aff6-524260a1ed19-konnectivity-ca\") pod \"konnectivity-agent-cdbfr\" (UID: \"ca34b1ae-390f-48d0-aff6-524260a1ed19\") " pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-hostroot\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824921    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-system-cni-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-hostroot\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824933    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-log-socket\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-multus-certs\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824999    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-multus-certs\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825002    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-socket-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-os-release\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-cni-binary-copy\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-etc-selinux\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-lib-modules\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825111    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-socket-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-host\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825143    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a49a070d-9b32-46f7-ad88-9338451f0b8f-iptables-alerter-script\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825149    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.824879    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f5d0788-6048-437e-b01b-bab9557f948e-host\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cd6d036-9a5b-42d0-b428-861c82202bff-dbus\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825150    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-os-release\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825200    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-k8s-cni-cncf-io\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825212    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cd6d036-9a5b-42d0-b428-861c82202bff-kubelet-config\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825241    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-var-lib-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825265    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cd6d036-9a5b-42d0-b428-861c82202bff-dbus\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:16.826748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825267    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f5d0788-6048-437e-b01b-bab9557f948e-serviceca\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825273    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-etc-selinux\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825304    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-kubelet\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzpfw\" (UniqueName: \"kubernetes.io/projected/9022ab2d-fd3c-4739-b911-d257554cca54-kube-api-access-hzpfw\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825363    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-lib-modules\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825376    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-device-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-sys\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-os-release\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825472    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-node-log\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825497    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-host\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31443663-2252-44bd-af2e-6b6408ecd69c-hosts-file\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825549    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-node-log\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825557    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kc5d\" (UniqueName: \"kubernetes.io/projected/9f5d0788-6048-437e-b01b-bab9557f948e-kube-api-access-9kc5d\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.827467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825596    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-os-release\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825642    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825644    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-device-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825451    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysctl-d\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825696    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-sys\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825698    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f5d0788-6048-437e-b01b-bab9557f948e-serviceca\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htj8p\" (UniqueName: \"kubernetes.io/projected/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-kube-api-access-htj8p\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825739    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-var-lib-kubelet\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-var-lib-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825760    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31443663-2252-44bd-af2e-6b6408ecd69c-hosts-file\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825760    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-cni-binary-copy\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9ck\" (UniqueName: \"kubernetes.io/projected/0650390e-fcae-415a-9ba8-57737e01556a-kube-api-access-5b9ck\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysconfig\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825839    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-cnibin\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-kubelet\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828148 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-ovn\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825894    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysconfig\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-conf-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825916    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-cnibin\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-kubelet\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825954    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-ovn\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca34b1ae-390f-48d0-aff6-524260a1ed19-agent-certs\") pod \"konnectivity-agent-cdbfr\" (UID: \"ca34b1ae-390f-48d0-aff6-524260a1ed19\") " pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825976    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-conf-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.825994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysctl-conf\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-cni-netd\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826058    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-cni-netd\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-ovnkube-config\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826099    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-sysctl-conf\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.828903 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-var-lib-kubelet\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.826180    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-system-cni-dir\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.826225    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:17.326209718 +0000 UTC m=+3.075215737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-ovnkube-script-lib\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826238    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/474329be-b0d8-4922-a5bc-bc5d62fc63be-system-cni-dir\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826290    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-cni-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826325    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-var-lib-kubelet\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-cnibin\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-kubernetes\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826369    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-cnibin\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.829319 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-systemd-units\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826430    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-multus-cni-dir\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826465    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-env-overrides\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff65a204-91a1-41be-8986-464ae109a4a3-etc-kubernetes\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826489    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31443663-2252-44bd-af2e-6b6408ecd69c-tmp-dir\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826534    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-run-openvswitch\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826534    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/31443663-2252-44bd-af2e-6b6408ecd69c-kube-api-access-bhvd9\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-netns\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826599    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff65a204-91a1-41be-8986-464ae109a4a3-etc-tuned\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826644    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-ovnkube-config\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826678    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a49a070d-9b32-46f7-ad88-9338451f0b8f-host-slash\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826714    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5de24734-fb4c-4871-b17e-069347aaeb37-systemd-units\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826751    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-host-run-netns\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.829696 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826835    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-ovnkube-script-lib\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a49a070d-9b32-46f7-ad88-9338451f0b8f-host-slash\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-registration-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-sys-fs\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.826962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31443663-2252-44bd-af2e-6b6408ecd69c-tmp-dir\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.827013    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-sys-fs\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.827042    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5de24734-fb4c-4871-b17e-069347aaeb37-env-overrides\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.827066    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-registration-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.827437    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/474329be-b0d8-4922-a5bc-bc5d62fc63be-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.827491    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0650390e-fcae-415a-9ba8-57737e01556a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.828237    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff65a204-91a1-41be-8986-464ae109a4a3-tmp\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.828382    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5de24734-fb4c-4871-b17e-069347aaeb37-ovn-node-metrics-cert\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.828425    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca34b1ae-390f-48d0-aff6-524260a1ed19-agent-certs\") pod \"konnectivity-agent-cdbfr\" (UID: \"ca34b1ae-390f-48d0-aff6-524260a1ed19\") " pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:16.830110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.828982    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff65a204-91a1-41be-8986-464ae109a4a3-etc-tuned\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.831747 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.831723    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:16.831843 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.831755    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:16.831843 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.831769    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:16.831843 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:16.831830    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:37:17.33181436 +0000 UTC m=+3.080820399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:16.833009 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.832986    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggmr\" (UniqueName: \"kubernetes.io/projected/474329be-b0d8-4922-a5bc-bc5d62fc63be-kube-api-access-vggmr\") pod \"multus-additional-cni-plugins-nwc49\" (UID: \"474329be-b0d8-4922-a5bc-bc5d62fc63be\") " pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:16.833109 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.832996    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prlbw\" (UniqueName: \"kubernetes.io/projected/a49a070d-9b32-46f7-ad88-9338451f0b8f-kube-api-access-prlbw\") pod \"iptables-alerter-c2qlg\" (UID: \"a49a070d-9b32-46f7-ad88-9338451f0b8f\") " pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:16.833353 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.833311    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9sdw\" (UniqueName: \"kubernetes.io/projected/ff65a204-91a1-41be-8986-464ae109a4a3-kube-api-access-z9sdw\") pod \"tuned-vlcc2\" (UID: \"ff65a204-91a1-41be-8986-464ae109a4a3\") " pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:16.833807 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.833783    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kc5d\" (UniqueName: \"kubernetes.io/projected/9f5d0788-6048-437e-b01b-bab9557f948e-kube-api-access-9kc5d\") pod \"node-ca-2cq2r\" (UID: \"9f5d0788-6048-437e-b01b-bab9557f948e\") " pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:16.834028 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.834010    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9ck\" (UniqueName: \"kubernetes.io/projected/0650390e-fcae-415a-9ba8-57737e01556a-kube-api-access-5b9ck\") pod \"aws-ebs-csi-driver-node-twl8g\" (UID: \"0650390e-fcae-415a-9ba8-57737e01556a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:16.834766 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.834745    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htj8p\" (UniqueName: \"kubernetes.io/projected/6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed-kube-api-access-htj8p\") pod \"multus-wrbt4\" (UID: \"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed\") " pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:16.835087 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.835069    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bglj\" (UniqueName: \"kubernetes.io/projected/5de24734-fb4c-4871-b17e-069347aaeb37-kube-api-access-4bglj\") pod \"ovnkube-node-kx87t\" (UID: \"5de24734-fb4c-4871-b17e-069347aaeb37\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.838217 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.838197    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhvd9\" (UniqueName: \"kubernetes.io/projected/31443663-2252-44bd-af2e-6b6408ecd69c-kube-api-access-bhvd9\") pod \"node-resolver-99rzh\" (UID: \"31443663-2252-44bd-af2e-6b6408ecd69c\") " pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:16.838467 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.838452    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzpfw\" (UniqueName: \"kubernetes.io/projected/9022ab2d-fd3c-4739-b911-d257554cca54-kube-api-access-hzpfw\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:16.969154 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.969076    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:16.986888 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:16.986871    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vlcc2"
Jul 03 20:37:17.000755 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.000736    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2qlg"
Jul 03 20:37:17.017494 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.017473    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-99rzh"
Jul 03 20:37:17.032188 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.032170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2cq2r"
Jul 03 20:37:17.037874 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.037860    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wrbt4"
Jul 03 20:37:17.050326 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.050309    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:17.063715 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.063700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g"
Jul 03 20:37:17.067338 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.067319    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwc49"
Jul 03 20:37:17.282383 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.282345    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9dec68b5fc70760505a8e888fd282a0.slice/crio-3f80de56ed838598f5056207cd50d3c5aec4b08e4022c02ae4c0c55e9565f9de WatchSource:0}: Error finding container 3f80de56ed838598f5056207cd50d3c5aec4b08e4022c02ae4c0c55e9565f9de: Status 404 returned error can't find the container with id 3f80de56ed838598f5056207cd50d3c5aec4b08e4022c02ae4c0c55e9565f9de
Jul 03 20:37:17.283359 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.283330    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea9d48208bb56a32156494e4cb83cfb.slice/crio-b90215d25ac74ba6a49350ef64e7a809a2bdb817dcdd87d7e42dabce16733849 WatchSource:0}: Error finding container b90215d25ac74ba6a49350ef64e7a809a2bdb817dcdd87d7e42dabce16733849: Status 404 returned error can't find the container with id b90215d25ac74ba6a49350ef64e7a809a2bdb817dcdd87d7e42dabce16733849
Jul 03 20:37:17.284262 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.284239    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff65a204_91a1_41be_8986_464ae109a4a3.slice/crio-4878f596021cf06614d51912867438ccea4369acea786f023abccd0d424775ea WatchSource:0}: Error finding container 4878f596021cf06614d51912867438ccea4369acea786f023abccd0d424775ea: Status 404 returned error can't find the container with id 4878f596021cf06614d51912867438ccea4369acea786f023abccd0d424775ea
Jul 03 20:37:17.287252 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.287223    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 20:37:17.291057 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.291035    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de24734_fb4c_4871_b17e_069347aaeb37.slice/crio-4f4555800b46badf12e4ee3fe34221306b76b6dc4d961c7a5059f193bc325fe1 WatchSource:0}: Error finding container 4f4555800b46badf12e4ee3fe34221306b76b6dc4d961c7a5059f193bc325fe1: Status 404 returned error can't find the container with id 4f4555800b46badf12e4ee3fe34221306b76b6dc4d961c7a5059f193bc325fe1
Jul 03 20:37:17.304732 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.304711    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31443663_2252_44bd_af2e_6b6408ecd69c.slice/crio-8647fee0eeab38034a67984f9c9cbcc4e8eed39c56ccf07ef4032186b8b59482 WatchSource:0}: Error finding container 8647fee0eeab38034a67984f9c9cbcc4e8eed39c56ccf07ef4032186b8b59482: Status 404 returned error can't find the container with id 8647fee0eeab38034a67984f9c9cbcc4e8eed39c56ccf07ef4032186b8b59482
Jul 03 20:37:17.327363 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.327341    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49a070d_9b32_46f7_ad88_9338451f0b8f.slice/crio-d18b2e8a8e89354d634aca05fab3056f46971798e5e14b3eee127fd4f672cdce WatchSource:0}: Error finding container d18b2e8a8e89354d634aca05fab3056f46971798e5e14b3eee127fd4f672cdce: Status 404 returned error can't find the container with id d18b2e8a8e89354d634aca05fab3056f46971798e5e14b3eee127fd4f672cdce
Jul 03 20:37:17.329523 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.329504    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a214ce6_540e_4a40_bcb9_0b8e5d80b8ed.slice/crio-c4008bd1781491e5ad36d41888f1e0fc805fe6e9d3c6e7149c0af19772e78f43 WatchSource:0}: Error finding container c4008bd1781491e5ad36d41888f1e0fc805fe6e9d3c6e7149c0af19772e78f43: Status 404 returned error can't find the container with id c4008bd1781491e5ad36d41888f1e0fc805fe6e9d3c6e7149c0af19772e78f43
Jul 03 20:37:17.331185 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.331166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:17.331288 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.331201    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:17.331360 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.331319    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:17.331414 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.331365    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:37:18.331350385 +0000 UTC m=+4.080356401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:17.331414 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.331319    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:17.331414 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.331412    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:18.331401416 +0000 UTC m=+4.080407446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:17.403971 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.403922    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474329be_b0d8_4922_a5bc_bc5d62fc63be.slice/crio-f7e600a7224a0f20cc153d5abd4eaca25f82bb606e476c9fc560130399ea9923 WatchSource:0}: Error finding container f7e600a7224a0f20cc153d5abd4eaca25f82bb606e476c9fc560130399ea9923: Status 404 returned error can't find the container with id f7e600a7224a0f20cc153d5abd4eaca25f82bb606e476c9fc560130399ea9923
Jul 03 20:37:17.404271 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.404241    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5d0788_6048_437e_b01b_bab9557f948e.slice/crio-12c213d7ba232c5cc7aa7ff1421a91065c7d2697eeb8a774178e1696061fb6e4 WatchSource:0}: Error finding container 12c213d7ba232c5cc7aa7ff1421a91065c7d2697eeb8a774178e1696061fb6e4: Status 404 returned error can't find the container with id 12c213d7ba232c5cc7aa7ff1421a91065c7d2697eeb8a774178e1696061fb6e4
Jul 03 20:37:17.423772 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.423721    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2cq2r" event={"ID":"9f5d0788-6048-437e-b01b-bab9557f948e","Type":"ContainerStarted","Data":"12c213d7ba232c5cc7aa7ff1421a91065c7d2697eeb8a774178e1696061fb6e4"}
Jul 03 20:37:17.424777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.424757    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerStarted","Data":"f7e600a7224a0f20cc153d5abd4eaca25f82bb606e476c9fc560130399ea9923"}
Jul 03 20:37:17.425720 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.425694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdbfr" event={"ID":"ca34b1ae-390f-48d0-aff6-524260a1ed19","Type":"ContainerStarted","Data":"88ef1cd7412d82a389e6b7eaccdca8150c4b6361ee4fe0dda7ffb0d463622de2"}
Jul 03 20:37:17.426615 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.426590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wrbt4" event={"ID":"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed","Type":"ContainerStarted","Data":"c4008bd1781491e5ad36d41888f1e0fc805fe6e9d3c6e7149c0af19772e78f43"}
Jul 03 20:37:17.427425 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.427408    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal" event={"ID":"f9dec68b5fc70760505a8e888fd282a0","Type":"ContainerStarted","Data":"3f80de56ed838598f5056207cd50d3c5aec4b08e4022c02ae4c0c55e9565f9de"}
Jul 03 20:37:17.428362 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.428345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"0ea9d48208bb56a32156494e4cb83cfb","Type":"ContainerStarted","Data":"b90215d25ac74ba6a49350ef64e7a809a2bdb817dcdd87d7e42dabce16733849"}
Jul 03 20:37:17.429300 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.429280    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2qlg" event={"ID":"a49a070d-9b32-46f7-ad88-9338451f0b8f","Type":"ContainerStarted","Data":"d18b2e8a8e89354d634aca05fab3056f46971798e5e14b3eee127fd4f672cdce"}
Jul 03 20:37:17.430196 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.430171    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-99rzh" event={"ID":"31443663-2252-44bd-af2e-6b6408ecd69c","Type":"ContainerStarted","Data":"8647fee0eeab38034a67984f9c9cbcc4e8eed39c56ccf07ef4032186b8b59482"}
Jul 03 20:37:17.431272 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.431245    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"4f4555800b46badf12e4ee3fe34221306b76b6dc4d961c7a5059f193bc325fe1"}
Jul 03 20:37:17.431460 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.431445    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:17.431616 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.431598    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:17.431616 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.431617    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:17.431764 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.431627    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:17.431764 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.431679    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:37:18.43166547 +0000 UTC m=+4.180671485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:17.432219 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.432202    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vlcc2" event={"ID":"ff65a204-91a1-41be-8986-464ae109a4a3","Type":"ContainerStarted","Data":"4878f596021cf06614d51912867438ccea4369acea786f023abccd0d424775ea"}
Jul 03 20:37:17.453614 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:17.453583    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0650390e_fcae_415a_9ba8_57737e01556a.slice/crio-0e9afca06dc92bb5a3b8be6eb4a82facc8a5bb7427e1b35b7ff56dee644ab1d0 WatchSource:0}: Error finding container 0e9afca06dc92bb5a3b8be6eb4a82facc8a5bb7427e1b35b7ff56dee644ab1d0: Status 404 returned error can't find the container with id 0e9afca06dc92bb5a3b8be6eb4a82facc8a5bb7427e1b35b7ff56dee644ab1d0
Jul 03 20:37:17.455209 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.455189    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-driver start failed in pod aws-ebs-csi-driver-node-twl8g_openshift-cluster-csi-drivers(0650390e-fcae-415a-9ba8-57737e01556a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 03 20:37:17.455924 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.455903    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-node-driver-registrar start failed in pod aws-ebs-csi-driver-node-twl8g_openshift-cluster-csi-drivers(0650390e-fcae-415a-9ba8-57737e01556a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 03 20:37:17.457625 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.457608    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-liveness-probe start failed in pod aws-ebs-csi-driver-node-twl8g_openshift-cluster-csi-drivers(0650390e-fcae-415a-9ba8-57737e01556a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 03 20:37:17.457673 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:17.457651    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" podUID="0650390e-fcae-415a-9ba8-57737e01556a"
Jul 03 20:37:17.687388 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.687236    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 20:32:16 +0000 UTC" deadline="2028-01-07 12:49:14.386656134 +0000 UTC"
Jul 03 20:37:17.687388 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:17.687290    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13264h11m56.699369666s"
Jul 03 20:37:18.181274 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.181185    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:18.181274 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.181209    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:18.182215 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.181344    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:18.182215 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.181741    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:18.182215 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.181798    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:18.182215 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.181868    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:18.340547 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.340514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:18.340723 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.340604    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:18.340792 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.340725    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:18.340792 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.340783    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:20.340764922 +0000 UTC m=+6.089770942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:18.341506 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.341306    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:18.341506 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.341358    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:37:20.341342902 +0000 UTC m=+6.090348923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:18.441884 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.441195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:18.441884 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.441360    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:18.441884 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.441377    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:18.441884 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.441406    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:18.441884 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.441463    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:37:20.441443561 +0000 UTC m=+6.190449577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:18.465601 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.465563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" event={"ID":"0650390e-fcae-415a-9ba8-57737e01556a","Type":"ContainerStarted","Data":"0e9afca06dc92bb5a3b8be6eb4a82facc8a5bb7427e1b35b7ff56dee644ab1d0"}
Jul 03 20:37:18.475356 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:18.475314    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cde2dd29b991fab261b34481407faace228f79f1e92bdeef6c97eec1af7538e\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa590e7fc5391b1007aa63e4e4488de68ce3695cc319d50a3f9b438deda90b29\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:57b61ec1af2b592c8217f770864d5d3ffb8f77f17e1922158c3fab15728d6aa3\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" podUID="0650390e-fcae-415a-9ba8-57737e01556a"
Jul 03 20:37:18.687504 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.687425    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 20:32:16 +0000 UTC" deadline="2028-02-01 08:52:53.551762227 +0000 UTC"
Jul 03 20:37:18.687504 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:18.687463    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13860h15m34.864303593s"
Jul 03 20:37:20.180194 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:20.180151    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:20.180658 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.180329    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:20.180777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:20.180741    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:20.180913 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.180890    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:20.181008 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:20.180992    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:20.181104 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.181068    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:20.356833 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:20.355857    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:20.356833 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:20.355918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:20.356833 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.356050    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:20.356833 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.356114    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:37:24.356095034 +0000 UTC m=+10.105101052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:20.356833 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.356712    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:20.356833 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.356763    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:24.356747135 +0000 UTC m=+10.105753153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:20.457299 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:20.457215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:20.457464 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.457451    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:20.457522 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.457472    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:20.457522 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.457485    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:20.457635 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:20.457547    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:37:24.457527148 +0000 UTC m=+10.206533165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:22.181100 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:22.181066    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:22.181100 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:22.181095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:22.181612 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:22.181225    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:22.181612 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:22.181298    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:22.181612 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:22.181348    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:22.181612 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:22.181413    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:24.180619 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:24.180583    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:24.181157 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.180715    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:24.181157 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:24.180801    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:24.181157 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.180911    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:24.181157 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:24.180990    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:24.181157 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.181073    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:24.388242 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:24.388207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:24.388405 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:24.388300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:24.388490 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.388431    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:24.388549 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.388491    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:32.388472338 +0000 UTC m=+18.137478358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:24.388836 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.388731    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:24.388836 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.388812    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:37:32.388793005 +0000 UTC m=+18.137799033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:24.489019 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:24.488922    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:24.489182 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.489046    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:24.489182 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.489066    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:24.489182 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.489074    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:24.489182 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:24.489115    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:37:32.489102679 +0000 UTC m=+18.238108694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:26.180880 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:26.180847    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:26.181340 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:26.180996    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:26.181408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:26.181357    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:26.181461 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:26.181444    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:26.181512 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:26.181488    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:26.181565 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:26.181551    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:28.181254 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:28.180963    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:28.181685 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:28.180964    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:28.181685 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:28.181279    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:28.181685 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:28.180993    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:28.181685 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:28.181396    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:28.181685 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:28.181460    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:30.180651 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:30.180613    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:30.181152 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:30.180659    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:30.181152 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:30.180753    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:30.181152 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:30.180613    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:30.181152 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:30.180886    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:30.181152 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:30.181024    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:32.180927 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:32.180853    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:32.180927 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:32.180891    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:32.181380 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:32.180853    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:32.181380 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.180985    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:32.181380 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.181051    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:32.181380 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.181132    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:32.452356 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:32.452265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:32.452356 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:32.452330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:32.452576 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.452433    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:32.452576 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.452445    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:32.452576 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.452512    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:48.452491885 +0000 UTC m=+34.201497902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:32.452576 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.452532    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:37:48.452522791 +0000 UTC m=+34.201528810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:32.553576 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:32.553542    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:32.553768 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.553726    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:32.553768 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.553750    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:32.553768 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.553762    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:32.553907 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:32.553821    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:37:48.553801535 +0000 UTC m=+34.302807574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:34.180287 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:34.180225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:34.180859 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:34.180338    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:34.180859 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:34.180354    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:34.180859 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:34.180393    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:34.180859 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:34.180494    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:34.180859 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:34.180555    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:36.180555 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.180520    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:36.181046 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.180637    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:36.181046 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:36.180650    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:36.181046 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.180683    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:36.181046 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:36.180774    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:36.181046 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:36.180849    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:36.507270 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.507030    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wrbt4" event={"ID":"6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed","Type":"ContainerStarted","Data":"e8b099ed20519f99b735e3acf3a63e237e5dd33d836c8ccc2ec72e0b1d33ef7d"}
Jul 03 20:37:36.508707 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.508679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal" event={"ID":"f9dec68b5fc70760505a8e888fd282a0","Type":"ContainerStarted","Data":"d9f0e8f8322f8462954431d497118ac6c5f328e36f8a1ae9c7020a393f553fdc"}
Jul 03 20:37:36.510972 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.510926    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"9ff08d1674578a6680bf8f7596cf9daf23c5b231379a9a0a6ff0fae90213f566"}
Jul 03 20:37:36.511121 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.511019    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"c3e05cea3ca0ea1e8c439f11fb6539d4dbbe6adbbac26b77adf008c0c7510e39"}
Jul 03 20:37:36.513912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.513842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vlcc2" event={"ID":"ff65a204-91a1-41be-8986-464ae109a4a3","Type":"ContainerStarted","Data":"3e5e822bab7c2a78d36858f7c07d32a6c8446563855a0959a39869c90a9de3ec"}
Jul 03 20:37:36.522919 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.522870    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wrbt4" podStartSLOduration=2.944174969 podStartE2EDuration="21.522853894s" totalImagesPullingTime="18.578678925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:36.522204926 +0000 UTC m=+22.271210965" watchObservedRunningTime="2026-07-03 20:37:36.522853894 +0000 UTC m=+22.271859934"
Jul 03 20:37:36.541446 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.541405    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vlcc2" podStartSLOduration=2.969186472 podStartE2EDuration="21.541391508s" totalImagesPullingTime="18.572205036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:36.541119318 +0000 UTC m=+22.290125358" watchObservedRunningTime="2026-07-03 20:37:36.541391508 +0000 UTC m=+22.290397547"
Jul 03 20:37:36.553987 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:36.553931    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal" podStartSLOduration=20.553919002 podStartE2EDuration="20.553919002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:36.55376158 +0000 UTC m=+22.302767619" watchObservedRunningTime="2026-07-03 20:37:36.553919002 +0000 UTC m=+22.302925039"
Jul 03 20:37:37.517553 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.517306    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdbfr" event={"ID":"ca34b1ae-390f-48d0-aff6-524260a1ed19","Type":"ContainerStarted","Data":"3a9348fbcaa9c503fb2250dafc6c81bf9b45d914c69a5c22cacd16525ab02eaf"}
Jul 03 20:37:37.519492 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.519471    2569 generic.go:356] "Generic (PLEG): container finished" podID="0ea9d48208bb56a32156494e4cb83cfb" containerID="61d7b53785c2c4c489087883273464d7bc71475c81a7305abc9465d839f87e67" exitCode=0
Jul 03 20:37:37.519593 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.519525    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"0ea9d48208bb56a32156494e4cb83cfb","Type":"ContainerDied","Data":"61d7b53785c2c4c489087883273464d7bc71475c81a7305abc9465d839f87e67"}
Jul 03 20:37:37.521114 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.521095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2qlg" event={"ID":"a49a070d-9b32-46f7-ad88-9338451f0b8f","Type":"ContainerStarted","Data":"806551e0945a09a01423126c61cecf57fcf6bb75c4093586b68d05fed641eedc"}
Jul 03 20:37:37.522550 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.522522    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-99rzh" event={"ID":"31443663-2252-44bd-af2e-6b6408ecd69c","Type":"ContainerStarted","Data":"257e93fa428460bb5fbe0692ed5468d0411398a72946eecf86dcf5d6ffb859b0"}
Jul 03 20:37:37.524867 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.524848    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"fb1d22bbcc10588c1537469d5c00b4e858172d1fc2ff66b634bc6300305b448a"}
Jul 03 20:37:37.524972 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.524910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"59b2db7fd3b169ba948a278ab143dd86c2c9a364de07f7aa2417074670ec84a3"}
Jul 03 20:37:37.526080 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.526059    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2cq2r" event={"ID":"9f5d0788-6048-437e-b01b-bab9557f948e","Type":"ContainerStarted","Data":"a76ca1394286b80fb3035e429c77be0bd5958a48f22b21515aa8beb0cba2c8d3"}
Jul 03 20:37:37.527474 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.527452    2569 generic.go:356] "Generic (PLEG): container finished" podID="474329be-b0d8-4922-a5bc-bc5d62fc63be" containerID="b7e918a97b4499e0daeb205ee7051d7ee4998da69f3162f07f49d266e36b8e40" exitCode=0
Jul 03 20:37:37.527556 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.527528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerDied","Data":"b7e918a97b4499e0daeb205ee7051d7ee4998da69f3162f07f49d266e36b8e40"}
Jul 03 20:37:37.534284 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.534249    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cdbfr" podStartSLOduration=4.012617677 podStartE2EDuration="22.534238007s" totalImagesPullingTime="18.52162033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:37.534135072 +0000 UTC m=+23.283141110" watchObservedRunningTime="2026-07-03 20:37:37.534238007 +0000 UTC m=+23.283244045"
Jul 03 20:37:37.546655 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.546614    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c2qlg" podStartSLOduration=4.018450342 podStartE2EDuration="22.546602398s" totalImagesPullingTime="18.528152056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:37.546052221 +0000 UTC m=+23.295058261" watchObservedRunningTime="2026-07-03 20:37:37.546602398 +0000 UTC m=+23.295608435"
Jul 03 20:37:37.559120 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.559075    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-99rzh" podStartSLOduration=4.009866899 podStartE2EDuration="22.559062186s" totalImagesPullingTime="18.549195287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:37.558952996 +0000 UTC m=+23.307959031" watchObservedRunningTime="2026-07-03 20:37:37.559062186 +0000 UTC m=+23.308068224"
Jul 03 20:37:37.584755 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:37.584714    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2cq2r" podStartSLOduration=4.13204 podStartE2EDuration="22.584697765s" totalImagesPullingTime="18.452657765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:37.584439764 +0000 UTC m=+23.333445802" watchObservedRunningTime="2026-07-03 20:37:37.584697765 +0000 UTC m=+23.333703804"
Jul 03 20:37:38.180354 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.180315    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:38.180609 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:38.180432    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:38.180609 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.180323    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:38.180609 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.180315    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:38.180609 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:38.180555    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:38.180788 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:38.180637    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:38.534295 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.534249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"305ce1cb982226ae941c231696ef84574c7f6c8fec628a1ae091dd3be8a06aec"}
Jul 03 20:37:38.534788 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.534346    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"a6a01fefb03b7f28fa07a42d949f17f40fd0cce6bfbf57b2eab394acd9cdf657"}
Jul 03 20:37:38.536023 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.535995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" event={"ID":"0650390e-fcae-415a-9ba8-57737e01556a","Type":"ContainerStarted","Data":"65e709f1186202624eb8f459a5676a1c43e7458cfe15422011bba28b0f3f1b61"}
Jul 03 20:37:38.538711 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.538376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"0ea9d48208bb56a32156494e4cb83cfb","Type":"ContainerStarted","Data":"1736546508f884831a2cab944c865a1b2f14e819c27426c18d1596f2e7aa2ac2"}
Jul 03 20:37:38.556244 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:38.556197    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" podStartSLOduration=22.556179458 podStartE2EDuration="22.556179458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:38.555756175 +0000 UTC m=+24.304762214" watchObservedRunningTime="2026-07-03 20:37:38.556179458 +0000 UTC m=+24.305185497"
Jul 03 20:37:39.101056 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:39.101029    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 03 20:37:39.432461 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:39.432295    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T20:37:39.101048088Z","UUID":"ecdde7a0-7334-42e3-960c-f4ad93959c49","Handler":null,"Name":"","Endpoint":""}
Jul 03 20:37:39.433897 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:39.433875    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 03 20:37:39.434059 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:39.433918    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 03 20:37:39.543518 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:39.543480    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" event={"ID":"0650390e-fcae-415a-9ba8-57737e01556a","Type":"ContainerStarted","Data":"5d99bcb223fa9b67e8f126f34bf413905215b3c2be214f7ac071cece2e0a16d3"}
Jul 03 20:37:40.180292 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:40.180211    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:40.180292 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:40.180236    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:40.180480 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:40.180211    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:40.180480 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:40.180341    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:40.180480 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:40.180383    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:40.180480 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:40.180462    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:40.895737 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:40.895699    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:40.896432 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:40.896410    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:42.181110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.180924    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:42.181434 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.180952    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:42.181434 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:42.181194    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:42.181434 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.180980    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:42.181434 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:42.181252    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:42.181434 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:42.181320    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:42.553727 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.553695    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"75ec81c356f8f6fe1c8bcfb24eef342d5882ccf95b507f79db9b0a89818ab35e"}
Jul 03 20:37:42.555514 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.555489    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" event={"ID":"0650390e-fcae-415a-9ba8-57737e01556a","Type":"ContainerStarted","Data":"afb469df6b288ef3d043edacc3f236bce9ea0d0d5e592e92ad691d8d2b675435"}
Jul 03 20:37:42.557066 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.557034    2569 generic.go:356] "Generic (PLEG): container finished" podID="474329be-b0d8-4922-a5bc-bc5d62fc63be" containerID="ca919cf2f5b00fb2a818683b1ba4aac28ebae92f2cb6f131146c9ee97190f349" exitCode=0
Jul 03 20:37:42.557153 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.557065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerDied","Data":"ca919cf2f5b00fb2a818683b1ba4aac28ebae92f2cb6f131146c9ee97190f349"}
Jul 03 20:37:42.571805 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:42.571767    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twl8g" podStartSLOduration=3.252229621 podStartE2EDuration="27.571753364s" totalImagesPullingTime="24.319523743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=3 observedRunningTime="2026-07-03 20:37:42.571676959 +0000 UTC m=+28.320682994" watchObservedRunningTime="2026-07-03 20:37:42.571753364 +0000 UTC m=+28.320759402"
Jul 03 20:37:44.180875 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.180662    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:44.181431 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.180676    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:44.181431 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:44.180909    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:44.181431 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.180712    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:44.181431 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:44.180992    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:44.181431 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:44.181029    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:44.564069 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.564032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" event={"ID":"5de24734-fb4c-4871-b17e-069347aaeb37","Type":"ContainerStarted","Data":"2f5956f80a5e401a84068f86f9f7f0397dc56e15ce605d2796b7d724b07ffd42"}
Jul 03 20:37:44.564320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.564208    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:44.564320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.564272    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:44.564320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.564319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:44.566639 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.566612    2569 generic.go:356] "Generic (PLEG): container finished" podID="474329be-b0d8-4922-a5bc-bc5d62fc63be" containerID="6d79c50991dbcb377c09268a46421f6c8a16cae00a493dc05dcfc40b14c6108b" exitCode=0
Jul 03 20:37:44.566779 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.566653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerDied","Data":"6d79c50991dbcb377c09268a46421f6c8a16cae00a493dc05dcfc40b14c6108b"}
Jul 03 20:37:44.580734 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.580713    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:44.580825 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.580808    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:37:44.595255 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:44.595219    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t" podStartSLOduration=10.662239134 podStartE2EDuration="29.595206482s" totalImagesPullingTime="18.932967348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:44.594689584 +0000 UTC m=+30.343695622" watchObservedRunningTime="2026-07-03 20:37:44.595206482 +0000 UTC m=+30.344212520"
Jul 03 20:37:45.823302 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.823272    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:45.823657 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.823404    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 03 20:37:45.823833 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.823809    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cdbfr"
Jul 03 20:37:45.971888 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.971854    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mf6t2"]
Jul 03 20:37:45.972095 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.972004    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:45.972156 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:45.972125    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:45.972740 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.972711    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rgnz6"]
Jul 03 20:37:45.972878 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.972812    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:45.972975 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:45.972891    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:45.974704 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.974680    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9sckp"]
Jul 03 20:37:45.974794 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:45.974779    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:45.974899 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:45.974879    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:46.573051 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:46.573024    2569 generic.go:356] "Generic (PLEG): container finished" podID="474329be-b0d8-4922-a5bc-bc5d62fc63be" containerID="c487b09e11c78fec279628b05016a796353f1771171638c66185935821a8135e" exitCode=0
Jul 03 20:37:46.573180 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:46.573101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerDied","Data":"c487b09e11c78fec279628b05016a796353f1771171638c66185935821a8135e"}
Jul 03 20:37:47.181115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:47.180900    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:47.181514 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:47.180918    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:47.181514 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:47.181239    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:47.181514 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:47.181295    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:48.180236 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:48.180151    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:48.180376 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.180271    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rgnz6" podUID="f02bd3f8-0043-421d-a4d5-c5435bd9de3c"
Jul 03 20:37:48.473526 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:48.473439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:48.473526 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:48.473503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:48.474017 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.473590    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:48.474017 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.473613    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:48.474017 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.473656    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:38:20.473639416 +0000 UTC m=+66.222645431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 20:37:48.474017 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.473674    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret podName:6cd6d036-9a5b-42d0-b428-861c82202bff nodeName:}" failed. No retries permitted until 2026-07-03 20:38:20.473666967 +0000 UTC m=+66.222672984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret") pod "global-pull-secret-syncer-mf6t2" (UID: "6cd6d036-9a5b-42d0-b428-861c82202bff") : object "kube-system"/"original-pull-secret" not registered
Jul 03 20:37:48.574584 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:48.574549    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:48.574730 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.574696    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 20:37:48.574730 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.574717    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 20:37:48.574730 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.574726    2569 projected.go:196] Error preparing data for projected volume kube-api-access-s8mbd for pod openshift-network-diagnostics/network-check-target-rgnz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:48.574866 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:48.574780    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd podName:f02bd3f8-0043-421d-a4d5-c5435bd9de3c nodeName:}" failed. No retries permitted until 2026-07-03 20:38:20.574762024 +0000 UTC m=+66.323768049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8mbd" (UniqueName: "kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd") pod "network-check-target-rgnz6" (UID: "f02bd3f8-0043-421d-a4d5-c5435bd9de3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 20:37:49.180828 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:49.180799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:49.180828 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:49.180815    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:49.181115 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:49.180956    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mf6t2" podUID="6cd6d036-9a5b-42d0-b428-861c82202bff"
Jul 03 20:37:49.181115 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:49.181068    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:37:50.045028 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.044999    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeReady"
Jul 03 20:37:50.045659 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.045157    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 03 20:37:50.090437 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.090403    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fvf9x"]
Jul 03 20:37:50.095561 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.095525    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hm5tb"]
Jul 03 20:37:50.095682 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.095663    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.097384 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.097359    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 03 20:37:50.097513 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.097443    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v2wzp\""
Jul 03 20:37:50.097513 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.097443    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 03 20:37:50.099470 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.099454    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.101145 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.101105    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 03 20:37:50.101562 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.101484    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 03 20:37:50.102043 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.102004    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lzmlt\""
Jul 03 20:37:50.102162 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.102005    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 03 20:37:50.102871 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.102834    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fvf9x"]
Jul 03 20:37:50.108178 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.106800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hm5tb"]
Jul 03 20:37:50.181165 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.181134    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:37:50.183534 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.183510    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 20:37:50.183714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.183580    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ml64n\""
Jul 03 20:37:50.185065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185039    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 20:37:50.185730 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.185845 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185746    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd8c8768-8ac8-431b-8c67-3543adbab1b9-config-volume\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.185845 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8c8768-8ac8-431b-8c67-3543adbab1b9-tmp-dir\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.185980 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8426\" (UniqueName: \"kubernetes.io/projected/bd8c8768-8ac8-431b-8c67-3543adbab1b9-kube-api-access-p8426\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.185980 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185874    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54122702-f841-4ea6-965e-6116ab1bc2b7-cert\") pod \"ingress-canary-hm5tb\" (UID: \"54122702-f841-4ea6-965e-6116ab1bc2b7\") " pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.185980 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.185906    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn8vz\" (UniqueName: \"kubernetes.io/projected/54122702-f841-4ea6-965e-6116ab1bc2b7-kube-api-access-cn8vz\") pod \"ingress-canary-hm5tb\" (UID: \"54122702-f841-4ea6-965e-6116ab1bc2b7\") " pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.286779 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.286745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8426\" (UniqueName: \"kubernetes.io/projected/bd8c8768-8ac8-431b-8c67-3543adbab1b9-kube-api-access-p8426\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.286779 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.286779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54122702-f841-4ea6-965e-6116ab1bc2b7-cert\") pod \"ingress-canary-hm5tb\" (UID: \"54122702-f841-4ea6-965e-6116ab1bc2b7\") " pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.287065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.286809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn8vz\" (UniqueName: \"kubernetes.io/projected/54122702-f841-4ea6-965e-6116ab1bc2b7-kube-api-access-cn8vz\") pod \"ingress-canary-hm5tb\" (UID: \"54122702-f841-4ea6-965e-6116ab1bc2b7\") " pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.287065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.286875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.287065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.286903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd8c8768-8ac8-431b-8c67-3543adbab1b9-config-volume\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.287065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.286934    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8c8768-8ac8-431b-8c67-3543adbab1b9-tmp-dir\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.287266 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:50.287150    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:37:50.287266 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:50.287226    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:50.787203777 +0000 UTC m=+36.536209810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:37:50.287381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.287275    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8c8768-8ac8-431b-8c67-3543adbab1b9-tmp-dir\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.287626 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.287603    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd8c8768-8ac8-431b-8c67-3543adbab1b9-config-volume\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.291368 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.291346    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54122702-f841-4ea6-965e-6116ab1bc2b7-cert\") pod \"ingress-canary-hm5tb\" (UID: \"54122702-f841-4ea6-965e-6116ab1bc2b7\") " pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.296289 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.296223    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8426\" (UniqueName: \"kubernetes.io/projected/bd8c8768-8ac8-431b-8c67-3543adbab1b9-kube-api-access-p8426\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.296538 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.296513    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn8vz\" (UniqueName: \"kubernetes.io/projected/54122702-f841-4ea6-965e-6116ab1bc2b7-kube-api-access-cn8vz\") pod \"ingress-canary-hm5tb\" (UID: \"54122702-f841-4ea6-965e-6116ab1bc2b7\") " pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.417428 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.417378    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hm5tb"
Jul 03 20:37:50.597775 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.597714    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hm5tb"]
Jul 03 20:37:50.680388 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:50.680354    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54122702_f841_4ea6_965e_6116ab1bc2b7.slice/crio-98da5d4a443ebc22b2583fbcc3929ff3eb23607afcd47ca9f6db5b6d5ebbba42 WatchSource:0}: Error finding container 98da5d4a443ebc22b2583fbcc3929ff3eb23607afcd47ca9f6db5b6d5ebbba42: Status 404 returned error can't find the container with id 98da5d4a443ebc22b2583fbcc3929ff3eb23607afcd47ca9f6db5b6d5ebbba42
Jul 03 20:37:50.791311 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:50.791149    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:50.791418 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:50.791290    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:37:50.791418 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:50.791365    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:51.791350626 +0000 UTC m=+37.540356642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:37:51.180861 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.180771    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:37:51.181528 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.180966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:37:51.183169 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.183086    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 20:37:51.183169 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.183153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4xwrm\""
Jul 03 20:37:51.183169 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.183092    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 20:37:51.588747 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.588718    2569 generic.go:356] "Generic (PLEG): container finished" podID="474329be-b0d8-4922-a5bc-bc5d62fc63be" containerID="4a096595d80264f0c811ac8af46a2c7fdecee362b76aa5139508c69e9f9ff872" exitCode=0
Jul 03 20:37:51.588914 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.588814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerDied","Data":"4a096595d80264f0c811ac8af46a2c7fdecee362b76aa5139508c69e9f9ff872"}
Jul 03 20:37:51.590320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.590291    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hm5tb" event={"ID":"54122702-f841-4ea6-965e-6116ab1bc2b7","Type":"ContainerStarted","Data":"98da5d4a443ebc22b2583fbcc3929ff3eb23607afcd47ca9f6db5b6d5ebbba42"}
Jul 03 20:37:51.797983 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:51.797824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:51.798074 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:51.798002    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:37:51.798074 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:51.798069    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:53.7980491 +0000 UTC m=+39.547055120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:37:52.597583 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:52.597546    2569 generic.go:356] "Generic (PLEG): container finished" podID="474329be-b0d8-4922-a5bc-bc5d62fc63be" containerID="bc2fd5ab7ff5b0d17beeb65909e9fc812d7b684512d0ef9e80a1208f1573c6b5" exitCode=0
Jul 03 20:37:52.598036 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:52.597589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerDied","Data":"bc2fd5ab7ff5b0d17beeb65909e9fc812d7b684512d0ef9e80a1208f1573c6b5"}
Jul 03 20:37:53.601671 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:53.601631    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hm5tb" event={"ID":"54122702-f841-4ea6-965e-6116ab1bc2b7","Type":"ContainerStarted","Data":"4a743220561b11c92da1ee919efa4c8cc8ccaaf59f5871c375c9f0abe4dfa6c3"}
Jul 03 20:37:53.604878 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:53.604851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwc49" event={"ID":"474329be-b0d8-4922-a5bc-bc5d62fc63be","Type":"ContainerStarted","Data":"b111d0390c27ceb6e06d94d904ebeb2c4cb222887ebd0d88e6a3ed5a892cc630"}
Jul 03 20:37:53.616575 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:53.616533    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hm5tb" podStartSLOduration=1.384237616 podStartE2EDuration="3.616518798s" totalImagesPullingTime="2.232281182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:53.616045915 +0000 UTC m=+39.365051964" watchObservedRunningTime="2026-07-03 20:37:53.616518798 +0000 UTC m=+39.365524837"
Jul 03 20:37:53.638277 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:53.638231    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nwc49" podStartSLOduration=9.87277545 podStartE2EDuration="38.63821372s" totalImagesPullingTime="28.76543827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:53.637810014 +0000 UTC m=+39.386816052" watchObservedRunningTime="2026-07-03 20:37:53.63821372 +0000 UTC m=+39.387219759"
Jul 03 20:37:53.811549 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:53.811518    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:53.811697 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:53.811650    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:37:53.811742 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:53.811702    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:37:57.811689481 +0000 UTC m=+43.560695496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:37:54.686678 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.686494    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"]
Jul 03 20:37:54.707059 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.707020    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"]
Jul 03 20:37:54.707180 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.707094    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:54.709617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.709597    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 03 20:37:54.709759 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.709598    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fdng7\""
Jul 03 20:37:54.709759 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.709727    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 03 20:37:54.709759 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.709677    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 03 20:37:54.709928 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.709673    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 03 20:37:54.819119 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.819089    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbw6l\" (UniqueName: \"kubernetes.io/projected/2375cdaa-6ee1-48b9-9754-569fe4cb81e7-kube-api-access-pbw6l\") pod \"managed-serviceaccount-addon-agent-65f6869684-xs7pp\" (UID: \"2375cdaa-6ee1-48b9-9754-569fe4cb81e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:54.819267 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.819141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2375cdaa-6ee1-48b9-9754-569fe4cb81e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65f6869684-xs7pp\" (UID: \"2375cdaa-6ee1-48b9-9754-569fe4cb81e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:54.919956 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.919913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbw6l\" (UniqueName: \"kubernetes.io/projected/2375cdaa-6ee1-48b9-9754-569fe4cb81e7-kube-api-access-pbw6l\") pod \"managed-serviceaccount-addon-agent-65f6869684-xs7pp\" (UID: \"2375cdaa-6ee1-48b9-9754-569fe4cb81e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:54.920093 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.919972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2375cdaa-6ee1-48b9-9754-569fe4cb81e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65f6869684-xs7pp\" (UID: \"2375cdaa-6ee1-48b9-9754-569fe4cb81e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:54.924100 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.924082    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2375cdaa-6ee1-48b9-9754-569fe4cb81e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65f6869684-xs7pp\" (UID: \"2375cdaa-6ee1-48b9-9754-569fe4cb81e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:54.927521 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:54.927495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbw6l\" (UniqueName: \"kubernetes.io/projected/2375cdaa-6ee1-48b9-9754-569fe4cb81e7-kube-api-access-pbw6l\") pod \"managed-serviceaccount-addon-agent-65f6869684-xs7pp\" (UID: \"2375cdaa-6ee1-48b9-9754-569fe4cb81e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:55.030740 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:55.030712    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:37:55.165761 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:55.165733    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"]
Jul 03 20:37:55.168987 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:37:55.168961    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2375cdaa_6ee1_48b9_9754_569fe4cb81e7.slice/crio-f0190f96f88d238675196ac55c647379b8d2d122743668cc89d7f9466f375dff WatchSource:0}: Error finding container f0190f96f88d238675196ac55c647379b8d2d122743668cc89d7f9466f375dff: Status 404 returned error can't find the container with id f0190f96f88d238675196ac55c647379b8d2d122743668cc89d7f9466f375dff
Jul 03 20:37:55.610659 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:55.610626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" event={"ID":"2375cdaa-6ee1-48b9-9754-569fe4cb81e7","Type":"ContainerStarted","Data":"f0190f96f88d238675196ac55c647379b8d2d122743668cc89d7f9466f375dff"}
Jul 03 20:37:57.840729 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:57.840690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:37:57.841215 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:57.840887    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:37:57.841215 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:37:57.840982    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:38:05.840959752 +0000 UTC m=+51.589965769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:37:58.620443 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:58.620352    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" event={"ID":"2375cdaa-6ee1-48b9-9754-569fe4cb81e7","Type":"ContainerStarted","Data":"69b3376a851991ea52f060b3f9bf60c9d9ec88b52ac483c35e714de1cce953f0"}
Jul 03 20:37:58.646778 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:37:58.646730    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" podStartSLOduration=1.455592126 podStartE2EDuration="4.646715866s" totalImagesPullingTime="3.19112374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:58.646510779 +0000 UTC m=+44.395516817" watchObservedRunningTime="2026-07-03 20:37:58.646715866 +0000 UTC m=+44.395721902"
Jul 03 20:38:05.896052 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:05.896016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:38:05.896493 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:05.896124    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:38:05.896493 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:05.896173    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:38:21.89615873 +0000 UTC m=+67.645164746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:38:16.583974 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:16.583926    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx87t"
Jul 03 20:38:20.499058 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.499014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:38:20.499548 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.499089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:38:20.501544 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.501527    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 20:38:20.501619 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.501527    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 20:38:20.510010 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:20.509983    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 20:38:20.510117 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:20.510048    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:39:24.510030642 +0000 UTC m=+130.259036663 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : secret "metrics-daemon-secret" not found
Jul 03 20:38:20.512212 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.512192    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cd6d036-9a5b-42d0-b428-861c82202bff-original-pull-secret\") pod \"global-pull-secret-syncer-mf6t2\" (UID: \"6cd6d036-9a5b-42d0-b428-861c82202bff\") " pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:38:20.598553 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.598519    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mf6t2"
Jul 03 20:38:20.599742 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.599713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:38:20.601952 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.601923    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 20:38:20.612325 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.612299    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 20:38:20.623736 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.623709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8mbd\" (UniqueName: \"kubernetes.io/projected/f02bd3f8-0043-421d-a4d5-c5435bd9de3c-kube-api-access-s8mbd\") pod \"network-check-target-rgnz6\" (UID: \"f02bd3f8-0043-421d-a4d5-c5435bd9de3c\") " pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:38:20.734973 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.734877    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mf6t2"]
Jul 03 20:38:20.739278 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:38:20.739254    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd6d036_9a5b_42d0_b428_861c82202bff.slice/crio-c850a91dae3cdeabca3b77359d6ac77177ed921bf44ec616b865104c42f67ea9 WatchSource:0}: Error finding container c850a91dae3cdeabca3b77359d6ac77177ed921bf44ec616b865104c42f67ea9: Status 404 returned error can't find the container with id c850a91dae3cdeabca3b77359d6ac77177ed921bf44ec616b865104c42f67ea9
Jul 03 20:38:20.793288 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.793220    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ml64n\""
Jul 03 20:38:20.801879 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.801861    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:38:20.958494 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:20.958461    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rgnz6"]
Jul 03 20:38:20.961766 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:38:20.961735    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02bd3f8_0043_421d_a4d5_c5435bd9de3c.slice/crio-da8fabf874be594ab7de5449bfd08b14ec57bb79026afd271d9e77f0e6662909 WatchSource:0}: Error finding container da8fabf874be594ab7de5449bfd08b14ec57bb79026afd271d9e77f0e6662909: Status 404 returned error can't find the container with id da8fabf874be594ab7de5449bfd08b14ec57bb79026afd271d9e77f0e6662909
Jul 03 20:38:21.676199 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:21.676160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rgnz6" event={"ID":"f02bd3f8-0043-421d-a4d5-c5435bd9de3c","Type":"ContainerStarted","Data":"da8fabf874be594ab7de5449bfd08b14ec57bb79026afd271d9e77f0e6662909"}
Jul 03 20:38:21.677655 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:21.677602    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mf6t2" event={"ID":"6cd6d036-9a5b-42d0-b428-861c82202bff","Type":"ContainerStarted","Data":"c850a91dae3cdeabca3b77359d6ac77177ed921bf44ec616b865104c42f67ea9"}
Jul 03 20:38:21.909519 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:21.909476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:38:21.909716 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:21.909633    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:38:21.909716 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:21.909698    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:38:53.909681918 +0000 UTC m=+99.658687934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:38:25.690980 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:25.690871    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rgnz6" event={"ID":"f02bd3f8-0043-421d-a4d5-c5435bd9de3c","Type":"ContainerStarted","Data":"847e19a6f0d889ba800a0363e95a433320baaba3a265517f0347f3b85851fe51"}
Jul 03 20:38:25.691398 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:25.690996    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:38:25.692323 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:25.692300    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mf6t2" event={"ID":"6cd6d036-9a5b-42d0-b428-861c82202bff","Type":"ContainerStarted","Data":"baad1fbd84f4839e5267106e68789fe30ce687362ccb8bdb227f88c83da5cf25"}
Jul 03 20:38:25.705641 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:25.705599    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rgnz6" podStartSLOduration=66.296530051 podStartE2EDuration="1m10.705586003s" totalImagesPullingTime="4.409055952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:38:25.704829894 +0000 UTC m=+71.453835943" watchObservedRunningTime="2026-07-03 20:38:25.705586003 +0000 UTC m=+71.454592040"
Jul 03 20:38:25.718931 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:25.718877    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mf6t2" podStartSLOduration=66.084373522 podStartE2EDuration="1m10.718865259s" totalImagesPullingTime="4.634491737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:38:25.718421751 +0000 UTC m=+71.467427790" watchObservedRunningTime="2026-07-03 20:38:25.718865259 +0000 UTC m=+71.467871298"
Jul 03 20:38:53.923123 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:53.922974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:38:53.923123 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:53.923099    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:38:53.923643 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:38:53.923161    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:39:57.923144566 +0000 UTC m=+163.672150592 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:38:56.697263 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:38:56.697232    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rgnz6"
Jul 03 20:39:24.526425 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:24.526389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:39:24.526895 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:39:24.526515    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 20:39:24.526895 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:39:24.526575    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:26.526560166 +0000 UTC m=+252.275566182 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : secret "metrics-daemon-secret" not found
Jul 03 20:39:53.109898 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:39:53.109846    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fvf9x" podUID="bd8c8768-8ac8-431b-8c67-3543adbab1b9"
Jul 03 20:39:53.898562 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:53.898532    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:39:54.192485 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:39:54.192409    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:39:57.938081 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:57.938053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:39:57.938459 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:39:57.938198    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 20:39:57.938459 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:39:57.938261    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls podName:bd8c8768-8ac8-431b-8c67-3543adbab1b9 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:59.938245967 +0000 UTC m=+285.687251987 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls") pod "dns-default-fvf9x" (UID: "bd8c8768-8ac8-431b-8c67-3543adbab1b9") : secret "dns-default-metrics-tls" not found
Jul 03 20:39:58.911360 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:58.911274    2569 generic.go:356] "Generic (PLEG): container finished" podID="2375cdaa-6ee1-48b9-9754-569fe4cb81e7" containerID="69b3376a851991ea52f060b3f9bf60c9d9ec88b52ac483c35e714de1cce953f0" exitCode=255
Jul 03 20:39:58.911360 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:58.911328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" event={"ID":"2375cdaa-6ee1-48b9-9754-569fe4cb81e7","Type":"ContainerDied","Data":"69b3376a851991ea52f060b3f9bf60c9d9ec88b52ac483c35e714de1cce953f0"}
Jul 03 20:39:58.916772 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:58.916752    2569 scope.go:117] "RemoveContainer" containerID="69b3376a851991ea52f060b3f9bf60c9d9ec88b52ac483c35e714de1cce953f0"
Jul 03 20:39:59.915382 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:39:59.915343    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" event={"ID":"2375cdaa-6ee1-48b9-9754-569fe4cb81e7","Type":"ContainerStarted","Data":"782eedae427201418d97a5bab84de5223d566296bed3cd223f9903fe45d32784"}
Jul 03 20:40:07.180437 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:40:07.180340    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:41:16.447113 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.447079    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86f8489c86-kncdx"]
Jul 03 20:41:16.448950 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.448923    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.450760 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.450735    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 03 20:41:16.450896 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.450776    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 03 20:41:16.450991 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.450902    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dxprn\""
Jul 03 20:41:16.451183 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.451166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 03 20:41:16.458204 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.458188    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 03 20:41:16.472763 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.472742    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86f8489c86-kncdx"]
Jul 03 20:41:16.540141 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.540110    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"]
Jul 03 20:41:16.542211 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.542197    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"
Jul 03 20:41:16.543913 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.543891    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 03 20:41:16.544039 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.543891    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mlfv5\""
Jul 03 20:41:16.544039 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.543926    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 03 20:41:16.546625 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.546607    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"]
Jul 03 20:41:16.548337 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.548319    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qqcmk"]
Jul 03 20:41:16.548443 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.548428    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.550418 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550397    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 03 20:41:16.550492 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550435    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56f648dcdf-pj9r7"]
Jul 03 20:41:16.550600 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550582    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.550652 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550640    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 03 20:41:16.550705 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550658    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 03 20:41:16.550830 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550815    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h2n8c\""
Jul 03 20:41:16.550898 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.550867    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 03 20:41:16.552280 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.552241    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.552875 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.552855    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 03 20:41:16.553075 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.552870    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 03 20:41:16.553075 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.552892    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 03 20:41:16.553172 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.553149    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 03 20:41:16.553223 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.553195    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kw454\""
Jul 03 20:41:16.553756 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.553738    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"]
Jul 03 20:41:16.554570 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554372    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 03 20:41:16.554570 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554398    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 03 20:41:16.554570 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554381    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 03 20:41:16.554570 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554451    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 03 20:41:16.554570 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554561    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 03 20:41:16.554860 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554839    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 03 20:41:16.555002 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.554978    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d6djb\""
Jul 03 20:41:16.558055 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.558035    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"]
Jul 03 20:41:16.562731 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.562698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-trusted-ca\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.562888 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.562869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zz8q\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-kube-api-access-6zz8q\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.563061 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-bound-sa-token\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.563193 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563175    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97ed054f-96d3-4362-a84e-de4c8f0827cf-ca-trust-extracted\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.563343 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.563464 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fgsh\" (UniqueName: \"kubernetes.io/projected/b0af4eca-1d44-42d0-bcab-df4acb254b46-kube-api-access-9fgsh\") pod \"volume-data-source-validator-5d456fdbcd-w5b5j\" (UID: \"b0af4eca-1d44-42d0-bcab-df4acb254b46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"
Jul 03 20:41:16.563620 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-image-registry-private-configuration\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.563752 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-installation-pull-secrets\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.563873 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.563857    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-certificates\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.564293 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.564270    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 03 20:41:16.567699 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.567680    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qqcmk"]
Jul 03 20:41:16.568603 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.568581    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f648dcdf-pj9r7"]
Jul 03 20:41:16.664653 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-trusted-ca\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.664824 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664661    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.664824 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.664824 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-bound-sa-token\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.664824 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf2bq\" (UniqueName: \"kubernetes.io/projected/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-kube-api-access-lf2bq\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.664824 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664820    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665044 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-stats-auth\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.665044 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:16.664927    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 20:41:16.665044 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:16.664960    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86f8489c86-kncdx: secret "image-registry-tls" not found
Jul 03 20:41:16.665044 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.664968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-image-registry-private-configuration\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665044 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:16.665015    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls podName:97ed054f-96d3-4362-a84e-de4c8f0827cf nodeName:}" failed. No retries permitted until 2026-07-03 20:41:17.164996147 +0000 UTC m=+242.914002174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls") pod "image-registry-86f8489c86-kncdx" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf") : secret "image-registry-tls" not found
Jul 03 20:41:16.665044 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-certificates\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-trusted-ca\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zz8q\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-kube-api-access-6zz8q\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97ed054f-96d3-4362-a84e-de4c8f0827cf-ca-trust-extracted\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmv6t\" (UniqueName: \"kubernetes.io/projected/2b847e39-d44f-461f-89ff-6f6b22406d25-kube-api-access-vmv6t\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fgsh\" (UniqueName: \"kubernetes.io/projected/b0af4eca-1d44-42d0-bcab-df4acb254b46-kube-api-access-9fgsh\") pod \"volume-data-source-validator-5d456fdbcd-w5b5j\" (UID: \"b0af4eca-1d44-42d0-bcab-df4acb254b46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665202    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-config\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-default-certificate\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.665330 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-config\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.665714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-installation-pull-secrets\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-serving-cert\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.665714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665475    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97ed054f-96d3-4362-a84e-de4c8f0827cf-ca-trust-extracted\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665527    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng4rs\" (UniqueName: \"kubernetes.io/projected/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-kube-api-access-ng4rs\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.665714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665627    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-certificates\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.665714 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.665678    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-trusted-ca\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.667354 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.667331    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-image-registry-private-configuration\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.667465 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.667423    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-installation-pull-secrets\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.672021 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.672002    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-bound-sa-token\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.672873 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.672857    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zz8q\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-kube-api-access-6zz8q\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:16.673250 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.673227    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fgsh\" (UniqueName: \"kubernetes.io/projected/b0af4eca-1d44-42d0-bcab-df4acb254b46-kube-api-access-9fgsh\") pod \"volume-data-source-validator-5d456fdbcd-w5b5j\" (UID: \"b0af4eca-1d44-42d0-bcab-df4acb254b46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"
Jul 03 20:41:16.766026 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.765996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-trusted-ca\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.766149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmv6t\" (UniqueName: \"kubernetes.io/projected/2b847e39-d44f-461f-89ff-6f6b22406d25-kube-api-access-vmv6t\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.766149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766073    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-config\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.766149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.766149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-default-certificate\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.766149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-config\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.766381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-serving-cert\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.766381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766180    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng4rs\" (UniqueName: \"kubernetes.io/projected/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-kube-api-access-ng4rs\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.766381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.766381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766225    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.766381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf2bq\" (UniqueName: \"kubernetes.io/projected/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-kube-api-access-lf2bq\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.766381 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-stats-auth\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.766821 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766756    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-config\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.766883 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:16.766855    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 20:41:16.766930 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.766896    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-config\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.767025 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:16.766931    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:17.26691293 +0000 UTC m=+243.015918946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : secret "router-metrics-certs-default" not found
Jul 03 20:41:16.767025 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:16.766997    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:17.266970348 +0000 UTC m=+243.015976396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : configmap references non-existent config key: service-ca.crt
Jul 03 20:41:16.767195 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.767174    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-trusted-ca\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.768879 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.768852    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.769065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.769045    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-stats-auth\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.769137 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.769075    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-default-certificate\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.769232 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.769215    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-serving-cert\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.772957 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.772917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmv6t\" (UniqueName: \"kubernetes.io/projected/2b847e39-d44f-461f-89ff-6f6b22406d25-kube-api-access-vmv6t\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:16.776310 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.776286    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf2bq\" (UniqueName: \"kubernetes.io/projected/7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb-kube-api-access-lf2bq\") pod \"console-operator-68b757fb67-qqcmk\" (UID: \"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb\") " pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.776509 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.776494    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng4rs\" (UniqueName: \"kubernetes.io/projected/8eb0069d-4d2d-47a4-886d-a10c8e8f2a96-kube-api-access-ng4rs\") pod \"service-ca-operator-5d46d9ffd4-bdkrq\" (UID: \"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.852266 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.852240    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"
Jul 03 20:41:16.864930 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.864913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"
Jul 03 20:41:16.873657 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.873637    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:16.999794 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:16.999728    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j"]
Jul 03 20:41:17.016638 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.016557    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq"]
Jul 03 20:41:17.019748 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:17.019717    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb0069d_4d2d_47a4_886d_a10c8e8f2a96.slice/crio-858393f44c6f3efb5455e174c660e7a2b60142eca83dcd5cd6aeabb483170a1e WatchSource:0}: Error finding container 858393f44c6f3efb5455e174c660e7a2b60142eca83dcd5cd6aeabb483170a1e: Status 404 returned error can't find the container with id 858393f44c6f3efb5455e174c660e7a2b60142eca83dcd5cd6aeabb483170a1e
Jul 03 20:41:17.039264 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.039242    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qqcmk"]
Jul 03 20:41:17.042096 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:17.042068    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c92a97f_20dc_4d06_b9d1_0f4ec059a7eb.slice/crio-6bd29964667b9877ce2bf33e2da9a899a4b7b1a222fa546ff1056405c0ec75b2 WatchSource:0}: Error finding container 6bd29964667b9877ce2bf33e2da9a899a4b7b1a222fa546ff1056405c0ec75b2: Status 404 returned error can't find the container with id 6bd29964667b9877ce2bf33e2da9a899a4b7b1a222fa546ff1056405c0ec75b2
Jul 03 20:41:17.097169 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.097139    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" event={"ID":"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb","Type":"ContainerStarted","Data":"6bd29964667b9877ce2bf33e2da9a899a4b7b1a222fa546ff1056405c0ec75b2"}
Jul 03 20:41:17.098226 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.098204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j" event={"ID":"b0af4eca-1d44-42d0-bcab-df4acb254b46","Type":"ContainerStarted","Data":"f03b1f1d175eb5790abbb7923173730b2aee58007123299865bf287e5c261af9"}
Jul 03 20:41:17.099217 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.099197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq" event={"ID":"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96","Type":"ContainerStarted","Data":"858393f44c6f3efb5455e174c660e7a2b60142eca83dcd5cd6aeabb483170a1e"}
Jul 03 20:41:17.168753 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.168729    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:17.168851 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:17.168839    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 20:41:17.168898 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:17.168852    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86f8489c86-kncdx: secret "image-registry-tls" not found
Jul 03 20:41:17.168956 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:17.168905    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls podName:97ed054f-96d3-4362-a84e-de4c8f0827cf nodeName:}" failed. No retries permitted until 2026-07-03 20:41:18.168892209 +0000 UTC m=+243.917898225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls") pod "image-registry-86f8489c86-kncdx" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf") : secret "image-registry-tls" not found
Jul 03 20:41:17.269458 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.269382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:17.269458 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:17.269426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:17.269664 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:17.269515    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:18.269499513 +0000 UTC m=+244.018505529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : configmap references non-existent config key: service-ca.crt
Jul 03 20:41:17.269664 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:17.269595    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 20:41:17.269664 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:17.269656    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:18.269639695 +0000 UTC m=+244.018645726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : secret "router-metrics-certs-default" not found
Jul 03 20:41:18.175792 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:18.175740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:18.176258 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:18.175909    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 20:41:18.176258 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:18.175934    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86f8489c86-kncdx: secret "image-registry-tls" not found
Jul 03 20:41:18.176258 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:18.176016    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls podName:97ed054f-96d3-4362-a84e-de4c8f0827cf nodeName:}" failed. No retries permitted until 2026-07-03 20:41:20.175991807 +0000 UTC m=+245.924997825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls") pod "image-registry-86f8489c86-kncdx" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf") : secret "image-registry-tls" not found
Jul 03 20:41:18.276562 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:18.276403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:18.276562 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:18.276466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:18.276723 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:18.276592    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:20.276569392 +0000 UTC m=+246.025575421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : configmap references non-existent config key: service-ca.crt
Jul 03 20:41:18.276723 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:18.276637    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 20:41:18.276723 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:18.276685    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:20.276670032 +0000 UTC m=+246.025676052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : secret "router-metrics-certs-default" not found
Jul 03 20:41:19.106532 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:19.106492    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j" event={"ID":"b0af4eca-1d44-42d0-bcab-df4acb254b46","Type":"ContainerStarted","Data":"c48e9d91a4c723e77ae63c96b32bfae0b0e3ea5bcc63dc243601be2f6fb3d203"}
Jul 03 20:41:19.119243 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:19.119184    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-w5b5j" podStartSLOduration=1.8665171040000001 podStartE2EDuration="3.119168457s" totalImagesPullingTime="1.252651353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:19.11895772 +0000 UTC m=+244.867963757" watchObservedRunningTime="2026-07-03 20:41:19.119168457 +0000 UTC m=+244.868174494"
Jul 03 20:41:20.111672 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.111577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq" event={"ID":"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96","Type":"ContainerStarted","Data":"7bbc83306337dbc1902c832a28f74184e008c667929d11d108893b2881fef6c5"}
Jul 03 20:41:20.113151 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.113129    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/0.log"
Jul 03 20:41:20.113258 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.113167    2569 generic.go:356] "Generic (PLEG): container finished" podID="7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb" containerID="d540f90b1db30e5bcd60fa8107f2748c6ee8bde8fed90053fd5f4249b59c32fe" exitCode=255
Jul 03 20:41:20.113258 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.113197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" event={"ID":"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb","Type":"ContainerDied","Data":"d540f90b1db30e5bcd60fa8107f2748c6ee8bde8fed90053fd5f4249b59c32fe"}
Jul 03 20:41:20.113455 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.113438    2569 scope.go:117] "RemoveContainer" containerID="d540f90b1db30e5bcd60fa8107f2748c6ee8bde8fed90053fd5f4249b59c32fe"
Jul 03 20:41:20.124475 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.124435    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq" podStartSLOduration=1.400956929 podStartE2EDuration="4.12442184s" totalImagesPullingTime="2.723464911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:20.123730903 +0000 UTC m=+245.872736942" watchObservedRunningTime="2026-07-03 20:41:20.12442184 +0000 UTC m=+245.873427879"
Jul 03 20:41:20.191139 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.190901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:20.191139 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.191071    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 20:41:20.191139 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.191091    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86f8489c86-kncdx: secret "image-registry-tls" not found
Jul 03 20:41:20.191367 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.191165    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls podName:97ed054f-96d3-4362-a84e-de4c8f0827cf nodeName:}" failed. No retries permitted until 2026-07-03 20:41:24.191145049 +0000 UTC m=+249.940151068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls") pod "image-registry-86f8489c86-kncdx" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf") : secret "image-registry-tls" not found
Jul 03 20:41:20.292308 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.292276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:20.292471 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.292327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:20.292471 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.292441    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 20:41:20.292471 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.292449    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:24.292432054 +0000 UTC m=+250.041438073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : configmap references non-existent config key: service-ca.crt
Jul 03 20:41:20.292642 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.292480    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:24.292469761 +0000 UTC m=+250.041475777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : secret "router-metrics-certs-default" not found
Jul 03 20:41:20.629283 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.629246    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5wqhf"]
Jul 03 20:41:20.631377 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.631362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.633397 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.633365    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 03 20:41:20.633645 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.633628    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 03 20:41:20.633731 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.633716    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz87q\""
Jul 03 20:41:20.633856 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.633841    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 03 20:41:20.633856 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.633842    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 03 20:41:20.656869 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.656844    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5wqhf"]
Jul 03 20:41:20.695178 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.695152    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6211e9-da3e-452f-96cf-c3a550e002d7-data-volume\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.695306 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.695197    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5sxl\" (UniqueName: \"kubernetes.io/projected/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-api-access-t5sxl\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.695306 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.695224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.695389 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.695306    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b6211e9-da3e-452f-96cf-c3a550e002d7-crio-socket\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.695389 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.695329    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.796641 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796608    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6211e9-da3e-452f-96cf-c3a550e002d7-data-volume\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.796815 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5sxl\" (UniqueName: \"kubernetes.io/projected/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-api-access-t5sxl\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.796815 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.796815 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b6211e9-da3e-452f-96cf-c3a550e002d7-crio-socket\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.796815 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796789    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.797035 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.796834    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:20.797035 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.796895    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:21.296879701 +0000 UTC m=+247.045885716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:20.797035 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b6211e9-da3e-452f-96cf-c3a550e002d7-crio-socket\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.797035 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.796927    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 20:41:20.797035 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.796977    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6211e9-da3e-452f-96cf-c3a550e002d7-data-volume\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:20.797035 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:20.797014    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:21.29699711 +0000 UTC m=+247.046003131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : configmap "kube-rbac-proxy" not found
Jul 03 20:41:20.805979 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:20.805928    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5sxl\" (UniqueName: \"kubernetes.io/projected/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-api-access-t5sxl\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:21.118203 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.118174    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:41:21.118588 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.118564    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/0.log"
Jul 03 20:41:21.118628 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.118595    2569 generic.go:356] "Generic (PLEG): container finished" podID="7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb" containerID="444bfaf4ecb140de48e15e05ec3d3f9d07ebb8a9d6eab3184bc7a21b90c85fb4" exitCode=255
Jul 03 20:41:21.118685 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.118671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" event={"ID":"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb","Type":"ContainerDied","Data":"444bfaf4ecb140de48e15e05ec3d3f9d07ebb8a9d6eab3184bc7a21b90c85fb4"}
Jul 03 20:41:21.118723 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.118712    2569 scope.go:117] "RemoveContainer" containerID="d540f90b1db30e5bcd60fa8107f2748c6ee8bde8fed90053fd5f4249b59c32fe"
Jul 03 20:41:21.118893 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.118871    2569 scope.go:117] "RemoveContainer" containerID="444bfaf4ecb140de48e15e05ec3d3f9d07ebb8a9d6eab3184bc7a21b90c85fb4"
Jul 03 20:41:21.119115 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:21.119091    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qqcmk_openshift-console-operator(7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" podUID="7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb"
Jul 03 20:41:21.301382 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.301339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:21.301578 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:21.301434    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 20:41:21.301578 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:21.301480    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:22.301467416 +0000 UTC m=+248.050473431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : configmap "kube-rbac-proxy" not found
Jul 03 20:41:21.301578 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:21.301543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:21.301739 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:21.301640    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:21.301739 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:21.301683    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:22.301670738 +0000 UTC m=+248.050676754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:22.123023 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:22.122993    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:41:22.123460 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:22.123382    2569 scope.go:117] "RemoveContainer" containerID="444bfaf4ecb140de48e15e05ec3d3f9d07ebb8a9d6eab3184bc7a21b90c85fb4"
Jul 03 20:41:22.123591 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:22.123567    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qqcmk_openshift-console-operator(7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" podUID="7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb"
Jul 03 20:41:22.308757 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:22.308724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:22.308930 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:22.308774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:22.308930 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:22.308854    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 20:41:22.308930 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:22.308880    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:22.308930 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:22.308916    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:24.3088989 +0000 UTC m=+250.057904917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : configmap "kube-rbac-proxy" not found
Jul 03 20:41:22.308930 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:22.308932    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:24.308926015 +0000 UTC m=+250.057932031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:22.396525 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:22.396456    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-99rzh_31443663-2252-44bd-af2e-6b6408ecd69c/dns-node-resolver/0.log"
Jul 03 20:41:23.396704 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:23.396671    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2cq2r_9f5d0788-6048-437e-b01b-bab9557f948e/node-ca/0.log"
Jul 03 20:41:24.224246 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:24.224208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:24.224408 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.224358    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 20:41:24.224408 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.224378    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86f8489c86-kncdx: secret "image-registry-tls" not found
Jul 03 20:41:24.224476 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.224432    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls podName:97ed054f-96d3-4362-a84e-de4c8f0827cf nodeName:}" failed. No retries permitted until 2026-07-03 20:41:32.22441619 +0000 UTC m=+257.973422209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls") pod "image-registry-86f8489c86-kncdx" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf") : secret "image-registry-tls" not found
Jul 03 20:41:24.325220 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:24.325184    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:24.325396 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:24.325234    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:24.325396 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:24.325266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:24.325396 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:24.325294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:24.325396 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325329    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:24.325396 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325366    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 20:41:24.325396 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325390    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:28.325376045 +0000 UTC m=+254.074382061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:24.325673 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325404    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:32.325398096 +0000 UTC m=+258.074404112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : secret "router-metrics-certs-default" not found
Jul 03 20:41:24.325673 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325414    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:32.325408667 +0000 UTC m=+258.074414682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : configmap references non-existent config key: service-ca.crt
Jul 03 20:41:24.325673 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325330    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 20:41:24.325673 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:24.325434    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:28.325429808 +0000 UTC m=+254.074435824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : configmap "kube-rbac-proxy" not found
Jul 03 20:41:24.396447 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:24.396419    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hm5tb_54122702-f841-4ea6-965e-6116ab1bc2b7/serve-healthcheck-canary/0.log"
Jul 03 20:41:26.540751 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:26.540712    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:41:26.541115 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:26.540864    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 20:41:26.541115 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:26.540925    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs podName:9022ab2d-fd3c-4739-b911-d257554cca54 nodeName:}" failed. No retries permitted until 2026-07-03 20:43:28.540907751 +0000 UTC m=+374.289913775 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs") pod "network-metrics-daemon-9sckp" (UID: "9022ab2d-fd3c-4739-b911-d257554cca54") : secret "metrics-daemon-secret" not found
Jul 03 20:41:26.874486 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:26.874435    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:26.874656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:26.874515    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:26.874848 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:26.874835    2569 scope.go:117] "RemoveContainer" containerID="444bfaf4ecb140de48e15e05ec3d3f9d07ebb8a9d6eab3184bc7a21b90c85fb4"
Jul 03 20:41:26.875027 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:26.875007    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qqcmk_openshift-console-operator(7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" podUID="7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb"
Jul 03 20:41:28.353660 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:28.353616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:28.354056 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:28.353676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:28.354056 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:28.353770    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:28.354056 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:28.353830    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:36.353814381 +0000 UTC m=+262.102820397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:28.354056 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:28.353779    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 20:41:28.354056 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:28.353891    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:36.353880461 +0000 UTC m=+262.102886477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : configmap "kube-rbac-proxy" not found
Jul 03 20:41:32.286558 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.286522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:32.288877 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.288858    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"image-registry-86f8489c86-kncdx\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") " pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:32.357746 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.357722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:32.387477 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.387451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:32.387587 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.387500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:32.387626 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:32.387613    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle podName:2b847e39-d44f-461f-89ff-6f6b22406d25 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:48.387595262 +0000 UTC m=+274.136601277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle") pod "router-default-56f648dcdf-pj9r7" (UID: "2b847e39-d44f-461f-89ff-6f6b22406d25") : configmap references non-existent config key: service-ca.crt
Jul 03 20:41:32.389702 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.389676    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b847e39-d44f-461f-89ff-6f6b22406d25-metrics-certs\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:32.483464 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:32.483426    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86f8489c86-kncdx"]
Jul 03 20:41:32.485643 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:32.485602    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ed054f_96d3_4362_a84e_de4c8f0827cf.slice/crio-f1f8cdde34016f2cb829caf1e41f9d333d39f5d2e4b8f54ff95d0f3747d024bd WatchSource:0}: Error finding container f1f8cdde34016f2cb829caf1e41f9d333d39f5d2e4b8f54ff95d0f3747d024bd: Status 404 returned error can't find the container with id f1f8cdde34016f2cb829caf1e41f9d333d39f5d2e4b8f54ff95d0f3747d024bd
Jul 03 20:41:33.157926 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:33.157888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" event={"ID":"97ed054f-96d3-4362-a84e-de4c8f0827cf","Type":"ContainerStarted","Data":"5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66"}
Jul 03 20:41:33.158117 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:33.157961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" event={"ID":"97ed054f-96d3-4362-a84e-de4c8f0827cf","Type":"ContainerStarted","Data":"f1f8cdde34016f2cb829caf1e41f9d333d39f5d2e4b8f54ff95d0f3747d024bd"}
Jul 03 20:41:33.158117 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:33.158002    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:41:33.175361 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:33.175315    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" podStartSLOduration=17.175299925 podStartE2EDuration="17.175299925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:33.17395951 +0000 UTC m=+258.922965542" watchObservedRunningTime="2026-07-03 20:41:33.175299925 +0000 UTC m=+258.924305963"
Jul 03 20:41:36.420196 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:36.420154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:36.420684 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:36.420208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:36.420684 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:36.420310    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:36.420684 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:36.420393    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls podName:3b6211e9-da3e-452f-96cf-c3a550e002d7 nodeName:}" failed. No retries permitted until 2026-07-03 20:41:52.420373445 +0000 UTC m=+278.169379478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wqhf" (UID: "3b6211e9-da3e-452f-96cf-c3a550e002d7") : secret "insights-runtime-extractor-tls" not found
Jul 03 20:41:36.420684 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:36.420654    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6211e9-da3e-452f-96cf-c3a550e002d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:40.180396 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:40.180310    2569 scope.go:117] "RemoveContainer" containerID="444bfaf4ecb140de48e15e05ec3d3f9d07ebb8a9d6eab3184bc7a21b90c85fb4"
Jul 03 20:41:41.182320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:41.182291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:41:41.183785 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:41.183758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" event={"ID":"7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb","Type":"ContainerStarted","Data":"be98fbc19495962e9d00983b48ede621f01420ba09e5414ab4e6b913ec833977"}
Jul 03 20:41:41.184053 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:41.184036    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:41.188541 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:41.188521    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk"
Jul 03 20:41:41.199082 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:41.199041    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-qqcmk" podStartSLOduration=22.499543478 podStartE2EDuration="25.19902611s" totalImagesPullingTime="2.699482632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:41.198498467 +0000 UTC m=+266.947504508" watchObservedRunningTime="2026-07-03 20:41:41.19902611 +0000 UTC m=+266.948032142"
Jul 03 20:41:47.632917 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:47.632881    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86f8489c86-kncdx"]
Jul 03 20:41:47.637782 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:47.637751    2569 patch_prober.go:28] interesting pod/image-registry-86f8489c86-kncdx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 03 20:41:47.637961 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:47.637817    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 20:41:48.419033 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:48.418989    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:48.419569 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:48.419550    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b847e39-d44f-461f-89ff-6f6b22406d25-service-ca-bundle\") pod \"router-default-56f648dcdf-pj9r7\" (UID: \"2b847e39-d44f-461f-89ff-6f6b22406d25\") " pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:48.679196 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:48.679095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:48.802683 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:48.802645    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f648dcdf-pj9r7"]
Jul 03 20:41:48.807296 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:48.807270    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b847e39_d44f_461f_89ff_6f6b22406d25.slice/crio-4b832873056cc98b02d5451c9ff5d7ab1c8526ea74f0eb0286b282d3fce35823 WatchSource:0}: Error finding container 4b832873056cc98b02d5451c9ff5d7ab1c8526ea74f0eb0286b282d3fce35823: Status 404 returned error can't find the container with id 4b832873056cc98b02d5451c9ff5d7ab1c8526ea74f0eb0286b282d3fce35823
Jul 03 20:41:49.207454 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:49.207414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f648dcdf-pj9r7" event={"ID":"2b847e39-d44f-461f-89ff-6f6b22406d25","Type":"ContainerStarted","Data":"788a7accb375d7891c246f93da33046bcdf480eeec2fd8e3711aa306729bced5"}
Jul 03 20:41:49.207619 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:49.207469    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f648dcdf-pj9r7" event={"ID":"2b847e39-d44f-461f-89ff-6f6b22406d25","Type":"ContainerStarted","Data":"4b832873056cc98b02d5451c9ff5d7ab1c8526ea74f0eb0286b282d3fce35823"}
Jul 03 20:41:49.224125 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:49.224076    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56f648dcdf-pj9r7" podStartSLOduration=33.224062128 podStartE2EDuration="33.224062128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:49.223877095 +0000 UTC m=+274.972883133" watchObservedRunningTime="2026-07-03 20:41:49.224062128 +0000 UTC m=+274.973068167"
Jul 03 20:41:49.679828 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:49.679792    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:49.682233 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:49.682208    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:50.210822 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.210794    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:50.212004 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.211984    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56f648dcdf-pj9r7"
Jul 03 20:41:50.410415 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.410381    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bcbcbcc5b-jkrcl"]
Jul 03 20:41:50.413565 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.413545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.415339 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415321    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7f7z7\""
Jul 03 20:41:50.415541 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415518    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 03 20:41:50.415654 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415590    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 03 20:41:50.415654 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415602    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 03 20:41:50.415654 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415590    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 03 20:41:50.415654 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415638    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 03 20:41:50.415864 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415678    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 03 20:41:50.415864 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.415755    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 03 20:41:50.423348 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.423325    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcbcbcc5b-jkrcl"]
Jul 03 20:41:50.535637 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.535608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-config\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.535801 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.535652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-oauth-serving-cert\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.535801 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.535671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-serving-cert\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.535801 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.535747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-service-ca\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.535801 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.535779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctct8\" (UniqueName: \"kubernetes.io/projected/cff7b085-9ad0-4b51-b070-d43afa3cc9de-kube-api-access-ctct8\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.535990 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.535814    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-oauth-config\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637010 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.636978    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-oauth-serving-cert\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637010 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-serving-cert\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-service-ca\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctct8\" (UniqueName: \"kubernetes.io/projected/cff7b085-9ad0-4b51-b070-d43afa3cc9de-kube-api-access-ctct8\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637100    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-oauth-config\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637174    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-config\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637794 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637758    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-service-ca\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637913 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637825    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-config\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.637913 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.637843    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-oauth-serving-cert\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.639439 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.639414    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-serving-cert\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.639564 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.639545    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-oauth-config\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.644329 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.644303    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctct8\" (UniqueName: \"kubernetes.io/projected/cff7b085-9ad0-4b51-b070-d43afa3cc9de-kube-api-access-ctct8\") pod \"console-bcbcbcc5b-jkrcl\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") " pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.721828 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.721783    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:41:50.847550 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:50.847519    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcbcbcc5b-jkrcl"]
Jul 03 20:41:50.850383 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:50.850360    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff7b085_9ad0_4b51_b070_d43afa3cc9de.slice/crio-b0ea1493b2dc95ffa63ad98cb56c73049fb68fe83118400060e44bf93a427823 WatchSource:0}: Error finding container b0ea1493b2dc95ffa63ad98cb56c73049fb68fe83118400060e44bf93a427823: Status 404 returned error can't find the container with id b0ea1493b2dc95ffa63ad98cb56c73049fb68fe83118400060e44bf93a427823
Jul 03 20:41:51.214147 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:51.214062    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcbcc5b-jkrcl" event={"ID":"cff7b085-9ad0-4b51-b070-d43afa3cc9de","Type":"ContainerStarted","Data":"b0ea1493b2dc95ffa63ad98cb56c73049fb68fe83118400060e44bf93a427823"}
Jul 03 20:41:52.455122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:52.455081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:52.457563 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:52.457526    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6211e9-da3e-452f-96cf-c3a550e002d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wqhf\" (UID: \"3b6211e9-da3e-452f-96cf-c3a550e002d7\") " pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:52.740421 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:52.740370    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5wqhf"
Jul 03 20:41:53.968489 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:53.968458    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5wqhf"]
Jul 03 20:41:53.971558 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:53.971530    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6211e9_da3e_452f_96cf_c3a550e002d7.slice/crio-b9f9ca9b97eb9ef14fa92766d22bf2baaf3e2ef3255c902da3642508437f6db5 WatchSource:0}: Error finding container b9f9ca9b97eb9ef14fa92766d22bf2baaf3e2ef3255c902da3642508437f6db5: Status 404 returned error can't find the container with id b9f9ca9b97eb9ef14fa92766d22bf2baaf3e2ef3255c902da3642508437f6db5
Jul 03 20:41:54.225557 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:54.225531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wqhf" event={"ID":"3b6211e9-da3e-452f-96cf-c3a550e002d7","Type":"ContainerStarted","Data":"b9f9ca9b97eb9ef14fa92766d22bf2baaf3e2ef3255c902da3642508437f6db5"}
Jul 03 20:41:55.015916 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.015880    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"]
Jul 03 20:41:55.018162 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.018138    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.019981 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.019955    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 03 20:41:55.020581 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.020556    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dx6dc\""
Jul 03 20:41:55.020686 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.020629    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 03 20:41:55.020746 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.020683    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 03 20:41:55.020746 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.020684    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 03 20:41:55.020746 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.020626    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 03 20:41:55.028093 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.028072    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"]
Jul 03 20:41:55.177815 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.177785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.178003 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.177843    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.178003 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.177875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd42w\" (UniqueName: \"kubernetes.io/projected/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-kube-api-access-pd42w\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.178003 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.177900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.231098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.231053    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcbcc5b-jkrcl" event={"ID":"cff7b085-9ad0-4b51-b070-d43afa3cc9de","Type":"ContainerStarted","Data":"a9a3934832fd196f904cbc2c30eae25e8e43130f4888c8993d9b0ba145c3bb01"}
Jul 03 20:41:55.245923 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.245876    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bcbcbcc5b-jkrcl" podStartSLOduration=1.922249473 podStartE2EDuration="5.245860468s" totalImagesPullingTime="3.323610995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:55.244773414 +0000 UTC m=+280.993779475" watchObservedRunningTime="2026-07-03 20:41:55.245860468 +0000 UTC m=+280.994866502"
Jul 03 20:41:55.278838 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.278765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.279031 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.278868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.279031 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.278901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd42w\" (UniqueName: \"kubernetes.io/projected/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-kube-api-access-pd42w\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.279031 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.278967    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.279606 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.279579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.281934 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.281906    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.282048 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.282001    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.288272 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.288228    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd42w\" (UniqueName: \"kubernetes.io/projected/b38edb65-8c0a-45fb-b4c6-76aa43651c6b-kube-api-access-pd42w\") pod \"prometheus-operator-567f7b8b7c-sfjpr\" (UID: \"b38edb65-8c0a-45fb-b4c6-76aa43651c6b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.329078 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.329047    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"
Jul 03 20:41:55.460354 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:55.457294    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr"]
Jul 03 20:41:56.899244 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:56.899199    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fvf9x" podUID="bd8c8768-8ac8-431b-8c67-3543adbab1b9"
Jul 03 20:41:57.229588 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:41:57.229507    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38edb65_8c0a_45fb_b4c6_76aa43651c6b.slice/crio-8c233a58b553012029c5bac384743d5fa13a83a9c88d665aba718059bb0bb95c WatchSource:0}: Error finding container 8c233a58b553012029c5bac384743d5fa13a83a9c88d665aba718059bb0bb95c: Status 404 returned error can't find the container with id 8c233a58b553012029c5bac384743d5fa13a83a9c88d665aba718059bb0bb95c
Jul 03 20:41:57.238868 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:57.238847    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:41:57.239012 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:57.238849    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr" event={"ID":"b38edb65-8c0a-45fb-b4c6-76aa43651c6b","Type":"ContainerStarted","Data":"8c233a58b553012029c5bac384743d5fa13a83a9c88d665aba718059bb0bb95c"}
Jul 03 20:41:57.644026 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:57.639187    2569 patch_prober.go:28] interesting pod/image-registry-86f8489c86-kncdx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 03 20:41:57.644026 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:57.639257    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 20:41:58.245007 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:58.244977    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wqhf" event={"ID":"3b6211e9-da3e-452f-96cf-c3a550e002d7","Type":"ContainerStarted","Data":"80e7349401a0121f01930e94cda7080863ad3d475c2866d95a9a6f030d90af6f"}
Jul 03 20:41:59.251348 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.251309    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wqhf" event={"ID":"3b6211e9-da3e-452f-96cf-c3a550e002d7","Type":"ContainerStarted","Data":"ee615921ef10281dd2bbe3edfca38d711024c0ca4cb8c300c88dbbe2f4f66051"}
Jul 03 20:41:59.253290 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.253247    2569 generic.go:356] "Generic (PLEG): container finished" podID="2375cdaa-6ee1-48b9-9754-569fe4cb81e7" containerID="782eedae427201418d97a5bab84de5223d566296bed3cd223f9903fe45d32784" exitCode=255
Jul 03 20:41:59.253436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.253311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" event={"ID":"2375cdaa-6ee1-48b9-9754-569fe4cb81e7","Type":"ContainerDied","Data":"782eedae427201418d97a5bab84de5223d566296bed3cd223f9903fe45d32784"}
Jul 03 20:41:59.253436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.253361    2569 scope.go:117] "RemoveContainer" containerID="69b3376a851991ea52f060b3f9bf60c9d9ec88b52ac483c35e714de1cce953f0"
Jul 03 20:41:59.255484 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.255463    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr" event={"ID":"b38edb65-8c0a-45fb-b4c6-76aa43651c6b","Type":"ContainerStarted","Data":"831e91a7c6e3757e3bc8f3e0ea92f3cab4710b5854f9a6521052234e67365884"}
Jul 03 20:41:59.255597 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.255510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr" event={"ID":"b38edb65-8c0a-45fb-b4c6-76aa43651c6b","Type":"ContainerStarted","Data":"3e9c5d1ccedb75dba5dd5da49e85734784efbba91acd55c16ea514c91e63108e"}
Jul 03 20:41:59.260497 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:41:59.260476    2569 scope.go:117] "RemoveContainer" containerID="782eedae427201418d97a5bab84de5223d566296bed3cd223f9903fe45d32784"
Jul 03 20:41:59.260684 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:41:59.260659    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-65f6869684-xs7pp_open-cluster-management-agent-addon(2375cdaa-6ee1-48b9-9754-569fe4cb81e7)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" podUID="2375cdaa-6ee1-48b9-9754-569fe4cb81e7"
Jul 03 20:42:00.023746 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.023704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:42:00.026515 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.026485    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8c8768-8ac8-431b-8c67-3543adbab1b9-metrics-tls\") pod \"dns-default-fvf9x\" (UID: \"bd8c8768-8ac8-431b-8c67-3543adbab1b9\") " pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:42:00.242436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.242404    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v2wzp\""
Jul 03 20:42:00.251111 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.251079    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:42:00.722291 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.722257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:42:00.722694 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.722585    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:42:00.723906 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.723885    2569 patch_prober.go:28] interesting pod/console-bcbcbcc5b-jkrcl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body=
Jul 03 20:42:00.723991 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.723932    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bcbcbcc5b-jkrcl" podUID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused"
Jul 03 20:42:00.809267 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.809212    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sfjpr" podStartSLOduration=4.424719116 podStartE2EDuration="5.809189276s" totalImagesPullingTime="1.38447016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:41:59.28082656 +0000 UTC m=+285.029832598" watchObservedRunningTime="2026-07-03 20:42:00.809189276 +0000 UTC m=+286.558195316"
Jul 03 20:42:00.810214 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:00.810111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fvf9x"]
Jul 03 20:42:00.812537 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:00.812515    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8c8768_8ac8_431b_8c67_3543adbab1b9.slice/crio-842ea43005c651fe1fd15d2e93ea1e8c63afbc1c10007dd7588cd28ad3de7804 WatchSource:0}: Error finding container 842ea43005c651fe1fd15d2e93ea1e8c63afbc1c10007dd7588cd28ad3de7804: Status 404 returned error can't find the container with id 842ea43005c651fe1fd15d2e93ea1e8c63afbc1c10007dd7588cd28ad3de7804
Jul 03 20:42:01.269835 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:01.269786    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wqhf" event={"ID":"3b6211e9-da3e-452f-96cf-c3a550e002d7","Type":"ContainerStarted","Data":"92823057de209f0f94613dc3d5d889308270a4744e553a72ba7c678e8f387607"}
Jul 03 20:42:01.271459 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:01.271429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fvf9x" event={"ID":"bd8c8768-8ac8-431b-8c67-3543adbab1b9","Type":"ContainerStarted","Data":"842ea43005c651fe1fd15d2e93ea1e8c63afbc1c10007dd7588cd28ad3de7804"}
Jul 03 20:42:01.296091 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:01.296042    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5wqhf" podStartSLOduration=34.660575575 podStartE2EDuration="41.296026172s" totalImagesPullingTime="6.635450597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:41:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:01.295301733 +0000 UTC m=+287.044307761" watchObservedRunningTime="2026-07-03 20:42:01.296026172 +0000 UTC m=+287.045032209"
Jul 03 20:42:03.279042 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:03.279004    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fvf9x" event={"ID":"bd8c8768-8ac8-431b-8c67-3543adbab1b9","Type":"ContainerStarted","Data":"f6f16053155d8e5620c8678150feea6a87b8122492aa99b7cc44782584fef9b2"}
Jul 03 20:42:03.279466 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:03.279065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fvf9x" event={"ID":"bd8c8768-8ac8-431b-8c67-3543adbab1b9","Type":"ContainerStarted","Data":"e5ecb32041f3867f6a7c30cef5f44c440bd2658a8e22847e266cedf60d81ba7e"}
Jul 03 20:42:03.279466 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:03.279141    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:42:03.293461 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:03.293416    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fvf9x" podStartSLOduration=251.905284716 podStartE2EDuration="4m13.293402031s" totalImagesPullingTime="1.388117315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:03.293253761 +0000 UTC m=+289.042259800" watchObservedRunningTime="2026-07-03 20:42:03.293402031 +0000 UTC m=+289.042408068"
Jul 03 20:42:05.031031 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:05.030992    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp"
Jul 03 20:42:05.031436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:05.031343    2569 scope.go:117] "RemoveContainer" containerID="782eedae427201418d97a5bab84de5223d566296bed3cd223f9903fe45d32784"
Jul 03 20:42:05.031560 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:05.031540    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-65f6869684-xs7pp_open-cluster-management-agent-addon(2375cdaa-6ee1-48b9-9754-569fe4cb81e7)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" podUID="2375cdaa-6ee1-48b9-9754-569fe4cb81e7"
Jul 03 20:42:07.637297 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:07.637265    2569 patch_prober.go:28] interesting pod/image-registry-86f8489c86-kncdx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 03 20:42:07.637679 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:07.637320    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 20:42:09.716117 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.716082    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"]
Jul 03 20:42:09.718436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.718419    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.720244 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.720212    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 03 20:42:09.720244 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.720226    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5mk5s\""
Jul 03 20:42:09.720427 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.720283    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 03 20:42:09.729335 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.729315    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"]
Jul 03 20:42:09.796353 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.796319    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b06837c-01bf-439d-9d2d-26f45ab0bc01-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.796496 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.796399    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.796496 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.796435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.796572 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.796506    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jpw\" (UniqueName: \"kubernetes.io/projected/3b06837c-01bf-439d-9d2d-26f45ab0bc01-kube-api-access-r5jpw\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.897885 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.897845    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.897885 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.897886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.898137 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.897913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jpw\" (UniqueName: \"kubernetes.io/projected/3b06837c-01bf-439d-9d2d-26f45ab0bc01-kube-api-access-r5jpw\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.898137 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.898000    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b06837c-01bf-439d-9d2d-26f45ab0bc01-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.898137 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:09.898029    2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 03 20:42:09.898137 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:09.898093    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls podName:3b06837c-01bf-439d-9d2d-26f45ab0bc01 nodeName:}" failed. No retries permitted until 2026-07-03 20:42:10.398075123 +0000 UTC m=+296.147081155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-ff75z" (UID: "3b06837c-01bf-439d-9d2d-26f45ab0bc01") : secret "openshift-state-metrics-tls" not found
Jul 03 20:42:09.898699 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.898679    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b06837c-01bf-439d-9d2d-26f45ab0bc01-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.900399 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.900375    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.900399 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.900397    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-77m79"]
Jul 03 20:42:09.902535 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.902521    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.904207 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.904191    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 03 20:42:09.904279 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.904252    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 03 20:42:09.904494 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.904478    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 03 20:42:09.904551 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.904478    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-55fjf\""
Jul 03 20:42:09.909898 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.909870    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jpw\" (UniqueName: \"kubernetes.io/projected/3b06837c-01bf-439d-9d2d-26f45ab0bc01-kube-api-access-r5jpw\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:09.998716 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-textfile\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.998864 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-sys\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.998864 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-root\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.998864 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xzt\" (UniqueName: \"kubernetes.io/projected/25cf7655-039a-4a67-a825-354df9c9db29-kube-api-access-b2xzt\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.999014 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-wtmp\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.999014 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.999014 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.999014 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.998988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25cf7655-039a-4a67-a825-354df9c9db29-metrics-client-ca\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:09.999142 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:09.999036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-accelerators-collector-config\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.099849 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.099811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.099849 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.099849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25cf7655-039a-4a67-a825-354df9c9db29-metrics-client-ca\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.099871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-accelerators-collector-config\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.099923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-textfile\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.099976    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-sys\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.100034    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls podName:25cf7655-039a-4a67-a825-354df9c9db29 nodeName:}" failed. No retries permitted until 2026-07-03 20:42:10.600018192 +0000 UTC m=+296.349024208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls") pod "node-exporter-77m79" (UID: "25cf7655-039a-4a67-a825-354df9c9db29") : secret "node-exporter-tls" not found
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100053    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-sys\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100071 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-root\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100091    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xzt\" (UniqueName: \"kubernetes.io/projected/25cf7655-039a-4a67-a825-354df9c9db29-kube-api-access-b2xzt\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100158    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-root\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100172    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-wtmp\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100197    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100294    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-textfile\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100408 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-wtmp\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100610 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100484    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25cf7655-039a-4a67-a825-354df9c9db29-metrics-client-ca\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.100610 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.100551    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-accelerators-collector-config\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.102338 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.102322    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.109321 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.109300    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xzt\" (UniqueName: \"kubernetes.io/projected/25cf7655-039a-4a67-a825-354df9c9db29-kube-api-access-b2xzt\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.181783 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.181745    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9sckp" podUID="9022ab2d-fd3c-4739-b911-d257554cca54"
Jul 03 20:42:10.402700 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.402617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:10.402832 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.402761    2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 03 20:42:10.402884 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.402833    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls podName:3b06837c-01bf-439d-9d2d-26f45ab0bc01 nodeName:}" failed. No retries permitted until 2026-07-03 20:42:11.402817558 +0000 UTC m=+297.151823575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-ff75z" (UID: "3b06837c-01bf-439d-9d2d-26f45ab0bc01") : secret "openshift-state-metrics-tls" not found
Jul 03 20:42:10.604917 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.604879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:10.605106 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.605017    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 03 20:42:10.605106 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:10.605069    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls podName:25cf7655-039a-4a67-a825-354df9c9db29 nodeName:}" failed. No retries permitted until 2026-07-03 20:42:11.605054558 +0000 UTC m=+297.354060573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls") pod "node-exporter-77m79" (UID: "25cf7655-039a-4a67-a825-354df9c9db29") : secret "node-exporter-tls" not found
Jul 03 20:42:10.727296 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.727214    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:42:10.730991 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.730965    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:42:10.907291 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.907258    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 20:42:10.910446 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.910427    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:10.912320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.912293    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 03 20:42:10.912445 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.912307    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 03 20:42:10.912599 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.912580    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 03 20:42:10.912751 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.912730    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 03 20:42:10.913007 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.912986    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 03 20:42:10.913282 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.913252    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 03 20:42:10.913894 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.913734    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 03 20:42:10.913894 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.913777    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-97j9g\""
Jul 03 20:42:10.914167 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.914151    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 03 20:42:10.915192 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.913388    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 03 20:42:10.926333 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:10.926312    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 20:42:11.008541 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008677 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008549    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008677 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008677 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-web-config\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008677 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cb4f113-1d5a-4e2f-97dd-885e1203704b-config-out\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008820 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008687    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008820 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqn7\" (UniqueName: \"kubernetes.io/projected/3cb4f113-1d5a-4e2f-97dd-885e1203704b-kube-api-access-vtqn7\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008820 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008737    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cb4f113-1d5a-4e2f-97dd-885e1203704b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008820 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008768    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.008820 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.009011 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.009011 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.009011 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.008907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110211 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110211 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-web-config\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110433 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cb4f113-1d5a-4e2f-97dd-885e1203704b-config-out\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110433 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110270    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110433 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqn7\" (UniqueName: \"kubernetes.io/projected/3cb4f113-1d5a-4e2f-97dd-885e1203704b-kube-api-access-vtqn7\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110591 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cb4f113-1d5a-4e2f-97dd-885e1203704b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110591 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110591 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110591 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.110777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.110724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.111162 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.111140    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.111414 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:11.111396    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-trusted-ca-bundle podName:3cb4f113-1d5a-4e2f-97dd-885e1203704b nodeName:}" failed. No retries permitted until 2026-07-03 20:42:11.611376508 +0000 UTC m=+297.360382525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3cb4f113-1d5a-4e2f-97dd-885e1203704b") : configmap references non-existent config key: ca-bundle.crt
Jul 03 20:42:11.111672 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.111646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.113507 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.113225    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cb4f113-1d5a-4e2f-97dd-885e1203704b-config-out\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.113507 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.113320    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cb4f113-1d5a-4e2f-97dd-885e1203704b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.113984 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.113960    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.114353 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.114329    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-web-config\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.114436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.114358    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.114476 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.114467    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.114511 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.114477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.114572 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.114552    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.115473 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.115452    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cb4f113-1d5a-4e2f-97dd-885e1203704b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.116870 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.116850    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqn7\" (UniqueName: \"kubernetes.io/projected/3cb4f113-1d5a-4e2f-97dd-885e1203704b-kube-api-access-vtqn7\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.413826 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.413743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:11.416214 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.416190    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b06837c-01bf-439d-9d2d-26f45ab0bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ff75z\" (UID: \"3b06837c-01bf-439d-9d2d-26f45ab0bc01\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:11.536651 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.536613    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"
Jul 03 20:42:11.615057 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.615021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:11.615057 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.615060    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.615988 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.615934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb4f113-1d5a-4e2f-97dd-885e1203704b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb4f113-1d5a-4e2f-97dd-885e1203704b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.617574 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.617521    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25cf7655-039a-4a67-a825-354df9c9db29-node-exporter-tls\") pod \"node-exporter-77m79\" (UID: \"25cf7655-039a-4a67-a825-354df9c9db29\") " pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:11.667136 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.667017    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z"]
Jul 03 20:42:11.669862 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:11.669837    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b06837c_01bf_439d_9d2d_26f45ab0bc01.slice/crio-67374fae88d4f781a38376e520b729eddfbad6d7b889bf48f6ed988772e994ee WatchSource:0}: Error finding container 67374fae88d4f781a38376e520b729eddfbad6d7b889bf48f6ed988772e994ee: Status 404 returned error can't find the container with id 67374fae88d4f781a38376e520b729eddfbad6d7b889bf48f6ed988772e994ee
Jul 03 20:42:11.718258 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.718232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-77m79"
Jul 03 20:42:11.728154 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:11.728131    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25cf7655_039a_4a67_a825_354df9c9db29.slice/crio-803b5a45e8f935b666ee02c2ae179dc0a5e2e648c7792f60424fbf790a9af6a3 WatchSource:0}: Error finding container 803b5a45e8f935b666ee02c2ae179dc0a5e2e648c7792f60424fbf790a9af6a3: Status 404 returned error can't find the container with id 803b5a45e8f935b666ee02c2ae179dc0a5e2e648c7792f60424fbf790a9af6a3
Jul 03 20:42:11.821428 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.821399    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 20:42:11.948089 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:11.948020    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 20:42:11.950831 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:11.950805    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb4f113_1d5a_4e2f_97dd_885e1203704b.slice/crio-865eae912b0c9985861b8207bd94fdadf12f03cde647fa0933e1de06b72bd5a5 WatchSource:0}: Error finding container 865eae912b0c9985861b8207bd94fdadf12f03cde647fa0933e1de06b72bd5a5: Status 404 returned error can't find the container with id 865eae912b0c9985861b8207bd94fdadf12f03cde647fa0933e1de06b72bd5a5
Jul 03 20:42:12.309635 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:12.309604    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"865eae912b0c9985861b8207bd94fdadf12f03cde647fa0933e1de06b72bd5a5"}
Jul 03 20:42:12.310819 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:12.310788    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-77m79" event={"ID":"25cf7655-039a-4a67-a825-354df9c9db29","Type":"ContainerStarted","Data":"803b5a45e8f935b666ee02c2ae179dc0a5e2e648c7792f60424fbf790a9af6a3"}
Jul 03 20:42:12.312529 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:12.312507    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z" event={"ID":"3b06837c-01bf-439d-9d2d-26f45ab0bc01","Type":"ContainerStarted","Data":"dd676c4f89669f03c802f64193d9fcc073ce432453edca1cd7d303bc42c7d901"}
Jul 03 20:42:12.312625 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:12.312551    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z" event={"ID":"3b06837c-01bf-439d-9d2d-26f45ab0bc01","Type":"ContainerStarted","Data":"3066d650c662dccb64ee0e023fd7306b6f53a47c31c2e931423f76415c73598c"}
Jul 03 20:42:12.312625 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:12.312568    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z" event={"ID":"3b06837c-01bf-439d-9d2d-26f45ab0bc01","Type":"ContainerStarted","Data":"67374fae88d4f781a38376e520b729eddfbad6d7b889bf48f6ed988772e994ee"}
Jul 03 20:42:12.655165 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:12.655111    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry" containerID="cri-o://5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66" gracePeriod=30
Jul 03 20:42:13.272915 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.272886    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:42:13.285020 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.284999    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fvf9x"
Jul 03 20:42:13.320476 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.320445    2569 generic.go:356] "Generic (PLEG): container finished" podID="25cf7655-039a-4a67-a825-354df9c9db29" containerID="98fa17942e0a407e349793b66adf9d95a418cfdca093dd6b1840a2a132579e2a" exitCode=0
Jul 03 20:42:13.320585 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.320534    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-77m79" event={"ID":"25cf7655-039a-4a67-a825-354df9c9db29","Type":"ContainerDied","Data":"98fa17942e0a407e349793b66adf9d95a418cfdca093dd6b1840a2a132579e2a"}
Jul 03 20:42:13.321819 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.321799    2569 generic.go:356] "Generic (PLEG): container finished" podID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerID="5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66" exitCode=0
Jul 03 20:42:13.321915 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.321844    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f8489c86-kncdx"
Jul 03 20:42:13.321915 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.321886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" event={"ID":"97ed054f-96d3-4362-a84e-de4c8f0827cf","Type":"ContainerDied","Data":"5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66"}
Jul 03 20:42:13.322047 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.321955    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f8489c86-kncdx" event={"ID":"97ed054f-96d3-4362-a84e-de4c8f0827cf","Type":"ContainerDied","Data":"f1f8cdde34016f2cb829caf1e41f9d333d39f5d2e4b8f54ff95d0f3747d024bd"}
Jul 03 20:42:13.322047 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.321990    2569 scope.go:117] "RemoveContainer" containerID="5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66"
Jul 03 20:42:13.330346 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330328    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zz8q\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-kube-api-access-6zz8q\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330380    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97ed054f-96d3-4362-a84e-de4c8f0827cf-ca-trust-extracted\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330410    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-bound-sa-token\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330436 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330430    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-trusted-ca\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330545 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330449    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-certificates\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330545 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330474    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330545 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330490    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-image-registry-private-configuration\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.330545 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.330507    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-installation-pull-secrets\") pod \"97ed054f-96d3-4362-a84e-de4c8f0827cf\" (UID: \"97ed054f-96d3-4362-a84e-de4c8f0827cf\") "
Jul 03 20:42:13.331462 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.331129    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 20:42:13.333262 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.333234    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 20:42:13.334157 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.334132    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 20:42:13.334251 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.334131    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 20:42:13.334811 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.334715    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-kube-api-access-6zz8q" (OuterVolumeSpecName: "kube-api-access-6zz8q") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "kube-api-access-6zz8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 20:42:13.334902 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.334834    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 20:42:13.335887 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.335856    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 20:42:13.341566 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.341545    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97ed054f-96d3-4362-a84e-de4c8f0827cf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "97ed054f-96d3-4362-a84e-de4c8f0827cf" (UID: "97ed054f-96d3-4362-a84e-de4c8f0827cf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 20:42:13.344773 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.344685    2569 scope.go:117] "RemoveContainer" containerID="5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66"
Jul 03 20:42:13.345060 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:42:13.345027    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66\": container with ID starting with 5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66 not found: ID does not exist" containerID="5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66"
Jul 03 20:42:13.345156 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.345073    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66"} err="failed to get container status \"5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66\": rpc error: code = NotFound desc = could not find container \"5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66\": container with ID starting with 5ea17a144e0224b161800fa2e7bedc647355bff82eb35f607fa2e92c20b70c66 not found: ID does not exist"
Jul 03 20:42:13.431981 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.431935    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zz8q\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-kube-api-access-6zz8q\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.431986    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97ed054f-96d3-4362-a84e-de4c8f0827cf-ca-trust-extracted\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.432001    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-bound-sa-token\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.432015    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-trusted-ca\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.432026    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-certificates\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.432038    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97ed054f-96d3-4362-a84e-de4c8f0827cf-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.432052    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-image-registry-private-configuration\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.432282 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.432065    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97ed054f-96d3-4362-a84e-de4c8f0827cf-installation-pull-secrets\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:13.641161 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.641127    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86f8489c86-kncdx"]
Jul 03 20:42:13.644481 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:13.644455    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86f8489c86-kncdx"]
Jul 03 20:42:14.132328 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.132297    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9ffb795bc-jzks8"]
Jul 03 20:42:14.132603 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.132591    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry"
Jul 03 20:42:14.132646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.132604    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry"
Jul 03 20:42:14.132683 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.132656    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" containerName="registry"
Jul 03 20:42:14.135564 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.135545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.137339 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.137312    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 03 20:42:14.137339 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.137328    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c7ncd\""
Jul 03 20:42:14.137502 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.137454    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 03 20:42:14.137929 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.137909    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 03 20:42:14.138019 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.138006    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6dn65i4dc377d\""
Jul 03 20:42:14.138095 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.138078    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 03 20:42:14.145007 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.144976    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9ffb795bc-jzks8"]
Jul 03 20:42:14.237793 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.237759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-client-ca-bundle\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.237989 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.237802    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sshgj\" (UniqueName: \"kubernetes.io/projected/371870de-f457-4874-bc86-47e3c9838a41-kube-api-access-sshgj\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.237989 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.237901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371870de-f457-4874-bc86-47e3c9838a41-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.237989 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.237931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/371870de-f457-4874-bc86-47e3c9838a41-metrics-server-audit-profiles\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.238121 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.237998    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-secret-metrics-server-client-certs\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.238121 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.238030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/371870de-f457-4874-bc86-47e3c9838a41-audit-log\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.238121 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.238053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-secret-metrics-server-tls\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.327230 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.327197    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cb4f113-1d5a-4e2f-97dd-885e1203704b" containerID="c13800bdaa16f13c17f3152400516978a7010a974d38f1e9408c97dc53ea67e8" exitCode=0
Jul 03 20:42:14.327651 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.327293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerDied","Data":"c13800bdaa16f13c17f3152400516978a7010a974d38f1e9408c97dc53ea67e8"}
Jul 03 20:42:14.329669 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.329633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-77m79" event={"ID":"25cf7655-039a-4a67-a825-354df9c9db29","Type":"ContainerStarted","Data":"7299e4355a566fc8187281f828aa29c49d174a67b81de1c4bbb9f96db3d7854a"}
Jul 03 20:42:14.329896 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.329680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-77m79" event={"ID":"25cf7655-039a-4a67-a825-354df9c9db29","Type":"ContainerStarted","Data":"29e87b4292dffc4a2b88b452c974a649151a86edf07b887fcdceddbad6178155"}
Jul 03 20:42:14.331992 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.331966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z" event={"ID":"3b06837c-01bf-439d-9d2d-26f45ab0bc01","Type":"ContainerStarted","Data":"09cbd73eb3d1099ff211fa61d30a43f56ebbde77ebb5c7658cc5a95bfd45b1bd"}
Jul 03 20:42:14.339199 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371870de-f457-4874-bc86-47e3c9838a41-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339299 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/371870de-f457-4874-bc86-47e3c9838a41-metrics-server-audit-profiles\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339299 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-secret-metrics-server-client-certs\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339299 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/371870de-f457-4874-bc86-47e3c9838a41-audit-log\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339299 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339272    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-secret-metrics-server-tls\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339299 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-client-ca-bundle\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339535 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sshgj\" (UniqueName: \"kubernetes.io/projected/371870de-f457-4874-bc86-47e3c9838a41-kube-api-access-sshgj\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.339882 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.339845    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/371870de-f457-4874-bc86-47e3c9838a41-audit-log\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.340085 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.340062    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371870de-f457-4874-bc86-47e3c9838a41-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.340476 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.340418    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/371870de-f457-4874-bc86-47e3c9838a41-metrics-server-audit-profiles\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.341797 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.341778    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-secret-metrics-server-tls\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.341915 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.341898    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-client-ca-bundle\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.341992 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.341971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/371870de-f457-4874-bc86-47e3c9838a41-secret-metrics-server-client-certs\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.346489 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.346468    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sshgj\" (UniqueName: \"kubernetes.io/projected/371870de-f457-4874-bc86-47e3c9838a41-kube-api-access-sshgj\") pod \"metrics-server-9ffb795bc-jzks8\" (UID: \"371870de-f457-4874-bc86-47e3c9838a41\") " pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.367705 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.367659    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ff75z" podStartSLOduration=3.865970789 podStartE2EDuration="5.367647582s" totalImagesPullingTime="1.501676793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:14.36639448 +0000 UTC m=+300.115400533" watchObservedRunningTime="2026-07-03 20:42:14.367647582 +0000 UTC m=+300.116653671"
Jul 03 20:42:14.381611 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.381577    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-77m79" podStartSLOduration=4.525636751 podStartE2EDuration="5.381564739s" totalImagesPullingTime="782.910996ms" totalInitContainerRuntime="73.016992ms" isStatefulPod=true podCreationTimestamp="2026-07-03 20:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:14.380734835 +0000 UTC m=+300.129740873" watchObservedRunningTime="2026-07-03 20:42:14.381564739 +0000 UTC m=+300.130570802"
Jul 03 20:42:14.444661 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.444600    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:14.572133 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.572099    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9ffb795bc-jzks8"]
Jul 03 20:42:14.577817 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:14.577773    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371870de_f457_4874_bc86_47e3c9838a41.slice/crio-ec48829ed9bd05e3337b682450392d57c1b3c3d3089bfd8f27ca619ceecc3f28 WatchSource:0}: Error finding container ec48829ed9bd05e3337b682450392d57c1b3c3d3089bfd8f27ca619ceecc3f28: Status 404 returned error can't find the container with id ec48829ed9bd05e3337b682450392d57c1b3c3d3089bfd8f27ca619ceecc3f28
Jul 03 20:42:14.617587 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.617554    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"]
Jul 03 20:42:14.622845 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.622821    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.626691 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.625071    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 03 20:42:14.626691 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.625153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hqs2l\""
Jul 03 20:42:14.633849 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.632681    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"]
Jul 03 20:42:14.651398 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.651373    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:42:14.652383 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.652356    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:42:14.666576 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.666558    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 03 20:42:14.745304 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.745271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvj75\" (UniqueName: \"kubernetes.io/projected/1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325-kube-api-access-zvj75\") pod \"monitoring-plugin-d5dcff7cf-w668t\" (UID: \"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.745452 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.745408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-w668t\" (UID: \"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.846450 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.846417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-w668t\" (UID: \"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.846617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.846483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvj75\" (UniqueName: \"kubernetes.io/projected/1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325-kube-api-access-zvj75\") pod \"monitoring-plugin-d5dcff7cf-w668t\" (UID: \"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.848879 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.848852    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-w668t\" (UID: \"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.853186 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.853167    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvj75\" (UniqueName: \"kubernetes.io/projected/1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325-kube-api-access-zvj75\") pod \"monitoring-plugin-d5dcff7cf-w668t\" (UID: \"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:14.941628 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:14.941602    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:15.012896 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.012821    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"]
Jul 03 20:42:15.018301 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.018045    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.019977 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.019933    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sq5rd\""
Jul 03 20:42:15.020589 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.020563    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 03 20:42:15.020691 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.020607    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 03 20:42:15.020852 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.020831    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 03 20:42:15.021039 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.021023    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 03 20:42:15.021110 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.021088    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 03 20:42:15.025138 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.025082    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"]
Jul 03 20:42:15.025585 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.025563    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 03 20:42:15.072634 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.072537    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"]
Jul 03 20:42:15.075063 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:15.075034    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0b0b4d_d9c2_41bc_a1b1_2e77bf7bd325.slice/crio-9fcba57a629fb44dc8d12e10fce23f3b733b4b1d0c91fd958fbb5ab7461c84f1 WatchSource:0}: Error finding container 9fcba57a629fb44dc8d12e10fce23f3b733b4b1d0c91fd958fbb5ab7461c84f1: Status 404 returned error can't find the container with id 9fcba57a629fb44dc8d12e10fce23f3b733b4b1d0c91fd958fbb5ab7461c84f1
Jul 03 20:42:15.149646 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.149609    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.149828 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.149683    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-federate-client-tls\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.149828 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.149714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-telemeter-client-tls\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.150098 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.150069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-serving-certs-ca-bundle\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.150216 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.150133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-secret-telemeter-client\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.150216 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.150173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrgj\" (UniqueName: \"kubernetes.io/projected/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-kube-api-access-qtrgj\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.150216 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.150204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-metrics-client-ca\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.150379 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.150240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.188741 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.188590    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ed054f-96d3-4362-a84e-de4c8f0827cf" path="/var/lib/kubelet/pods/97ed054f-96d3-4362-a84e-de4c8f0827cf/volumes"
Jul 03 20:42:15.251112 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251312 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251312 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-federate-client-tls\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251312 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251222    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-telemeter-client-tls\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251312 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-serving-certs-ca-bundle\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-secret-telemeter-client\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrgj\" (UniqueName: \"kubernetes.io/projected/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-kube-api-access-qtrgj\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.251552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.251386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-metrics-client-ca\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.252220 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.252192    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-metrics-client-ca\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.252327 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.252310    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-serving-certs-ca-bundle\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.252327 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.252315    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.254608 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.254581    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-secret-telemeter-client\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.254718 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.254661    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.254777 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.254714    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-telemeter-client-tls\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.255201 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.255182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-federate-client-tls\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.259649 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.259621    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrgj\" (UniqueName: \"kubernetes.io/projected/67efaf64-a2a3-406a-a2b7-c6e52e69e6e5-kube-api-access-qtrgj\") pod \"telemeter-client-5ffc97dc85-hmnn4\" (UID: \"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5\") " pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.329748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.329671    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"
Jul 03 20:42:15.339471 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.339434    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t" event={"ID":"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325","Type":"ContainerStarted","Data":"9fcba57a629fb44dc8d12e10fce23f3b733b4b1d0c91fd958fbb5ab7461c84f1"}
Jul 03 20:42:15.341309 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.341279    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8" event={"ID":"371870de-f457-4874-bc86-47e3c9838a41","Type":"ContainerStarted","Data":"ec48829ed9bd05e3337b682450392d57c1b3c3d3089bfd8f27ca619ceecc3f28"}
Jul 03 20:42:15.491359 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:15.491328    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4"]
Jul 03 20:42:15.496112 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:15.496075    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67efaf64_a2a3_406a_a2b7_c6e52e69e6e5.slice/crio-c52ba09d1b9a08f693f26198875651a978771b2f2e81b1b7fbe1de69d9c4e7a3 WatchSource:0}: Error finding container c52ba09d1b9a08f693f26198875651a978771b2f2e81b1b7fbe1de69d9c4e7a3: Status 404 returned error can't find the container with id c52ba09d1b9a08f693f26198875651a978771b2f2e81b1b7fbe1de69d9c4e7a3
Jul 03 20:42:16.015958 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.015893    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 20:42:16.022535 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.022512    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.024619 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.024590    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 03 20:42:16.024915 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.024894    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 03 20:42:16.025059 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.024981    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 03 20:42:16.025397 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.025377    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 03 20:42:16.025630 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.025603    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-au85ep4ujmid9\""
Jul 03 20:42:16.025891 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.025859    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n28dk\""
Jul 03 20:42:16.026191 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.026060    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 03 20:42:16.026339 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.026285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 03 20:42:16.027096 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.026536    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 03 20:42:16.027096 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.026726    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 03 20:42:16.027096 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.026905    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 03 20:42:16.027096 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.027019    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 03 20:42:16.027616 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.027451    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 03 20:42:16.027616 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.027485    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 03 20:42:16.031273 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.031132    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 03 20:42:16.040642 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.037075    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 03 20:42:16.044414 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.044393    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 20:42:16.058966 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.058920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.059172 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.059152    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060475 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.059316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060607 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060607 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7h8n\" (UniqueName: \"kubernetes.io/projected/b99e93f6-8824-4926-8533-87aaf29fe099-kube-api-access-t7h8n\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060607 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e93f6-8824-4926-8533-87aaf29fe099-config-out\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060768 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060768 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060644    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060768 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e93f6-8824-4926-8533-87aaf29fe099-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060768 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.060768 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061024 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061024 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061024 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061024 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-web-config\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061024 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.060981    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061245 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.061048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061245 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.061076    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-config\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061245 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.061098    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.061245 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.061128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.162735 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.162735 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-web-config\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.162735 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-config\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162808    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162887    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.162983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7h8n\" (UniqueName: \"kubernetes.io/projected/b99e93f6-8824-4926-8533-87aaf29fe099-kube-api-access-t7h8n\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e93f6-8824-4926-8533-87aaf29fe099-config-out\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e93f6-8824-4926-8533-87aaf29fe099-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163141    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163167    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.163594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.163220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.164096 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.164071    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.166065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.164349    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.166065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.164626    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.166065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.164837    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.166065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.165729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.167634 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.167600    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.167995 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.167930    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.169069 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.169042    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.169642 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.169477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e93f6-8824-4926-8533-87aaf29fe099-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.169853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.169797    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.169853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.169823    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170218 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.169850    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170218 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170197    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e93f6-8824-4926-8533-87aaf29fe099-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170335 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170296    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170553 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170488    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-config\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170553 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170504    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170553 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170518    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-web-config\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170687 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e93f6-8824-4926-8533-87aaf29fe099-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.170687 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.170596    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e93f6-8824-4926-8533-87aaf29fe099-config-out\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.174300 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.174283    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7h8n\" (UniqueName: \"kubernetes.io/projected/b99e93f6-8824-4926-8533-87aaf29fe099-kube-api-access-t7h8n\") pod \"prometheus-k8s-0\" (UID: \"b99e93f6-8824-4926-8533-87aaf29fe099\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.188258 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.188243    2569 scope.go:117] "RemoveContainer" containerID="782eedae427201418d97a5bab84de5223d566296bed3cd223f9903fe45d32784"
Jul 03 20:42:16.339352 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.339256    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:16.352138 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:16.352097    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4" event={"ID":"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5","Type":"ContainerStarted","Data":"c52ba09d1b9a08f693f26198875651a978771b2f2e81b1b7fbe1de69d9c4e7a3"}
Jul 03 20:42:17.201633 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.201610    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 20:42:17.358096 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.358058    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f6869684-xs7pp" event={"ID":"2375cdaa-6ee1-48b9-9754-569fe4cb81e7","Type":"ContainerStarted","Data":"5ffce7587949cdda456417053726261107799992396097a3d4cdd30514b6348a"}
Jul 03 20:42:17.359875 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.359839    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t" event={"ID":"1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325","Type":"ContainerStarted","Data":"a1fc6ace1cbbde0aa6387ca0d15bb57064d55f70dcdaf50717b8e8ca6be1d698"}
Jul 03 20:42:17.360044 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.359970    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:17.362360 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.362286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"9d0a74b2a80110770ed47469b13c793ffb7c5f3ae1236dd13a4e915f01261fdd"}
Jul 03 20:42:17.364010 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.363987    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8" event={"ID":"371870de-f457-4874-bc86-47e3c9838a41","Type":"ContainerStarted","Data":"627fc445123152b66312a5429f5afe42c8cdeffcb8e9a442c6106fcd4ae6d4b6"}
Jul 03 20:42:17.365900 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.365882    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t"
Jul 03 20:42:17.388033 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.387934    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8" podStartSLOduration=0.954315798 podStartE2EDuration="3.387918979s" totalImagesPullingTime="2.433603181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:17.38717515 +0000 UTC m=+303.136181190" watchObservedRunningTime="2026-07-03 20:42:17.387918979 +0000 UTC m=+303.136925019"
Jul 03 20:42:17.399826 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.399774    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-w668t" podStartSLOduration=1.458908452 podStartE2EDuration="3.399755072s" totalImagesPullingTime="1.94084662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:17.399162147 +0000 UTC m=+303.148168220" watchObservedRunningTime="2026-07-03 20:42:17.399755072 +0000 UTC m=+303.148761111"
Jul 03 20:42:17.603608 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:42:17.603572    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99e93f6_8824_4926_8533_87aaf29fe099.slice/crio-8351c7055a094ae9e6d95d50a19f090cb3744fbf916f4d2eb47aa87b813451cf WatchSource:0}: Error finding container 8351c7055a094ae9e6d95d50a19f090cb3744fbf916f4d2eb47aa87b813451cf: Status 404 returned error can't find the container with id 8351c7055a094ae9e6d95d50a19f090cb3744fbf916f4d2eb47aa87b813451cf
Jul 03 20:42:17.916909 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:17.916888    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 20:42:18.370636 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.370599    2569 generic.go:356] "Generic (PLEG): container finished" podID="b99e93f6-8824-4926-8533-87aaf29fe099" containerID="222f5df1453c7563e8cd259e3721defd58aff5926b7ce6490b09525cf3789472" exitCode=0
Jul 03 20:42:18.371106 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.370644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerDied","Data":"222f5df1453c7563e8cd259e3721defd58aff5926b7ce6490b09525cf3789472"}
Jul 03 20:42:18.371106 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.370765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"8351c7055a094ae9e6d95d50a19f090cb3744fbf916f4d2eb47aa87b813451cf"}
Jul 03 20:42:18.374630 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.374536    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"207bc39632038f726e6981e5e1d918e047cd202330f6f46f4d52f7afba92c542"}
Jul 03 20:42:18.374630 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.374613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"85c55af33d906d387dfd9dc4870af590f1c5946813ca8261f02b1b4f7033847c"}
Jul 03 20:42:18.374787 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.374660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"c333936e4bc77f6656add58373f062fc8f5c3c80d3367b06acc2a30c30f8f4ce"}
Jul 03 20:42:18.374787 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.374699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"3574dfd045fb62c388ca58285f9840d2a2635cf34484420aa2e8896c9b205c32"}
Jul 03 20:42:18.376831 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.376805    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4" event={"ID":"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5","Type":"ContainerStarted","Data":"9686c154b4bb422b8876cb0d9b8bf51e129e33d859f28ea0e47f0186cea7d503"}
Jul 03 20:42:18.376934 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.376902    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4" event={"ID":"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5","Type":"ContainerStarted","Data":"f0552ef22ac2ed53403bdcaed1a0f2fbb369e987828d2d9ab71218cd88653a81"}
Jul 03 20:42:18.377013 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.376949    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4" event={"ID":"67efaf64-a2a3-406a-a2b7-c6e52e69e6e5","Type":"ContainerStarted","Data":"02bfef31ec94101561b8bf5c7089f79bb67d44e1f53edfac0a3d4c4b44bc9ce5"}
Jul 03 20:42:18.414390 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:18.414344    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5ffc97dc85-hmnn4" podStartSLOduration=2.252521785 podStartE2EDuration="4.414330533s" totalImagesPullingTime="2.161808748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:18.413128248 +0000 UTC m=+304.162134287" watchObservedRunningTime="2026-07-03 20:42:18.414330533 +0000 UTC m=+304.163336580"
Jul 03 20:42:19.390034 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:19.389902    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb4f113-1d5a-4e2f-97dd-885e1203704b","Type":"ContainerStarted","Data":"c54b8068bf153cbed61515d46449a18cd5bf95cfa3ef9463ed18f85471305ae5"}
Jul 03 20:42:19.412423 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:19.412354    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.771717538 podStartE2EDuration="9.412332352s" totalImagesPullingTime="4.620869206s" totalInitContainerRuntime="19.745608ms" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:19.41106241 +0000 UTC m=+305.160068450" watchObservedRunningTime="2026-07-03 20:42:19.412332352 +0000 UTC m=+305.161338392"
Jul 03 20:42:22.180825 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:22.180734    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:42:22.405085 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:22.405050    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"f941b394eba1920586c132dbbe00f867b9b1282b8effbdb1a63c33e05b924184"}
Jul 03 20:42:22.405245 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:22.405114    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"6883c65b0c4e7eadba078ce2b08a856af53fa66c7fa15f8dd2c27b85caf427aa"}
Jul 03 20:42:24.417369 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:24.417332    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"1805a849c6a9b4461b6ebddf419f823fcdcdede515a2cbb7778fc151e9168d89"}
Jul 03 20:42:24.417745 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:24.417419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"00ddffea97789a7bfbf222681f67752edf6ea6793ca021b618ba942c591135e6"}
Jul 03 20:42:24.417745 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:24.417464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"cf6e85350f021be54297909dd0d12c8135f464f29e3a3039113fe04df95d516e"}
Jul 03 20:42:24.417745 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:24.417508    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e93f6-8824-4926-8533-87aaf29fe099","Type":"ContainerStarted","Data":"9e470f4b6a8bfc018e759018d88ce2a551f4a35d759d208b3c86e149d3c9f303"}
Jul 03 20:42:24.442591 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:24.442541    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.23240292 podStartE2EDuration="9.442527103s" totalImagesPullingTime="5.184726263s" totalInitContainerRuntime="25.39792ms" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:24.44234558 +0000 UTC m=+310.191351618" watchObservedRunningTime="2026-07-03 20:42:24.442527103 +0000 UTC m=+310.191533140"
Jul 03 20:42:26.340073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:26.339997    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:42:26.426583 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:26.426550    2569 generic.go:356] "Generic (PLEG): container finished" podID="8eb0069d-4d2d-47a4-886d-a10c8e8f2a96" containerID="7bbc83306337dbc1902c832a28f74184e008c667929d11d108893b2881fef6c5" exitCode=0
Jul 03 20:42:26.426726 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:26.426626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq" event={"ID":"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96","Type":"ContainerDied","Data":"7bbc83306337dbc1902c832a28f74184e008c667929d11d108893b2881fef6c5"}
Jul 03 20:42:26.426972 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:26.426959    2569 scope.go:117] "RemoveContainer" containerID="7bbc83306337dbc1902c832a28f74184e008c667929d11d108893b2881fef6c5"
Jul 03 20:42:27.432124 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:27.432086    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bdkrq" event={"ID":"8eb0069d-4d2d-47a4-886d-a10c8e8f2a96","Type":"ContainerStarted","Data":"cb8a74f877aab6ed3413e8a9f1c3b06e75758902ee9869af4e78b85aecd4d1bc"}
Jul 03 20:42:30.272326 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:30.272292    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcbcbcc5b-jkrcl"]
Jul 03 20:42:34.445603 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:34.445569    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:34.446013 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:34.445708    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:54.450720 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:54.450692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:54.454490 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:54.454468    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9ffb795bc-jzks8"
Jul 03 20:42:55.295913 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.295869    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bcbcbcc5b-jkrcl" podUID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" containerName="console" containerID="cri-o://a9a3934832fd196f904cbc2c30eae25e8e43130f4888c8993d9b0ba145c3bb01" gracePeriod=15
Jul 03 20:42:55.540603 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.540579    2569 generic.go:356] "Generic (PLEG): container finished" podID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" containerID="a9a3934832fd196f904cbc2c30eae25e8e43130f4888c8993d9b0ba145c3bb01" exitCode=0
Jul 03 20:42:55.540913 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.540657    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcbcc5b-jkrcl" event={"ID":"cff7b085-9ad0-4b51-b070-d43afa3cc9de","Type":"ContainerDied","Data":"a9a3934832fd196f904cbc2c30eae25e8e43130f4888c8993d9b0ba145c3bb01"}
Jul 03 20:42:55.578755 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.578691    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:42:55.636404 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636369    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-service-ca\") pod \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") "
Jul 03 20:42:55.636552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636414    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-oauth-serving-cert\") pod \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") "
Jul 03 20:42:55.636552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636443    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-oauth-config\") pod \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") "
Jul 03 20:42:55.636552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636475    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-serving-cert\") pod \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") "
Jul 03 20:42:55.636552 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-config\") pod \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") "
Jul 03 20:42:55.636748 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636568    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctct8\" (UniqueName: \"kubernetes.io/projected/cff7b085-9ad0-4b51-b070-d43afa3cc9de-kube-api-access-ctct8\") pod \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\" (UID: \"cff7b085-9ad0-4b51-b070-d43afa3cc9de\") "
Jul 03 20:42:55.636802 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636754    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-service-ca" (OuterVolumeSpecName: "service-ca") pod "cff7b085-9ad0-4b51-b070-d43afa3cc9de" (UID: "cff7b085-9ad0-4b51-b070-d43afa3cc9de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 20:42:55.636955 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.636901    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cff7b085-9ad0-4b51-b070-d43afa3cc9de" (UID: "cff7b085-9ad0-4b51-b070-d43afa3cc9de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 20:42:55.637072 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.637014    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-config" (OuterVolumeSpecName: "console-config") pod "cff7b085-9ad0-4b51-b070-d43afa3cc9de" (UID: "cff7b085-9ad0-4b51-b070-d43afa3cc9de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 20:42:55.638699 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.638676    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff7b085-9ad0-4b51-b070-d43afa3cc9de-kube-api-access-ctct8" (OuterVolumeSpecName: "kube-api-access-ctct8") pod "cff7b085-9ad0-4b51-b070-d43afa3cc9de" (UID: "cff7b085-9ad0-4b51-b070-d43afa3cc9de"). InnerVolumeSpecName "kube-api-access-ctct8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 20:42:55.638765 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.638702    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cff7b085-9ad0-4b51-b070-d43afa3cc9de" (UID: "cff7b085-9ad0-4b51-b070-d43afa3cc9de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 20:42:55.638803 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.638762    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cff7b085-9ad0-4b51-b070-d43afa3cc9de" (UID: "cff7b085-9ad0-4b51-b070-d43afa3cc9de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 20:42:55.737506 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.737469    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-oauth-serving-cert\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:55.737506 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.737499    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-oauth-config\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:55.737506 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.737509    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-serving-cert\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:55.737727 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.737518    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-console-config\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:55.737727 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.737527    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctct8\" (UniqueName: \"kubernetes.io/projected/cff7b085-9ad0-4b51-b070-d43afa3cc9de-kube-api-access-ctct8\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:55.737727 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:55.737537    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cff7b085-9ad0-4b51-b070-d43afa3cc9de-service-ca\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:42:56.546765 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:56.546730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcbcc5b-jkrcl" event={"ID":"cff7b085-9ad0-4b51-b070-d43afa3cc9de","Type":"ContainerDied","Data":"b0ea1493b2dc95ffa63ad98cb56c73049fb68fe83118400060e44bf93a427823"}
Jul 03 20:42:56.546765 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:56.546754    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcbcc5b-jkrcl"
Jul 03 20:42:56.547271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:56.546792    2569 scope.go:117] "RemoveContainer" containerID="a9a3934832fd196f904cbc2c30eae25e8e43130f4888c8993d9b0ba145c3bb01"
Jul 03 20:42:56.566114 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:56.566087    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcbcbcc5b-jkrcl"]
Jul 03 20:42:56.569537 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:56.569513    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bcbcbcc5b-jkrcl"]
Jul 03 20:42:57.187656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:42:57.187617    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" path="/var/lib/kubelet/pods/cff7b085-9ad0-4b51-b070-d43afa3cc9de/volumes"
Jul 03 20:43:16.340235 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:16.340198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:43:16.355725 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:16.355696    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:43:16.650403 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:16.650330    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 20:43:28.613706 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:28.613659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:43:28.616011 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:28.615981    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9022ab2d-fd3c-4739-b911-d257554cca54-metrics-certs\") pod \"network-metrics-daemon-9sckp\" (UID: \"9022ab2d-fd3c-4739-b911-d257554cca54\") " pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:43:28.783579 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:28.783542    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4xwrm\""
Jul 03 20:43:28.792534 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:28.792509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9sckp"
Jul 03 20:43:28.915804 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:28.915780    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9sckp"]
Jul 03 20:43:28.918378 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:43:28.918352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9022ab2d_fd3c_4739_b911_d257554cca54.slice/crio-b458008e35baee3db591602bcc3999a22cd32ced771556ece7ba3a7d52400a6b WatchSource:0}: Error finding container b458008e35baee3db591602bcc3999a22cd32ced771556ece7ba3a7d52400a6b: Status 404 returned error can't find the container with id b458008e35baee3db591602bcc3999a22cd32ced771556ece7ba3a7d52400a6b
Jul 03 20:43:29.689995 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:29.689960    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9sckp" event={"ID":"9022ab2d-fd3c-4739-b911-d257554cca54","Type":"ContainerStarted","Data":"b458008e35baee3db591602bcc3999a22cd32ced771556ece7ba3a7d52400a6b"}
Jul 03 20:43:30.695382 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:30.695340    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9sckp" event={"ID":"9022ab2d-fd3c-4739-b911-d257554cca54","Type":"ContainerStarted","Data":"814ddfe902e6b912143171468668db90b197e5392341bb3949d87fca7f33d147"}
Jul 03 20:43:30.695763 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:30.695421    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9sckp" event={"ID":"9022ab2d-fd3c-4739-b911-d257554cca54","Type":"ContainerStarted","Data":"8b8368f4458adf05c16b3255dcc25ce11cddc23fa9101d26d5abb247e7690068"}
Jul 03 20:43:30.711013 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:43:30.710958    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9sckp" podStartSLOduration=374.813280948 podStartE2EDuration="6m15.710924021s" totalImagesPullingTime="897.643073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:43:30.709278829 +0000 UTC m=+376.458284868" watchObservedRunningTime="2026-07-03 20:43:30.710924021 +0000 UTC m=+376.459930059"
Jul 03 20:45:10.728562 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.728465    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"]
Jul 03 20:45:10.729143 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.728982    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" containerName="console"
Jul 03 20:45:10.729143 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.729001    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" containerName="console"
Jul 03 20:45:10.729143 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.729084    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff7b085-9ad0-4b51-b070-d43afa3cc9de" containerName="console"
Jul 03 20:45:10.731072 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.731051    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.735052 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.735032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 03 20:45:10.735180 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.735092    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 03 20:45:10.735522 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.735505    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 03 20:45:10.735583 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.735506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8vxtf\""
Jul 03 20:45:10.735641 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.735576    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 03 20:45:10.749390 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.749370    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"]
Jul 03 20:45:10.877841 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.877810    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34195223-3d7f-4d95-8456-087e5cafca3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.877841 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.877844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwj5k\" (UniqueName: \"kubernetes.io/projected/34195223-3d7f-4d95-8456-087e5cafca3a-kube-api-access-fwj5k\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.878083 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.877874    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34195223-3d7f-4d95-8456-087e5cafca3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.878083 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.878000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34195223-3d7f-4d95-8456-087e5cafca3a-manifests\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.878083 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.878037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34195223-3d7f-4d95-8456-087e5cafca3a-tmp\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.978737 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.978664    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34195223-3d7f-4d95-8456-087e5cafca3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.978737 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.978698    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwj5k\" (UniqueName: \"kubernetes.io/projected/34195223-3d7f-4d95-8456-087e5cafca3a-kube-api-access-fwj5k\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.978737 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.978721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34195223-3d7f-4d95-8456-087e5cafca3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.978929 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.978774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34195223-3d7f-4d95-8456-087e5cafca3a-manifests\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.978929 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.978801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34195223-3d7f-4d95-8456-087e5cafca3a-tmp\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.979307 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.979276    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34195223-3d7f-4d95-8456-087e5cafca3a-manifests\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.981047 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.981021    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34195223-3d7f-4d95-8456-087e5cafca3a-tmp\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.981310 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.981291    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34195223-3d7f-4d95-8456-087e5cafca3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.981522 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.981382    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34195223-3d7f-4d95-8456-087e5cafca3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:10.985787 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:10.985764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwj5k\" (UniqueName: \"kubernetes.io/projected/34195223-3d7f-4d95-8456-087e5cafca3a-kube-api-access-fwj5k\") pod \"opendatahub-operator-controller-manager-5448f4d7cf-kgrgv\" (UID: \"34195223-3d7f-4d95-8456-087e5cafca3a\") " pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:11.040744 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:11.040705    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:11.195488 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:11.195459    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"]
Jul 03 20:45:11.197050 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:45:11.197022    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34195223_3d7f_4d95_8456_087e5cafca3a.slice/crio-34d7fb1885fa3d575a14e24e183ac8641ed151e0bdd24487c70564983d352a18 WatchSource:0}: Error finding container 34d7fb1885fa3d575a14e24e183ac8641ed151e0bdd24487c70564983d352a18: Status 404 returned error can't find the container with id 34d7fb1885fa3d575a14e24e183ac8641ed151e0bdd24487c70564983d352a18
Jul 03 20:45:12.091578 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:12.091529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv" event={"ID":"34195223-3d7f-4d95-8456-087e5cafca3a","Type":"ContainerStarted","Data":"34d7fb1885fa3d575a14e24e183ac8641ed151e0bdd24487c70564983d352a18"}
Jul 03 20:45:15.105558 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:15.105519    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv" event={"ID":"34195223-3d7f-4d95-8456-087e5cafca3a","Type":"ContainerStarted","Data":"164ceeea47fe0422fe2fb10f19553b24f556dae5812508e3414c1ac92abc4355"}
Jul 03 20:45:16.111273 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:16.111236    2569 generic.go:356] "Generic (PLEG): container finished" podID="34195223-3d7f-4d95-8456-087e5cafca3a" containerID="164ceeea47fe0422fe2fb10f19553b24f556dae5812508e3414c1ac92abc4355" exitCode=0
Jul 03 20:45:16.111655 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:16.111325    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv" event={"ID":"34195223-3d7f-4d95-8456-087e5cafca3a","Type":"ContainerDied","Data":"164ceeea47fe0422fe2fb10f19553b24f556dae5812508e3414c1ac92abc4355"}
Jul 03 20:45:17.117429 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:17.117396    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv" event={"ID":"34195223-3d7f-4d95-8456-087e5cafca3a","Type":"ContainerStarted","Data":"21816e046680793240df26ef24551361e697e7d1a1bf7bb7b55d5004310c8f0f"}
Jul 03 20:45:17.117830 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:17.117516    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:17.136115 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:17.136069    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv" podStartSLOduration=2.875942619 podStartE2EDuration="7.136054802s" totalImagesPullingTime="3.21330537s" totalInitContainerRuntime="1.046806813s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:45:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:45:17.134788662 +0000 UTC m=+482.883794699" watchObservedRunningTime="2026-07-03 20:45:17.136054802 +0000 UTC m=+482.885060840"
Jul 03 20:45:28.124289 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.124252    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5448f4d7cf-kgrgv"
Jul 03 20:45:28.407182 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.407102    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"]
Jul 03 20:45:28.416522 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.416498    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.418615 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.418500    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 03 20:45:28.418756 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.418649    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 03 20:45:28.418886 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.418869    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 03 20:45:28.419058 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.419029    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 03 20:45:28.419155 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.419048    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-shghf\""
Jul 03 20:45:28.419155 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.419093    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 03 20:45:28.420505 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.420483    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"]
Jul 03 20:45:28.522762 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.522734    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9800b369-7d78-4ae0-b90b-7788655451ae-cert\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.522966 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.522778    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9800b369-7d78-4ae0-b90b-7788655451ae-manager-config\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.522966 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.522804    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9800b369-7d78-4ae0-b90b-7788655451ae-metrics-cert\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.522966 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.522823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8xr\" (UniqueName: \"kubernetes.io/projected/9800b369-7d78-4ae0-b90b-7788655451ae-kube-api-access-fr8xr\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.623912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.623878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9800b369-7d78-4ae0-b90b-7788655451ae-metrics-cert\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.623912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.623915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8xr\" (UniqueName: \"kubernetes.io/projected/9800b369-7d78-4ae0-b90b-7788655451ae-kube-api-access-fr8xr\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.624122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.624015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9800b369-7d78-4ae0-b90b-7788655451ae-cert\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.624122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.624057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9800b369-7d78-4ae0-b90b-7788655451ae-manager-config\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.624697 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.624675    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9800b369-7d78-4ae0-b90b-7788655451ae-manager-config\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.626434 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.626406    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9800b369-7d78-4ae0-b90b-7788655451ae-metrics-cert\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.626528 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.626447    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9800b369-7d78-4ae0-b90b-7788655451ae-cert\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.631549 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.631524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8xr\" (UniqueName: \"kubernetes.io/projected/9800b369-7d78-4ae0-b90b-7788655451ae-kube-api-access-fr8xr\") pod \"lws-controller-manager-66c99c87c9-ncwmk\" (UID: \"9800b369-7d78-4ae0-b90b-7788655451ae\") " pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.726995 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.726877    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:28.847979 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:28.847932    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"]
Jul 03 20:45:28.850823 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:45:28.850792    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9800b369_7d78_4ae0_b90b_7788655451ae.slice/crio-b08cca082cc79940bc366c7300bdb5a95e39ac0989220f72c4f8948c718b3392 WatchSource:0}: Error finding container b08cca082cc79940bc366c7300bdb5a95e39ac0989220f72c4f8948c718b3392: Status 404 returned error can't find the container with id b08cca082cc79940bc366c7300bdb5a95e39ac0989220f72c4f8948c718b3392
Jul 03 20:45:29.172013 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:29.171975    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk" event={"ID":"9800b369-7d78-4ae0-b90b-7788655451ae","Type":"ContainerStarted","Data":"b08cca082cc79940bc366c7300bdb5a95e39ac0989220f72c4f8948c718b3392"}
Jul 03 20:45:31.849487 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.849462    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"]
Jul 03 20:45:31.853869 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.853847    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:31.856007 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.855988    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 03 20:45:31.856122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.856016    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r2b6w\""
Jul 03 20:45:31.856122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.856016    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 03 20:45:31.861286 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.861165    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"]
Jul 03 20:45:31.956654 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.956623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-tls-certs\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:31.956825 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.956674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-tmp\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:31.956825 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:31.956702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnhkl\" (UniqueName: \"kubernetes.io/projected/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-kube-api-access-tnhkl\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.057237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.057162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-tls-certs\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.057237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.057211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-tmp\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.057237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.057236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnhkl\" (UniqueName: \"kubernetes.io/projected/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-kube-api-access-tnhkl\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.059595 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.059560    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-tmp\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.059711 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.059666    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-tls-certs\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.064065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.064041    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnhkl\" (UniqueName: \"kubernetes.io/projected/c9e63bba-7dd9-4768-a07e-ad80ffa8093d-kube-api-access-tnhkl\") pod \"kube-auth-proxy-57dff55469-cqbsg\" (UID: \"c9e63bba-7dd9-4768-a07e-ad80ffa8093d\") " pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.165050 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.165006    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"
Jul 03 20:45:32.193889 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.193859    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk" event={"ID":"9800b369-7d78-4ae0-b90b-7788655451ae","Type":"ContainerStarted","Data":"5f100e9ef00ac00a10417fb978ddc46f535fddc5019ae47d77e60bebb2b70827"}
Jul 03 20:45:32.194063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.193982    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:45:32.210640 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.210592    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk" podStartSLOduration=1.283313473 podStartE2EDuration="4.210574401s" totalImagesPullingTime="2.927260928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:45:32.208977072 +0000 UTC m=+497.957983112" watchObservedRunningTime="2026-07-03 20:45:32.210574401 +0000 UTC m=+497.959580440"
Jul 03 20:45:32.297382 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:32.297357    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dff55469-cqbsg"]
Jul 03 20:45:32.299346 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:45:32.299317    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e63bba_7dd9_4768_a07e_ad80ffa8093d.slice/crio-81e78a567040232d05c8f47d2e43114f83bcc8cf3774f0b000d3da285a759f42 WatchSource:0}: Error finding container 81e78a567040232d05c8f47d2e43114f83bcc8cf3774f0b000d3da285a759f42: Status 404 returned error can't find the container with id 81e78a567040232d05c8f47d2e43114f83bcc8cf3774f0b000d3da285a759f42
Jul 03 20:45:33.200547 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:33.200473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg" event={"ID":"c9e63bba-7dd9-4768-a07e-ad80ffa8093d","Type":"ContainerStarted","Data":"81e78a567040232d05c8f47d2e43114f83bcc8cf3774f0b000d3da285a759f42"}
Jul 03 20:45:35.211986 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:35.211871    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg" event={"ID":"c9e63bba-7dd9-4768-a07e-ad80ffa8093d","Type":"ContainerStarted","Data":"8601e75159d234935b85c2cb74a4b80ce8518040cddd4e9990fcf6c8df08b1bf"}
Jul 03 20:45:35.227912 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:35.227858    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57dff55469-cqbsg" podStartSLOduration=1.681025714 podStartE2EDuration="4.227838467s" totalImagesPullingTime="2.546812753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:45:35.226773633 +0000 UTC m=+500.975779672" watchObservedRunningTime="2026-07-03 20:45:35.227838467 +0000 UTC m=+500.976844505"
Jul 03 20:45:43.202602 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:45:43.202572    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66c99c87c9-ncwmk"
Jul 03 20:47:14.686320 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:14.686288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:47:14.686879 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:14.686562    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:47:20.548575 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.548540    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f8bd6b4b-jjkjp"]
Jul 03 20:47:20.550703 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.550687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.553187 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.553164    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 03 20:47:20.553417 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.553394    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 03 20:47:20.553905 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.553480    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 03 20:47:20.554228 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.554206    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 03 20:47:20.554385 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.554368    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 03 20:47:20.554545 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.554385    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 03 20:47:20.554648 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.554473    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 03 20:47:20.554877 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.554860    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7f7z7\""
Jul 03 20:47:20.559452 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.559434    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 03 20:47:20.563750 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.563728    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8bd6b4b-jjkjp"]
Jul 03 20:47:20.708037 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-oauth-serving-cert\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.708037 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-service-ca\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.708237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-trusted-ca-bundle\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.708237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-serving-cert\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.708237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdlk\" (UniqueName: \"kubernetes.io/projected/520c7e8d-2b97-48cd-8b89-72f161b8a61b-kube-api-access-tqdlk\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.708237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-config\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.708237 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.708151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-oauth-config\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809310 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-serving-cert\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809310 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdlk\" (UniqueName: \"kubernetes.io/projected/520c7e8d-2b97-48cd-8b89-72f161b8a61b-kube-api-access-tqdlk\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809310 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-config\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-oauth-config\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-oauth-serving-cert\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809456    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-service-ca\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.809656 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.809496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-trusted-ca-bundle\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.810176 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.810148    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-oauth-serving-cert\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.810304 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.810176    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-config\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.810304 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.810284    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-service-ca\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.810443 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.810425    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520c7e8d-2b97-48cd-8b89-72f161b8a61b-trusted-ca-bundle\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.811861 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.811841    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-serving-cert\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.811970 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.811870    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520c7e8d-2b97-48cd-8b89-72f161b8a61b-console-oauth-config\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.816641 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.816622    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdlk\" (UniqueName: \"kubernetes.io/projected/520c7e8d-2b97-48cd-8b89-72f161b8a61b-kube-api-access-tqdlk\") pod \"console-86f8bd6b4b-jjkjp\" (UID: \"520c7e8d-2b97-48cd-8b89-72f161b8a61b\") " pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:20.862276 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:20.862241    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:21.009024 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:21.009000    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8bd6b4b-jjkjp"]
Jul 03 20:47:21.011138 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:47:21.011101    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520c7e8d_2b97_48cd_8b89_72f161b8a61b.slice/crio-5fa19307afdae53c19db0bfbcf3948a7627241a6d6cd12ef77283edfc7c159a3 WatchSource:0}: Error finding container 5fa19307afdae53c19db0bfbcf3948a7627241a6d6cd12ef77283edfc7c159a3: Status 404 returned error can't find the container with id 5fa19307afdae53c19db0bfbcf3948a7627241a6d6cd12ef77283edfc7c159a3
Jul 03 20:47:21.677165 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:21.677123    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8bd6b4b-jjkjp" event={"ID":"520c7e8d-2b97-48cd-8b89-72f161b8a61b","Type":"ContainerStarted","Data":"79ee3d569176226f5583753fa1605fff774cf1e9c2a450b7483a44fe55c185a4"}
Jul 03 20:47:21.677541 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:21.677174    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8bd6b4b-jjkjp" event={"ID":"520c7e8d-2b97-48cd-8b89-72f161b8a61b","Type":"ContainerStarted","Data":"5fa19307afdae53c19db0bfbcf3948a7627241a6d6cd12ef77283edfc7c159a3"}
Jul 03 20:47:21.693374 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:21.693305    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f8bd6b4b-jjkjp" podStartSLOduration=1.693285782 podStartE2EDuration="1.693285782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:47:21.692426519 +0000 UTC m=+607.441432557" watchObservedRunningTime="2026-07-03 20:47:21.693285782 +0000 UTC m=+607.442291820"
Jul 03 20:47:24.084347 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.084316    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"]
Jul 03 20:47:24.086709 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.086694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.088621 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.088596    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 03 20:47:24.089114 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.089096    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 03 20:47:24.089210 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.089180    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c9dnh\""
Jul 03 20:47:24.089210 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.089196    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 03 20:47:24.089210 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.089180    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 03 20:47:24.093804 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.093780    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"]
Jul 03 20:47:24.240265 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.240227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/687c8507-2369-4f60-9bc5-180ff8bf6955-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.240431 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.240277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/687c8507-2369-4f60-9bc5-180ff8bf6955-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.240431 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.240336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56x54\" (UniqueName: \"kubernetes.io/projected/687c8507-2369-4f60-9bc5-180ff8bf6955-kube-api-access-56x54\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.341123 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.341029    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/687c8507-2369-4f60-9bc5-180ff8bf6955-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.341123 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.341075    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/687c8507-2369-4f60-9bc5-180ff8bf6955-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.341366 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.341252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56x54\" (UniqueName: \"kubernetes.io/projected/687c8507-2369-4f60-9bc5-180ff8bf6955-kube-api-access-56x54\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.341658 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.341635    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/687c8507-2369-4f60-9bc5-180ff8bf6955-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.343555 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.343528    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/687c8507-2369-4f60-9bc5-180ff8bf6955-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.372592 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.372573    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56x54\" (UniqueName: \"kubernetes.io/projected/687c8507-2369-4f60-9bc5-180ff8bf6955-kube-api-access-56x54\") pod \"kuadrant-console-plugin-66b5774985-ltdzb\" (UID: \"687c8507-2369-4f60-9bc5-180ff8bf6955\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.397476 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.397456    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"
Jul 03 20:47:24.524641 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.524618    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb"]
Jul 03 20:47:24.526755 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:47:24.526727    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod687c8507_2369_4f60_9bc5_180ff8bf6955.slice/crio-2afdc581d2827c117fd817bb8d0942e72d3f288e373908a7138a41d1cfc22b68 WatchSource:0}: Error finding container 2afdc581d2827c117fd817bb8d0942e72d3f288e373908a7138a41d1cfc22b68: Status 404 returned error can't find the container with id 2afdc581d2827c117fd817bb8d0942e72d3f288e373908a7138a41d1cfc22b68
Jul 03 20:47:24.528564 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.528547    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 20:47:24.691699 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:24.691618    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb" event={"ID":"687c8507-2369-4f60-9bc5-180ff8bf6955","Type":"ContainerStarted","Data":"2afdc581d2827c117fd817bb8d0942e72d3f288e373908a7138a41d1cfc22b68"}
Jul 03 20:47:30.862763 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:30.862724    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:30.863239 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:30.862796    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:30.868975 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:30.868929    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:31.734784 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:31.734749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f8bd6b4b-jjkjp"
Jul 03 20:47:33.988447 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:33.988408    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"]
Jul 03 20:47:33.998457 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:33.998430    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.001092 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.001071    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tc8gn\""
Jul 03 20:47:34.016594 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.016570    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"]
Jul 03 20:47:34.134223 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.134186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jzhn\" (UniqueName: \"kubernetes.io/projected/20008cba-b7d7-4f6d-8c42-da49ed32387b-kube-api-access-4jzhn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.134421 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.134357    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20008cba-b7d7-4f6d-8c42-da49ed32387b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.235900 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.235710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20008cba-b7d7-4f6d-8c42-da49ed32387b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.235900 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.235762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jzhn\" (UniqueName: \"kubernetes.io/projected/20008cba-b7d7-4f6d-8c42-da49ed32387b-kube-api-access-4jzhn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.236157 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.236104    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20008cba-b7d7-4f6d-8c42-da49ed32387b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.243563 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.243502    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jzhn\" (UniqueName: \"kubernetes.io/projected/20008cba-b7d7-4f6d-8c42-da49ed32387b-kube-api-access-4jzhn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.310063 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.310026    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:34.640011 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.639907    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"]
Jul 03 20:47:34.643161 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:34.643129    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"]
Jul 03 20:47:46.804579 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:46.804546    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb" event={"ID":"687c8507-2369-4f60-9bc5-180ff8bf6955","Type":"ContainerStarted","Data":"3d691a6a55408ccfebf917072d4298e31de23badb58a936ba8cd263f9e24c68c"}
Jul 03 20:47:46.819246 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:46.819204    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ltdzb" podStartSLOduration=0.674876761 podStartE2EDuration="22.819187975s" totalImagesPullingTime="22.144311214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:47:46.818225673 +0000 UTC m=+632.567231712" watchObservedRunningTime="2026-07-03 20:47:46.819187975 +0000 UTC m=+632.568194012"
Jul 03 20:47:49.133424 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:47:49.133380    2569 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-v5krt_kuadrant-system_20008cba-b7d7-4f6d-8c42-da49ed32387b_0(a96ec045691dc0d723e68fc9691378300ffd1d514a5945daeb01b18933783c1f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-v5krt to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 03 20:47:49.133734 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:47:49.133452    2569 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-v5krt_kuadrant-system_20008cba-b7d7-4f6d-8c42-da49ed32387b_0(a96ec045691dc0d723e68fc9691378300ffd1d514a5945daeb01b18933783c1f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-v5krt to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:49.818403 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.818370    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:49.820085 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:47:49.820053    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="20008cba-b7d7-4f6d-8c42-da49ed32387b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:49.826466 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.826444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:49.827977 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:47:49.827952    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="20008cba-b7d7-4f6d-8c42-da49ed32387b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:49.885509 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.885475    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20008cba-b7d7-4f6d-8c42-da49ed32387b-extensions-socket-volume\") pod \"20008cba-b7d7-4f6d-8c42-da49ed32387b\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") "
Jul 03 20:47:49.885664 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.885573    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jzhn\" (UniqueName: \"kubernetes.io/projected/20008cba-b7d7-4f6d-8c42-da49ed32387b-kube-api-access-4jzhn\") pod \"20008cba-b7d7-4f6d-8c42-da49ed32387b\" (UID: \"20008cba-b7d7-4f6d-8c42-da49ed32387b\") "
Jul 03 20:47:49.885758 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.885732    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20008cba-b7d7-4f6d-8c42-da49ed32387b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20008cba-b7d7-4f6d-8c42-da49ed32387b" (UID: "20008cba-b7d7-4f6d-8c42-da49ed32387b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 20:47:49.887635 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.887603    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20008cba-b7d7-4f6d-8c42-da49ed32387b-kube-api-access-4jzhn" (OuterVolumeSpecName: "kube-api-access-4jzhn") pod "20008cba-b7d7-4f6d-8c42-da49ed32387b" (UID: "20008cba-b7d7-4f6d-8c42-da49ed32387b"). InnerVolumeSpecName "kube-api-access-4jzhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 20:47:49.986667 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.986629    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jzhn\" (UniqueName: \"kubernetes.io/projected/20008cba-b7d7-4f6d-8c42-da49ed32387b-kube-api-access-4jzhn\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:47:49.986667 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:49.986660    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20008cba-b7d7-4f6d-8c42-da49ed32387b-extensions-socket-volume\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:47:50.822359 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:50.822325    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:50.824207 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:47:50.824177    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="20008cba-b7d7-4f6d-8c42-da49ed32387b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:50.829526 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:47:50.829491    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-v5krt\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="20008cba-b7d7-4f6d-8c42-da49ed32387b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5krt"
Jul 03 20:47:51.187199 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:47:51.187113    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20008cba-b7d7-4f6d-8c42-da49ed32387b" path="/var/lib/kubelet/pods/20008cba-b7d7-4f6d-8c42-da49ed32387b/volumes"
Jul 03 20:48:13.227077 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.227045    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:48:13.284227 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.284192    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:48:13.284227 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.284234    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:48:13.284416 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.284304    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.286400 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.286376    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 03 20:48:13.394149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.394114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d75f6e9-1209-4db8-a192-8dcd0631ca9a-config-file\") pod \"limitador-limitador-54d6d988d5-z2fpj\" (UID: \"9d75f6e9-1209-4db8-a192-8dcd0631ca9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.394149 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.394150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trs4f\" (UniqueName: \"kubernetes.io/projected/9d75f6e9-1209-4db8-a192-8dcd0631ca9a-kube-api-access-trs4f\") pod \"limitador-limitador-54d6d988d5-z2fpj\" (UID: \"9d75f6e9-1209-4db8-a192-8dcd0631ca9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.495498 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.495468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d75f6e9-1209-4db8-a192-8dcd0631ca9a-config-file\") pod \"limitador-limitador-54d6d988d5-z2fpj\" (UID: \"9d75f6e9-1209-4db8-a192-8dcd0631ca9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.495661 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.495505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trs4f\" (UniqueName: \"kubernetes.io/projected/9d75f6e9-1209-4db8-a192-8dcd0631ca9a-kube-api-access-trs4f\") pod \"limitador-limitador-54d6d988d5-z2fpj\" (UID: \"9d75f6e9-1209-4db8-a192-8dcd0631ca9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.496155 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.496136    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d75f6e9-1209-4db8-a192-8dcd0631ca9a-config-file\") pod \"limitador-limitador-54d6d988d5-z2fpj\" (UID: \"9d75f6e9-1209-4db8-a192-8dcd0631ca9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.502889 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.502865    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trs4f\" (UniqueName: \"kubernetes.io/projected/9d75f6e9-1209-4db8-a192-8dcd0631ca9a-kube-api-access-trs4f\") pod \"limitador-limitador-54d6d988d5-z2fpj\" (UID: \"9d75f6e9-1209-4db8-a192-8dcd0631ca9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.594077 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.594045    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:13.720327 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.720299    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:48:13.722987 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:48:13.722952    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d75f6e9_1209_4db8_a192_8dcd0631ca9a.slice/crio-c67f4a0b5d24f5d7a500969a494cc3072ec050a89f12fa04c6ecefad374402b1 WatchSource:0}: Error finding container c67f4a0b5d24f5d7a500969a494cc3072ec050a89f12fa04c6ecefad374402b1: Status 404 returned error can't find the container with id c67f4a0b5d24f5d7a500969a494cc3072ec050a89f12fa04c6ecefad374402b1
Jul 03 20:48:13.826819 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.826739    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xzncq"]
Jul 03 20:48:13.831483 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.831467    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:13.833345 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.833325    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m5gtv\""
Jul 03 20:48:13.835993 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.835970    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xzncq"]
Jul 03 20:48:13.923229 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:13.923188    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj" event={"ID":"9d75f6e9-1209-4db8-a192-8dcd0631ca9a","Type":"ContainerStarted","Data":"c67f4a0b5d24f5d7a500969a494cc3072ec050a89f12fa04c6ecefad374402b1"}
Jul 03 20:48:14.000773 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:14.000737    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqwgv\" (UniqueName: \"kubernetes.io/projected/6ba94224-a1de-41b9-a2aa-70c000546deb-kube-api-access-hqwgv\") pod \"authorino-75d556bd77-xzncq\" (UID: \"6ba94224-a1de-41b9-a2aa-70c000546deb\") " pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:14.101488 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:14.101353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqwgv\" (UniqueName: \"kubernetes.io/projected/6ba94224-a1de-41b9-a2aa-70c000546deb-kube-api-access-hqwgv\") pod \"authorino-75d556bd77-xzncq\" (UID: \"6ba94224-a1de-41b9-a2aa-70c000546deb\") " pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:14.108919 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:14.108892    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqwgv\" (UniqueName: \"kubernetes.io/projected/6ba94224-a1de-41b9-a2aa-70c000546deb-kube-api-access-hqwgv\") pod \"authorino-75d556bd77-xzncq\" (UID: \"6ba94224-a1de-41b9-a2aa-70c000546deb\") " pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:14.141376 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:14.141346    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:14.302636 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:14.301986    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xzncq"]
Jul 03 20:48:14.313299 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:48:14.313266    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ba94224_a1de_41b9_a2aa_70c000546deb.slice/crio-b77dfc9fd583aa77d9c3d6c379d04558831f5e88c258da8778db748af47c1e1f WatchSource:0}: Error finding container b77dfc9fd583aa77d9c3d6c379d04558831f5e88c258da8778db748af47c1e1f: Status 404 returned error can't find the container with id b77dfc9fd583aa77d9c3d6c379d04558831f5e88c258da8778db748af47c1e1f
Jul 03 20:48:14.931779 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:14.931704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xzncq" event={"ID":"6ba94224-a1de-41b9-a2aa-70c000546deb","Type":"ContainerStarted","Data":"b77dfc9fd583aa77d9c3d6c379d04558831f5e88c258da8778db748af47c1e1f"}
Jul 03 20:48:18.956159 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:18.956061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xzncq" event={"ID":"6ba94224-a1de-41b9-a2aa-70c000546deb","Type":"ContainerStarted","Data":"787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80"}
Jul 03 20:48:18.957487 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:18.957462    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj" event={"ID":"9d75f6e9-1209-4db8-a192-8dcd0631ca9a","Type":"ContainerStarted","Data":"ada9ae27db1abc8487cc60f19ccff13737bcf35a30d8d4ae8b7760b49ac85b83"}
Jul 03 20:48:18.957617 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:18.957598    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:18.971437 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:18.971391    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xzncq" podStartSLOduration=1.762781537 podStartE2EDuration="5.971377539s" totalImagesPullingTime="4.208596002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:48:18.969581298 +0000 UTC m=+664.718587337" watchObservedRunningTime="2026-07-03 20:48:18.971377539 +0000 UTC m=+664.720383576"
Jul 03 20:48:18.986130 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:18.986075    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj" podStartSLOduration=1.182632374 podStartE2EDuration="5.986058826s" totalImagesPullingTime="4.803426452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:48:18.983347215 +0000 UTC m=+664.732353255" watchObservedRunningTime="2026-07-03 20:48:18.986058826 +0000 UTC m=+664.735064865"
Jul 03 20:48:29.963470 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:29.963440    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"
Jul 03 20:48:46.483022 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:46.482978    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xzncq"]
Jul 03 20:48:46.483396 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:46.483192    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xzncq" podUID="6ba94224-a1de-41b9-a2aa-70c000546deb" containerName="authorino" containerID="cri-o://787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80" gracePeriod=30
Jul 03 20:48:46.729358 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:46.729334    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:46.792122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:46.792090    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqwgv\" (UniqueName: \"kubernetes.io/projected/6ba94224-a1de-41b9-a2aa-70c000546deb-kube-api-access-hqwgv\") pod \"6ba94224-a1de-41b9-a2aa-70c000546deb\" (UID: \"6ba94224-a1de-41b9-a2aa-70c000546deb\") "
Jul 03 20:48:46.794073 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:46.794048    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba94224-a1de-41b9-a2aa-70c000546deb-kube-api-access-hqwgv" (OuterVolumeSpecName: "kube-api-access-hqwgv") pod "6ba94224-a1de-41b9-a2aa-70c000546deb" (UID: "6ba94224-a1de-41b9-a2aa-70c000546deb"). InnerVolumeSpecName "kube-api-access-hqwgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 20:48:46.893476 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:46.893452    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqwgv\" (UniqueName: \"kubernetes.io/projected/6ba94224-a1de-41b9-a2aa-70c000546deb-kube-api-access-hqwgv\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 20:48:47.083122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.083043    2569 generic.go:356] "Generic (PLEG): container finished" podID="6ba94224-a1de-41b9-a2aa-70c000546deb" containerID="787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80" exitCode=0
Jul 03 20:48:47.083122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.083084    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xzncq"
Jul 03 20:48:47.083294 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.083120    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xzncq" event={"ID":"6ba94224-a1de-41b9-a2aa-70c000546deb","Type":"ContainerDied","Data":"787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80"}
Jul 03 20:48:47.083294 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.083161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xzncq" event={"ID":"6ba94224-a1de-41b9-a2aa-70c000546deb","Type":"ContainerDied","Data":"b77dfc9fd583aa77d9c3d6c379d04558831f5e88c258da8778db748af47c1e1f"}
Jul 03 20:48:47.083294 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.083178    2569 scope.go:117] "RemoveContainer" containerID="787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80"
Jul 03 20:48:47.092613 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.092594    2569 scope.go:117] "RemoveContainer" containerID="787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80"
Jul 03 20:48:47.092853 ip-10-0-128-87 kubenswrapper[2569]: E0703 20:48:47.092836    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80\": container with ID starting with 787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80 not found: ID does not exist" containerID="787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80"
Jul 03 20:48:47.092922 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.092860    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80"} err="failed to get container status \"787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80\": rpc error: code = NotFound desc = could not find container \"787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80\": container with ID starting with 787a216380d9c40c6b023d9ee6feff26d0184cf72fb4d0b69f596f8696c4ee80 not found: ID does not exist"
Jul 03 20:48:47.102336 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.102313    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xzncq"]
Jul 03 20:48:47.108474 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.108452    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xzncq"]
Jul 03 20:48:47.186567 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:48:47.186535    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba94224-a1de-41b9-a2aa-70c000546deb" path="/var/lib/kubelet/pods/6ba94224-a1de-41b9-a2aa-70c000546deb/volumes"
Jul 03 20:49:26.150135 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:49:26.150095    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:49:53.057494 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:49:53.057455    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:50:07.359868 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.359833    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"]
Jul 03 20:50:07.360254 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.360237    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba94224-a1de-41b9-a2aa-70c000546deb" containerName="authorino"
Jul 03 20:50:07.360254 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.360249    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba94224-a1de-41b9-a2aa-70c000546deb" containerName="authorino"
Jul 03 20:50:07.360332 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.360300    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba94224-a1de-41b9-a2aa-70c000546deb" containerName="authorino"
Jul 03 20:50:07.363500 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.363477    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.365920 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.365898    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 03 20:50:07.365920 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.365909    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 03 20:50:07.366119 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.365923    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 03 20:50:07.366119 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.365902    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qjt4q\""
Jul 03 20:50:07.371373 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.371349    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"]
Jul 03 20:50:07.399384 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.399361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.399518 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.399396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.399518 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.399426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.399518 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.399443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.399689 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.399531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.399689 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.399626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk6l8\" (UniqueName: \"kubernetes.io/projected/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-kube-api-access-lk6l8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.500826 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.500790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501040 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.500832    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501040 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.500870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501040 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.500960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6l8\" (UniqueName: \"kubernetes.io/projected/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-kube-api-access-lk6l8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501040 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.501003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501254 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.501048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501316 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.501260    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501373 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.501307    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.501501 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.501482    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.503092 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.503072    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.503258 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.503241    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.507727 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.507705    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk6l8\" (UniqueName: \"kubernetes.io/projected/2be05ec5-5dd4-47ae-8ab3-2ff6551eed78-kube-api-access-lk6l8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hb98r\" (UID: \"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.674375 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.674286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:07.803092 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:07.803067    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"]
Jul 03 20:50:07.805047 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:50:07.805019    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be05ec5_5dd4_47ae_8ab3_2ff6551eed78.slice/crio-14ca890f11034ac902df041d9b4a7f348512763a18b1b0b6238ad67945200498 WatchSource:0}: Error finding container 14ca890f11034ac902df041d9b4a7f348512763a18b1b0b6238ad67945200498: Status 404 returned error can't find the container with id 14ca890f11034ac902df041d9b4a7f348512763a18b1b0b6238ad67945200498
Jul 03 20:50:08.150498 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:08.150462    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:50:08.460151 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:08.460071    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r" event={"ID":"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78","Type":"ContainerStarted","Data":"14ca890f11034ac902df041d9b4a7f348512763a18b1b0b6238ad67945200498"}
Jul 03 20:50:09.465492 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:09.465448    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r" event={"ID":"2be05ec5-5dd4-47ae-8ab3-2ff6551eed78","Type":"ContainerStarted","Data":"fe8250fbcd79dd1bcff2e7f0b4bf044e8beeb184bf27d393463c568a2ba397ae"}
Jul 03 20:50:09.482873 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:09.482819    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r" podStartSLOduration=1.404819204 podStartE2EDuration="2.482799576s" totalImagesPullingTime="1.077980372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:50:09.482318523 +0000 UTC m=+775.231324561" watchObservedRunningTime="2026-07-03 20:50:09.482799576 +0000 UTC m=+775.231805615"
Jul 03 20:50:16.762039 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:16.762004    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:50:17.674547 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:17.674511    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:17.674694 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:17.674577    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:17.686874 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:17.686848    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:18.521721 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:18.521689    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hb98r"
Jul 03 20:50:23.263195 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.263162    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"]
Jul 03 20:50:23.266831 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.266808    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.269145 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.269121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 03 20:50:23.277396 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.277367    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"]
Jul 03 20:50:23.349317 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.349286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14b05e0-665e-4efd-858d-5cbe7e227746-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.349469 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.349330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.349469 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.349357    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.349469 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.349450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.349572 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.349479    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.349572 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.349512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dh6j\" (UniqueName: \"kubernetes.io/projected/b14b05e0-665e-4efd-858d-5cbe7e227746-kube-api-access-2dh6j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.450599 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.450553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14b05e0-665e-4efd-858d-5cbe7e227746-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.450599 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.450611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.450854 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.450640    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.450854 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.450671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.450854 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.450692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.450854 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.450713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dh6j\" (UniqueName: \"kubernetes.io/projected/b14b05e0-665e-4efd-858d-5cbe7e227746-kube-api-access-2dh6j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.451118 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.451069    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.451118 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.451109    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.451207 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.451128    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.452908 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.452883    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14b05e0-665e-4efd-858d-5cbe7e227746-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.453126 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.453108    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14b05e0-665e-4efd-858d-5cbe7e227746-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.458163 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.458138    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dh6j\" (UniqueName: \"kubernetes.io/projected/b14b05e0-665e-4efd-858d-5cbe7e227746-kube-api-access-2dh6j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb\" (UID: \"b14b05e0-665e-4efd-858d-5cbe7e227746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.579293 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.579219    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:23.706554 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:23.706530    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"]
Jul 03 20:50:23.708782 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:50:23.708754    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14b05e0_665e_4efd_858d_5cbe7e227746.slice/crio-1ed9e42d33642e0dff37f266a4b0e339dd1837965d3ab509b80b626b90cdafca WatchSource:0}: Error finding container 1ed9e42d33642e0dff37f266a4b0e339dd1837965d3ab509b80b626b90cdafca: Status 404 returned error can't find the container with id 1ed9e42d33642e0dff37f266a4b0e339dd1837965d3ab509b80b626b90cdafca
Jul 03 20:50:24.539101 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:24.539060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb" event={"ID":"b14b05e0-665e-4efd-858d-5cbe7e227746","Type":"ContainerStarted","Data":"17d050dfe7f278b7e53e82f413818de48980e131ffb2a5dbfe15899d5d5fee8a"}
Jul 03 20:50:24.539509 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:24.539112    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb" event={"ID":"b14b05e0-665e-4efd-858d-5cbe7e227746","Type":"ContainerStarted","Data":"1ed9e42d33642e0dff37f266a4b0e339dd1837965d3ab509b80b626b90cdafca"}
Jul 03 20:50:24.554611 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:24.554562    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb" podStartSLOduration=1.369740918 podStartE2EDuration="1.554549176s" totalImagesPullingTime="184.808258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:50:24.5537952 +0000 UTC m=+790.302801238" watchObservedRunningTime="2026-07-03 20:50:24.554549176 +0000 UTC m=+790.303555193"
Jul 03 20:50:24.851150 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:24.851063    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:50:33.580156 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:33.580125    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:33.580641 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:33.580190    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:33.592413 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:33.592389    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:34.594759 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:34.594729    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb"
Jul 03 20:50:49.256543 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:49.256465    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:50:52.549804 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.549763    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"]
Jul 03 20:50:52.553538 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.553514    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.555595 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.555576    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 03 20:50:52.561409 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.561389    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"]
Jul 03 20:50:52.596920 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.596890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.597070 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.596925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.597070 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.597036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.597160 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.597080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26clt\" (UniqueName: \"kubernetes.io/projected/5d51f25d-9a66-40e9-a34d-787491ae22d5-kube-api-access-26clt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.597160 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.597107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d51f25d-9a66-40e9-a34d-787491ae22d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.597160 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.597157    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698109 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698271 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698267    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26clt\" (UniqueName: \"kubernetes.io/projected/5d51f25d-9a66-40e9-a34d-787491ae22d5-kube-api-access-26clt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698491 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d51f25d-9a66-40e9-a34d-787491ae22d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698548 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698528    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698607 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.698774 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.698750    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.700424 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.700404    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d51f25d-9a66-40e9-a34d-787491ae22d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.700681 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.700663    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d51f25d-9a66-40e9-a34d-787491ae22d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.705635 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.705613    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26clt\" (UniqueName: \"kubernetes.io/projected/5d51f25d-9a66-40e9-a34d-787491ae22d5-kube-api-access-26clt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f\" (UID: \"5d51f25d-9a66-40e9-a34d-787491ae22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:52.865202 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:52.865118    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:50:53.000045 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:53.000020    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"]
Jul 03 20:50:53.002015 ip-10-0-128-87 kubenswrapper[2569]: W0703 20:50:53.001984    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d51f25d_9a66_40e9_a34d_787491ae22d5.slice/crio-f17d235709a098ada473b1fa7a0d087a5bba05e44d692d1d8a4008be17fedc6f WatchSource:0}: Error finding container f17d235709a098ada473b1fa7a0d087a5bba05e44d692d1d8a4008be17fedc6f: Status 404 returned error can't find the container with id f17d235709a098ada473b1fa7a0d087a5bba05e44d692d1d8a4008be17fedc6f
Jul 03 20:50:53.670426 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:53.670386    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f" event={"ID":"5d51f25d-9a66-40e9-a34d-787491ae22d5","Type":"ContainerStarted","Data":"8b066909db24b05d37de797b9f79e4a5acbce71f1ec25f153cc9b734ce2c6cfa"}
Jul 03 20:50:53.670426 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:53.670433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f" event={"ID":"5d51f25d-9a66-40e9-a34d-787491ae22d5","Type":"ContainerStarted","Data":"f17d235709a098ada473b1fa7a0d087a5bba05e44d692d1d8a4008be17fedc6f"}
Jul 03 20:50:53.684781 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:50:53.684716    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f" podStartSLOduration=1.5200347669999998 podStartE2EDuration="1.68470108s" totalImagesPullingTime="164.666313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:50:53.683804781 +0000 UTC m=+819.432810831" watchObservedRunningTime="2026-07-03 20:50:53.68470108 +0000 UTC m=+819.433707126"
Jul 03 20:51:00.951765 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:51:00.951728    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:51:02.865989 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:51:02.865953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:51:02.865989 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:51:02.865996    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:51:02.878124 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:51:02.878101    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:51:03.730657 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:51:03.730622    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f"
Jul 03 20:51:54.350122 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:51:54.350077    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:52:03.253075 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:52:03.253039    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:52:14.716117 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:52:14.716090    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:52:14.717364 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:52:14.717344    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:52:15.041090 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:52:15.041049    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:52:24.254210 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:52:24.254176    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:52:34.051444 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:52:34.051407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:53:02.753168 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:53:02.753133    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:53:11.642612 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:53:11.642578    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:53:44.752465 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:53:44.752383    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:53:53.858733 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:53:53.858697    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:54:02.356489 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:54:02.356455    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:54:11.649123 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:54:11.649091    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:54:21.763259 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:54:21.763223    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:54:30.957182 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:54:30.957147    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:54:42.743791 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:54:42.743751    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:54:51.861554 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:54:51.861520    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:55:14.951261 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:55:14.951175    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:55:24.557165 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:55:24.557128    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:55:48.051540 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:55:48.051505    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:55:58.846065 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:55:58.846023    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:56:13.755610 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:56:13.755575    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:56:22.553792 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:56:22.553753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:56:33.353302 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:56:33.353260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:56:43.044848 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:56:43.044766    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:56:52.151605 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:56:52.151569    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:57:14.752853 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:57:14.752825    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:57:14.754357 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:57:14.754334    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 20:58:40.355293 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:58:40.355261    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:58:49.352433 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:58:49.352397    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:59:01.564894 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:59:01.564859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:59:12.857492 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:59:12.857456    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:59:23.887540 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:59:23.887505    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:59:35.649416 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:59:35.649376    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:59:44.147980 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:59:44.147883    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 20:59:54.549085 ip-10-0-128-87 kubenswrapper[2569]: I0703 20:59:54.549050    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:00:06.154494 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:00:06.154460    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:00:14.852241 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:00:14.852204    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:00:25.746578 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:00:25.746538    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:00:49.845202 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:00:49.845167    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:00:56.948860 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:00:56.948820    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:01:06.657168 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:01:06.657136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:01:16.348543 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:01:16.348508    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:01:34.150386 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:01:34.150337    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:01:44.545503 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:01:44.545468    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:01:53.894398 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:01:53.894364    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:02:02.446253 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:02.446216    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:02:13.453119 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:13.453085    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:02:14.790323 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:14.790290    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:02:14.792211 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:14.792190    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:02:22.557787 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:22.557747    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:02:35.447205 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:35.447169    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:02:44.952047 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:44.951964    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:02:54.955097 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:02:54.955063    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:03:04.951836 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:03:04.951796    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:03:17.247549 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:03:17.247489    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:03:26.859893 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:03:26.859859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:03:38.948748 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:03:38.948711    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:03:49.450534 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:03:49.450496    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:04:01.943955 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:04:01.943916    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:04:10.758613 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:04:10.758526    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:04:23.947959 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:04:23.947904    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:04:30.654949 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:04:30.654899    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:04:40.851688 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:04:40.851650    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:04:53.346466 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:04:53.346431    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:05:05.138223 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:05:05.138181    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:05:12.350633 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:05:12.350588    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:05:21.151522 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:05:21.151479    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:06:41.859672 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:06:41.859636    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:06:50.751797 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:06:50.751757    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:07:02.751048 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:07:02.751014    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:07:13.547373 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:07:13.547339    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:07:14.818668 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:07:14.818636    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:07:14.822292 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:07:14.822271    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:07:45.153818 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:07:45.153780    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:07:56.543212 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:07:56.543177    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:08:03.055739 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:08:03.055703    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:08:13.052958 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:08:13.052911    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:08:54.848542 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:08:54.848457    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:09:04.053013 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:09:04.052975    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:09:16.254202 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:09:16.254165    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:10:03.250786 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:03.250751    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:10:15.652121 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:15.652045    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:10:32.545122 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:32.545080    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:10:55.455414 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.455379    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"]
Jul 03 21:10:55.458887 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.458865    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.462412 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.462393    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-33b41b\"/\"openshift-service-ca.crt\""
Jul 03 21:10:55.462530 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.462445    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-33b41b\"/\"default-dockercfg-tc94k\""
Jul 03 21:10:55.462593 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.462576    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-33b41b\"/\"test-model-33b41b-kserve-self-signed-certs\""
Jul 03 21:10:55.462668 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.462652    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-33b41b\"/\"kube-root-ca.crt\""
Jul 03 21:10:55.475183 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.475160    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"]
Jul 03 21:10:55.632842 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.632815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-tmp-dir\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.633029 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.632851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-home\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.633029 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.632881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d29pz\" (UniqueName: \"kubernetes.io/projected/29186ac9-f6c5-40fb-935b-5a156da84d72-kube-api-access-d29pz\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.633132 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.633032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-dshm\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.633132 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.633080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29186ac9-f6c5-40fb-935b-5a156da84d72-tls-certs\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.633132 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.633112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-model-cache\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.734653 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.734627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-tmp-dir\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.734806 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.734661    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-home\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.734806 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.734686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d29pz\" (UniqueName: \"kubernetes.io/projected/29186ac9-f6c5-40fb-935b-5a156da84d72-kube-api-access-d29pz\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.734806 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.734714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-dshm\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.734806 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.734743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29186ac9-f6c5-40fb-935b-5a156da84d72-tls-certs\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.734806 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.734773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-model-cache\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.735177 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.735152    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-tmp-dir\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.735177 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.735169    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-model-cache\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.735276 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.735190    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-home\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.737085 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.737066    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-dshm\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.737358 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.737341    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29186ac9-f6c5-40fb-935b-5a156da84d72-tls-certs\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.742017 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.741995    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d29pz\" (UniqueName: \"kubernetes.io/projected/29186ac9-f6c5-40fb-935b-5a156da84d72-kube-api-access-d29pz\") pod \"test-model-33b41b-kserve-7c6c84b4bc-bn9pd\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") " pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.771095 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.771070    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:10:55.904075 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:55.904048    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"]
Jul 03 21:10:55.905993 ip-10-0-128-87 kubenswrapper[2569]: W0703 21:10:55.905964    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29186ac9_f6c5_40fb_935b_5a156da84d72.slice/crio-0c883833dd1baed48ea11c3f8a97fe9f29f005dc686c88708717b2cf41d83885 WatchSource:0}: Error finding container 0c883833dd1baed48ea11c3f8a97fe9f29f005dc686c88708717b2cf41d83885: Status 404 returned error can't find the container with id 0c883833dd1baed48ea11c3f8a97fe9f29f005dc686c88708717b2cf41d83885
Jul 03 21:10:56.257271 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:56.257235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd" event={"ID":"29186ac9-f6c5-40fb-935b-5a156da84d72","Type":"ContainerStarted","Data":"feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862"}
Jul 03 21:10:56.257458 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:56.257283    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd" event={"ID":"29186ac9-f6c5-40fb-935b-5a156da84d72","Type":"ContainerStarted","Data":"0c883833dd1baed48ea11c3f8a97fe9f29f005dc686c88708717b2cf41d83885"}
Jul 03 21:10:56.273571 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:56.273525    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd" podStartSLOduration=1.273510138 podStartE2EDuration="1.273510138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 21:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 21:10:56.271868637 +0000 UTC m=+2022.020874675" watchObservedRunningTime="2026-07-03 21:10:56.273510138 +0000 UTC m=+2022.022516173"
Jul 03 21:10:59.757167 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:10:59.757128    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:11:05.771463 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:05.771416    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:11:05.771861 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:05.771485    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:11:05.783931 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:05.783904    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:11:06.321474 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:06.321440    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:11:18.633881 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:18.633848    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"]
Jul 03 21:11:23.352424 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:23.352383    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:11:33.654097 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.654035    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd" podUID="29186ac9-f6c5-40fb-935b-5a156da84d72" containerName="main" containerID="cri-o://feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862" gracePeriod=45
Jul 03 21:11:33.900633 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.900609    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:11:33.988893 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.988866    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d29pz\" (UniqueName: \"kubernetes.io/projected/29186ac9-f6c5-40fb-935b-5a156da84d72-kube-api-access-d29pz\") pod \"29186ac9-f6c5-40fb-935b-5a156da84d72\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") "
Jul 03 21:11:33.989073 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.988920    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-tmp-dir\") pod \"29186ac9-f6c5-40fb-935b-5a156da84d72\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") "
Jul 03 21:11:33.989073 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.988969    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29186ac9-f6c5-40fb-935b-5a156da84d72-tls-certs\") pod \"29186ac9-f6c5-40fb-935b-5a156da84d72\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") "
Jul 03 21:11:33.989073 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989007    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-model-cache\") pod \"29186ac9-f6c5-40fb-935b-5a156da84d72\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") "
Jul 03 21:11:33.989073 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989047    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-dshm\") pod \"29186ac9-f6c5-40fb-935b-5a156da84d72\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") "
Jul 03 21:11:33.989073 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989073    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-home\") pod \"29186ac9-f6c5-40fb-935b-5a156da84d72\" (UID: \"29186ac9-f6c5-40fb-935b-5a156da84d72\") "
Jul 03 21:11:33.989347 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989224    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29186ac9-f6c5-40fb-935b-5a156da84d72" (UID: "29186ac9-f6c5-40fb-935b-5a156da84d72"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:11:33.989347 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989274    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-model-cache" (OuterVolumeSpecName: "model-cache") pod "29186ac9-f6c5-40fb-935b-5a156da84d72" (UID: "29186ac9-f6c5-40fb-935b-5a156da84d72"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:11:33.989449 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989429    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-tmp-dir\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:11:33.989449 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989442    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-model-cache\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:11:33.989543 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.989443    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-home" (OuterVolumeSpecName: "home") pod "29186ac9-f6c5-40fb-935b-5a156da84d72" (UID: "29186ac9-f6c5-40fb-935b-5a156da84d72"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:11:33.991182 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.991159    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-dshm" (OuterVolumeSpecName: "dshm") pod "29186ac9-f6c5-40fb-935b-5a156da84d72" (UID: "29186ac9-f6c5-40fb-935b-5a156da84d72"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:11:33.991300 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.991273    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29186ac9-f6c5-40fb-935b-5a156da84d72-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29186ac9-f6c5-40fb-935b-5a156da84d72" (UID: "29186ac9-f6c5-40fb-935b-5a156da84d72"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 21:11:33.991355 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:33.991339    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29186ac9-f6c5-40fb-935b-5a156da84d72-kube-api-access-d29pz" (OuterVolumeSpecName: "kube-api-access-d29pz") pod "29186ac9-f6c5-40fb-935b-5a156da84d72" (UID: "29186ac9-f6c5-40fb-935b-5a156da84d72"). InnerVolumeSpecName "kube-api-access-d29pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 21:11:34.090144 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.090114    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d29pz\" (UniqueName: \"kubernetes.io/projected/29186ac9-f6c5-40fb-935b-5a156da84d72-kube-api-access-d29pz\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:11:34.090144 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.090140    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29186ac9-f6c5-40fb-935b-5a156da84d72-tls-certs\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:11:34.090144 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.090151    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-dshm\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:11:34.090351 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.090160    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29186ac9-f6c5-40fb-935b-5a156da84d72-home\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:11:34.441405 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.441327    2569 generic.go:356] "Generic (PLEG): container finished" podID="29186ac9-f6c5-40fb-935b-5a156da84d72" containerID="feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862" exitCode=0
Jul 03 21:11:34.441405 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.441370    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"
Jul 03 21:11:34.441578 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.441416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd" event={"ID":"29186ac9-f6c5-40fb-935b-5a156da84d72","Type":"ContainerDied","Data":"feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862"}
Jul 03 21:11:34.441578 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.441463    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd" event={"ID":"29186ac9-f6c5-40fb-935b-5a156da84d72","Type":"ContainerDied","Data":"0c883833dd1baed48ea11c3f8a97fe9f29f005dc686c88708717b2cf41d83885"}
Jul 03 21:11:34.441578 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.441483    2569 scope.go:117] "RemoveContainer" containerID="feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862"
Jul 03 21:11:34.455468 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.455442    2569 scope.go:117] "RemoveContainer" containerID="feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862"
Jul 03 21:11:34.455896 ip-10-0-128-87 kubenswrapper[2569]: E0703 21:11:34.455788    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862\": container with ID starting with feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862 not found: ID does not exist" containerID="feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862"
Jul 03 21:11:34.455896 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.455825    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862"} err="failed to get container status \"feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862\": rpc error: code = NotFound desc = could not find container \"feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862\": container with ID starting with feccd8c70a4f596f64243cd05abc58fed6d052de3ef65eb45a03a97a05234862 not found: ID does not exist"
Jul 03 21:11:34.467763 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.467737    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"]
Jul 03 21:11:34.469449 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:34.469427    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-33b41b/test-model-33b41b-kserve-7c6c84b4bc-bn9pd"]
Jul 03 21:11:35.186117 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:35.186082    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29186ac9-f6c5-40fb-935b-5a156da84d72" path="/var/lib/kubelet/pods/29186ac9-f6c5-40fb-935b-5a156da84d72/volumes"
Jul 03 21:11:57.450830 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:11:57.450750    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:12:07.947307 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:07.947267    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:12:14.847827 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:14.847790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:12:14.852714 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:14.852688    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:12:18.754880 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:18.754843    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:12:31.054387 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:31.054355    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:12:40.853496 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:40.853459    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:12:52.154084 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:12:52.154046    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:13:04.752809 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:04.752775    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:13:15.948029 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:15.947952    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:13:38.758769 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.758735    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"]
Jul 03 21:13:38.759160 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.759147    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29186ac9-f6c5-40fb-935b-5a156da84d72" containerName="main"
Jul 03 21:13:38.759160 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.759160    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="29186ac9-f6c5-40fb-935b-5a156da84d72" containerName="main"
Jul 03 21:13:38.759230 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.759224    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="29186ac9-f6c5-40fb-935b-5a156da84d72" containerName="main"
Jul 03 21:13:38.762323 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.762303    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.764681 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.764658    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"default-dockercfg-hpf6f\""
Jul 03 21:13:38.764681 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.764667    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"auth-test-model-26641f-kserve-self-signed-certs\""
Jul 03 21:13:38.764888 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.764669    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"kube-root-ca.crt\""
Jul 03 21:13:38.764888 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.764696    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"openshift-service-ca.crt\""
Jul 03 21:13:38.771187 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.771166    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"]
Jul 03 21:13:38.826230 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.826204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-home\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.826385 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.826242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tls-certs\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.826385 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.826269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-dshm\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.826385 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.826334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6gtc\" (UniqueName: \"kubernetes.io/projected/0afc6074-cd4c-4bce-bb20-b33aa231e53c-kube-api-access-r6gtc\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.826488 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.826400    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tmp-dir\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.826488 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.826476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-model-cache\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.926956 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.926906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-model-cache\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927082 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.926970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-home\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927082 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tls-certs\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927082 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-dshm\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927220 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6gtc\" (UniqueName: \"kubernetes.io/projected/0afc6074-cd4c-4bce-bb20-b33aa231e53c-kube-api-access-r6gtc\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927285 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tmp-dir\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927398 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927377    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-model-cache\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927444 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927414    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-home\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.927581 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.927564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tmp-dir\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.929258 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.929239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-dshm\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.929535 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.929517    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tls-certs\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:38.934899 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:38.934882    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6gtc\" (UniqueName: \"kubernetes.io/projected/0afc6074-cd4c-4bce-bb20-b33aa231e53c-kube-api-access-r6gtc\") pod \"auth-test-model-26641f-kserve-687ffb959-gtxcd\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") " pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:39.072056 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:39.071972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:39.197875 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:39.197850    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"]
Jul 03 21:13:39.200243 ip-10-0-128-87 kubenswrapper[2569]: W0703 21:13:39.200217    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0afc6074_cd4c_4bce_bb20_b33aa231e53c.slice/crio-5b2ef91018780304c94b943c54f2dc9361dfa6c64e3554584d4421a03c6abe3b WatchSource:0}: Error finding container 5b2ef91018780304c94b943c54f2dc9361dfa6c64e3554584d4421a03c6abe3b: Status 404 returned error can't find the container with id 5b2ef91018780304c94b943c54f2dc9361dfa6c64e3554584d4421a03c6abe3b
Jul 03 21:13:40.034133 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:40.034092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd" event={"ID":"0afc6074-cd4c-4bce-bb20-b33aa231e53c","Type":"ContainerStarted","Data":"ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899"}
Jul 03 21:13:40.034133 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:40.034139    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd" event={"ID":"0afc6074-cd4c-4bce-bb20-b33aa231e53c","Type":"ContainerStarted","Data":"5b2ef91018780304c94b943c54f2dc9361dfa6c64e3554584d4421a03c6abe3b"}
Jul 03 21:13:40.049754 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:40.049703    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd" podStartSLOduration=2.049687989 podStartE2EDuration="2.049687989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 21:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 21:13:40.047809113 +0000 UTC m=+2185.796815163" watchObservedRunningTime="2026-07-03 21:13:40.049687989 +0000 UTC m=+2185.798694059"
Jul 03 21:13:42.548930 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:42.548890    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:13:49.072650 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:49.072601    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:49.072650 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:49.072664    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:49.085180 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:49.085155    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:49.096664 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:49.096644    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:13:59.343806 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:13:59.343771    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:14:14.044207 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:14:14.044165    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:14:31.448535 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:14:31.448497    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:14:48.152460 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:14:48.152368    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:15:03.350410 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:03.350374    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:15:16.650084 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:16.650052    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:15:29.533908 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:29.533874    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"]
Jul 03 21:15:33.755740 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:33.755698    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:15:44.556854 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.556816    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd" podUID="0afc6074-cd4c-4bce-bb20-b33aa231e53c" containerName="main" containerID="cri-o://ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899" gracePeriod=45
Jul 03 21:15:44.806398 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.806372    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:15:44.906478 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906390    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-dshm\") pod \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") "
Jul 03 21:15:44.906478 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906430    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-home\") pod \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") "
Jul 03 21:15:44.906478 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906471    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tls-certs\") pod \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") "
Jul 03 21:15:44.906728 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906513    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6gtc\" (UniqueName: \"kubernetes.io/projected/0afc6074-cd4c-4bce-bb20-b33aa231e53c-kube-api-access-r6gtc\") pod \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") "
Jul 03 21:15:44.906728 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906531    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-model-cache\") pod \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") "
Jul 03 21:15:44.906728 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906721    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tmp-dir\") pod \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\" (UID: \"0afc6074-cd4c-4bce-bb20-b33aa231e53c\") "
Jul 03 21:15:44.906892 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906823    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-home" (OuterVolumeSpecName: "home") pod "0afc6074-cd4c-4bce-bb20-b33aa231e53c" (UID: "0afc6074-cd4c-4bce-bb20-b33aa231e53c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:15:44.907006 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.906973    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-model-cache" (OuterVolumeSpecName: "model-cache") pod "0afc6074-cd4c-4bce-bb20-b33aa231e53c" (UID: "0afc6074-cd4c-4bce-bb20-b33aa231e53c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:15:44.907087 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.907067    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0afc6074-cd4c-4bce-bb20-b33aa231e53c" (UID: "0afc6074-cd4c-4bce-bb20-b33aa231e53c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:15:44.907212 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.907186    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tmp-dir\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:15:44.907212 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.907212    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-home\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:15:44.907404 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.907227    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-model-cache\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:15:44.908674 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.908654    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-dshm" (OuterVolumeSpecName: "dshm") pod "0afc6074-cd4c-4bce-bb20-b33aa231e53c" (UID: "0afc6074-cd4c-4bce-bb20-b33aa231e53c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:15:44.908781 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.908762    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0afc6074-cd4c-4bce-bb20-b33aa231e53c" (UID: "0afc6074-cd4c-4bce-bb20-b33aa231e53c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 21:15:44.908844 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:44.908772    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afc6074-cd4c-4bce-bb20-b33aa231e53c-kube-api-access-r6gtc" (OuterVolumeSpecName: "kube-api-access-r6gtc") pod "0afc6074-cd4c-4bce-bb20-b33aa231e53c" (UID: "0afc6074-cd4c-4bce-bb20-b33aa231e53c"). InnerVolumeSpecName "kube-api-access-r6gtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 21:15:45.008448 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.008398    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0afc6074-cd4c-4bce-bb20-b33aa231e53c-dshm\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:15:45.008448 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.008442    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0afc6074-cd4c-4bce-bb20-b33aa231e53c-tls-certs\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:15:45.008448 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.008454    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6gtc\" (UniqueName: \"kubernetes.io/projected/0afc6074-cd4c-4bce-bb20-b33aa231e53c-kube-api-access-r6gtc\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:15:45.631711 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.631668    2569 generic.go:356] "Generic (PLEG): container finished" podID="0afc6074-cd4c-4bce-bb20-b33aa231e53c" containerID="ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899" exitCode=0
Jul 03 21:15:45.631711 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.631712    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"
Jul 03 21:15:45.632279 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.631753    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd" event={"ID":"0afc6074-cd4c-4bce-bb20-b33aa231e53c","Type":"ContainerDied","Data":"ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899"}
Jul 03 21:15:45.632279 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.631796    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd" event={"ID":"0afc6074-cd4c-4bce-bb20-b33aa231e53c","Type":"ContainerDied","Data":"5b2ef91018780304c94b943c54f2dc9361dfa6c64e3554584d4421a03c6abe3b"}
Jul 03 21:15:45.632279 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.631815    2569 scope.go:117] "RemoveContainer" containerID="ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899"
Jul 03 21:15:45.642300 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.642274    2569 scope.go:117] "RemoveContainer" containerID="ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899"
Jul 03 21:15:45.642730 ip-10-0-128-87 kubenswrapper[2569]: E0703 21:15:45.642708    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899\": container with ID starting with ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899 not found: ID does not exist" containerID="ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899"
Jul 03 21:15:45.642835 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.642736    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899"} err="failed to get container status \"ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899\": rpc error: code = NotFound desc = could not find container \"ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899\": container with ID starting with ba213a0b22353dcfe23ac227e7f97447fc1e7461bffbd11aa219211be8f45899 not found: ID does not exist"
Jul 03 21:15:45.645005 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.644983    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"]
Jul 03 21:15:45.648378 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:45.648357    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/auth-test-model-26641f-kserve-687ffb959-gtxcd"]
Jul 03 21:15:47.186564 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:47.186526    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afc6074-cd4c-4bce-bb20-b33aa231e53c" path="/var/lib/kubelet/pods/0afc6074-cd4c-4bce-bb20-b33aa231e53c/volumes"
Jul 03 21:15:59.953495 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.953459    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"]
Jul 03 21:15:59.953875 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.953815    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afc6074-cd4c-4bce-bb20-b33aa231e53c" containerName="main"
Jul 03 21:15:59.953875 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.953826    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afc6074-cd4c-4bce-bb20-b33aa231e53c" containerName="main"
Jul 03 21:15:59.953966 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.953898    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afc6074-cd4c-4bce-bb20-b33aa231e53c" containerName="main"
Jul 03 21:15:59.956654 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.956638    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:15:59.959315 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.959287    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"kube-root-ca.crt\""
Jul 03 21:15:59.959315 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.959310    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"default-dockercfg-hpf6f\""
Jul 03 21:15:59.959315 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.959317    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"openshift-service-ca.crt\""
Jul 03 21:15:59.959568 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.959414    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-26641f\"/\"sub-test-model-26641f-kserve-self-signed-certs\""
Jul 03 21:15:59.963819 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:15:59.963737    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"]
Jul 03 21:16:00.049261 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.049224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-home\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.049423 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.049270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxmh\" (UniqueName: \"kubernetes.io/projected/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-kube-api-access-pmxmh\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.049423 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.049300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-model-cache\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.049423 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.049340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-dshm\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.049423 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.049402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tls-certs\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.049595 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.049444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tmp-dir\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.150901 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.150863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-home\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.150901 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.150909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxmh\" (UniqueName: \"kubernetes.io/projected/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-kube-api-access-pmxmh\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151198 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.150971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-model-cache\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151198 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.150996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-dshm\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151198 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.151017    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tls-certs\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151198 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.151046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tmp-dir\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151404 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.151370    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-home\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151447 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.151421    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-model-cache\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.151522 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.151503    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tmp-dir\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.153267 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.153248    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-dshm\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.153575 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.153556    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tls-certs\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.158456 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.158433    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxmh\" (UniqueName: \"kubernetes.io/projected/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-kube-api-access-pmxmh\") pod \"sub-test-model-26641f-kserve-b855b76fc-gjmgd\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") " pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.266301 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.266267    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:00.396210 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.396182    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"]
Jul 03 21:16:00.398336 ip-10-0-128-87 kubenswrapper[2569]: W0703 21:16:00.398305    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf41d0c9d_09c1_4997_bb7e_b0ae9584db06.slice/crio-9ea18cee7ae7e65431230ed4c1f819fba7d2fd1308a9e5c874a143bccd1c3c2f WatchSource:0}: Error finding container 9ea18cee7ae7e65431230ed4c1f819fba7d2fd1308a9e5c874a143bccd1c3c2f: Status 404 returned error can't find the container with id 9ea18cee7ae7e65431230ed4c1f819fba7d2fd1308a9e5c874a143bccd1c3c2f
Jul 03 21:16:00.705590 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.705506    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd" event={"ID":"f41d0c9d-09c1-4997-bb7e-b0ae9584db06","Type":"ContainerStarted","Data":"c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785"}
Jul 03 21:16:00.705590 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.705544    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd" event={"ID":"f41d0c9d-09c1-4997-bb7e-b0ae9584db06","Type":"ContainerStarted","Data":"9ea18cee7ae7e65431230ed4c1f819fba7d2fd1308a9e5c874a143bccd1c3c2f"}
Jul 03 21:16:00.720593 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:00.720539    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd" podStartSLOduration=1.720523695 podStartE2EDuration="1.720523695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 21:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 21:16:00.718687464 +0000 UTC m=+2326.467693513" watchObservedRunningTime="2026-07-03 21:16:00.720523695 +0000 UTC m=+2326.469529732"
Jul 03 21:16:04.351584 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:04.351550    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:16:10.266505 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:10.266469    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:10.266888 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:10.266519    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:10.278777 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:10.278752    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:10.762059 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:10.762033    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:16:39.742804 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:39.742768    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:16:56.945408 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:16:56.945372    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:17:02.554453 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:02.554417    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"]
Jul 03 21:17:14.253776 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:14.253738    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:17:14.877054 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:14.877021    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:17:14.882256 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:14.882234    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:17:17.574619 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.574552    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd" podUID="f41d0c9d-09c1-4997-bb7e-b0ae9584db06" containerName="main" containerID="cri-o://c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785" gracePeriod=45
Jul 03 21:17:17.827216 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.827151    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:17:17.882115 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882080    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tls-certs\") pod \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") "
Jul 03 21:17:17.882299 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882122    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-model-cache\") pod \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") "
Jul 03 21:17:17.882299 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882152    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-home\") pod \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") "
Jul 03 21:17:17.882299 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882262    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tmp-dir\") pod \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") "
Jul 03 21:17:17.882463 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882302    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-dshm\") pod \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") "
Jul 03 21:17:17.882463 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882359    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-model-cache" (OuterVolumeSpecName: "model-cache") pod "f41d0c9d-09c1-4997-bb7e-b0ae9584db06" (UID: "f41d0c9d-09c1-4997-bb7e-b0ae9584db06"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:17:17.882463 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882375    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-home" (OuterVolumeSpecName: "home") pod "f41d0c9d-09c1-4997-bb7e-b0ae9584db06" (UID: "f41d0c9d-09c1-4997-bb7e-b0ae9584db06"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:17:17.882463 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882382    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmxmh\" (UniqueName: \"kubernetes.io/projected/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-kube-api-access-pmxmh\") pod \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\" (UID: \"f41d0c9d-09c1-4997-bb7e-b0ae9584db06\") "
Jul 03 21:17:17.882642 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882496    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f41d0c9d-09c1-4997-bb7e-b0ae9584db06" (UID: "f41d0c9d-09c1-4997-bb7e-b0ae9584db06"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:17:17.882752 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882733    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-model-cache\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:17:17.882800 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882758    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-home\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:17:17.882800 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.882772    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tmp-dir\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:17:17.884273 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.884253    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-dshm" (OuterVolumeSpecName: "dshm") pod "f41d0c9d-09c1-4997-bb7e-b0ae9584db06" (UID: "f41d0c9d-09c1-4997-bb7e-b0ae9584db06"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 21:17:17.884372 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.884340    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f41d0c9d-09c1-4997-bb7e-b0ae9584db06" (UID: "f41d0c9d-09c1-4997-bb7e-b0ae9584db06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 21:17:17.884372 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.884355    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-kube-api-access-pmxmh" (OuterVolumeSpecName: "kube-api-access-pmxmh") pod "f41d0c9d-09c1-4997-bb7e-b0ae9584db06" (UID: "f41d0c9d-09c1-4997-bb7e-b0ae9584db06"). InnerVolumeSpecName "kube-api-access-pmxmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 21:17:17.983688 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.983661    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmxmh\" (UniqueName: \"kubernetes.io/projected/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-kube-api-access-pmxmh\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:17:17.983688 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.983684    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-tls-certs\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:17:17.983688 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:17.983694    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41d0c9d-09c1-4997-bb7e-b0ae9584db06-dshm\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Jul 03 21:17:18.058406 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.058378    2569 generic.go:356] "Generic (PLEG): container finished" podID="f41d0c9d-09c1-4997-bb7e-b0ae9584db06" containerID="c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785" exitCode=0
Jul 03 21:17:18.058542 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.058421    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"
Jul 03 21:17:18.058542 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.058465    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd" event={"ID":"f41d0c9d-09c1-4997-bb7e-b0ae9584db06","Type":"ContainerDied","Data":"c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785"}
Jul 03 21:17:18.058542 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.058506    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd" event={"ID":"f41d0c9d-09c1-4997-bb7e-b0ae9584db06","Type":"ContainerDied","Data":"9ea18cee7ae7e65431230ed4c1f819fba7d2fd1308a9e5c874a143bccd1c3c2f"}
Jul 03 21:17:18.058542 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.058527    2569 scope.go:117] "RemoveContainer" containerID="c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785"
Jul 03 21:17:18.067452 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.067429    2569 scope.go:117] "RemoveContainer" containerID="c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785"
Jul 03 21:17:18.067728 ip-10-0-128-87 kubenswrapper[2569]: E0703 21:17:18.067709    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785\": container with ID starting with c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785 not found: ID does not exist" containerID="c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785"
Jul 03 21:17:18.067796 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.067739    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785"} err="failed to get container status \"c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785\": rpc error: code = NotFound desc = could not find container \"c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785\": container with ID starting with c151c73b664f6027e3a15a54b0a1d01fdea1a482aca9b8e2c432cbb57b35b785 not found: ID does not exist"
Jul 03 21:17:18.078308 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.078255    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"]
Jul 03 21:17:18.081396 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:18.081375    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-26641f/sub-test-model-26641f-kserve-b855b76fc-gjmgd"]
Jul 03 21:17:19.186167 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:19.186133    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41d0c9d-09c1-4997-bb7e-b0ae9584db06" path="/var/lib/kubelet/pods/f41d0c9d-09c1-4997-bb7e-b0ae9584db06/volumes"
Jul 03 21:17:31.751949 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:31.751901    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:17:45.748991 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:17:45.748895    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:18:00.545771 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:18:00.545737    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:18:13.542751 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:18:13.542715    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:18:55.349838 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:18:55.349800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2fpj"]
Jul 03 21:19:05.564818 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:05.564785    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448f4d7cf-kgrgv_34195223-3d7f-4d95-8456-087e5cafca3a/copy-manifests/0.log"
Jul 03 21:19:05.570703 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:05.570674    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448f4d7cf-kgrgv_34195223-3d7f-4d95-8456-087e5cafca3a/manager/0.log"
Jul 03 21:19:07.426117 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:07.426034    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ltdzb_687c8507-2369-4f60-9bc5-180ff8bf6955/kuadrant-console-plugin/0.log"
Jul 03 21:19:07.777713 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:07.777676    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z2fpj_9d75f6e9-1209-4db8-a192-8dcd0631ca9a/limitador/0.log"
Jul 03 21:19:08.475818 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:08.475780    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dff55469-cqbsg_c9e63bba-7dd9-4768-a07e-ad80ffa8093d/kube-auth-proxy/0.log"
Jul 03 21:19:09.059173 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:09.059121    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f648dcdf-pj9r7_2b847e39-d44f-461f-89ff-6f6b22406d25/router/0.log"
Jul 03 21:19:09.511895 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:09.511865    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hb98r_2be05ec5-5dd4-47ae-8ab3-2ff6551eed78/main/0.log"
Jul 03 21:19:09.731838 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:09.731807    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xrkb_b14b05e0-665e-4efd-858d-5cbe7e227746/main/0.log"
Jul 03 21:19:09.950061 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:09.949976    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-x6r4f_5d51f25d-9a66-40e9-a34d-787491ae22d5/main/0.log"
Jul 03 21:19:16.882351 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:16.882323    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mf6t2_6cd6d036-9a5b-42d0-b428-861c82202bff/global-pull-secret-syncer/0.log"
Jul 03 21:19:17.026304 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:17.026271    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cdbfr_ca34b1ae-390f-48d0-aff6-524260a1ed19/konnectivity-agent/0.log"
Jul 03 21:19:17.044476 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:17.044438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-87.ec2.internal_f9dec68b5fc70760505a8e888fd282a0/haproxy/0.log"
Jul 03 21:19:22.456256 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:22.456217    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ltdzb_687c8507-2369-4f60-9bc5-180ff8bf6955/kuadrant-console-plugin/0.log"
Jul 03 21:19:22.678467 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:22.678438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z2fpj_9d75f6e9-1209-4db8-a192-8dcd0631ca9a/limitador/0.log"
Jul 03 21:19:24.485816 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.485784    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/alertmanager/0.log"
Jul 03 21:19:24.502204 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.502182    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/config-reloader/0.log"
Jul 03 21:19:24.517498 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.517470    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/kube-rbac-proxy-web/0.log"
Jul 03 21:19:24.532697 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.532670    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/kube-rbac-proxy/0.log"
Jul 03 21:19:24.548327 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.548300    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/kube-rbac-proxy-metric/0.log"
Jul 03 21:19:24.565959 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.565915    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/prom-label-proxy/0.log"
Jul 03 21:19:24.582282 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.582259    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb4f113-1d5a-4e2f-97dd-885e1203704b/init-config-reloader/0.log"
Jul 03 21:19:24.795138 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.795064    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9ffb795bc-jzks8_371870de-f457-4874-bc86-47e3c9838a41/metrics-server/0.log"
Jul 03 21:19:24.824119 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.824089    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-w668t_1e0b0b4d-d9c2-41bc-a1b1-2e77bf7bd325/monitoring-plugin/0.log"
Jul 03 21:19:24.923201 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.923165    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-77m79_25cf7655-039a-4a67-a825-354df9c9db29/node-exporter/0.log"
Jul 03 21:19:24.939276 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.939253    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-77m79_25cf7655-039a-4a67-a825-354df9c9db29/kube-rbac-proxy/0.log"
Jul 03 21:19:24.955818 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:24.955801    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-77m79_25cf7655-039a-4a67-a825-354df9c9db29/init-textfile/0.log"
Jul 03 21:19:25.037707 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.037670    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ff75z_3b06837c-01bf-439d-9d2d-26f45ab0bc01/kube-rbac-proxy-main/0.log"
Jul 03 21:19:25.055060 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.054984    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ff75z_3b06837c-01bf-439d-9d2d-26f45ab0bc01/kube-rbac-proxy-self/0.log"
Jul 03 21:19:25.070910 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.070886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ff75z_3b06837c-01bf-439d-9d2d-26f45ab0bc01/openshift-state-metrics/0.log"
Jul 03 21:19:25.107855 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.107833    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/prometheus/0.log"
Jul 03 21:19:25.125280 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.125258    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/config-reloader/0.log"
Jul 03 21:19:25.141207 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.141189    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/thanos-sidecar/0.log"
Jul 03 21:19:25.160194 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.160174    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/kube-rbac-proxy-web/0.log"
Jul 03 21:19:25.175582 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.175560    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/kube-rbac-proxy/0.log"
Jul 03 21:19:25.191288 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.191263    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/kube-rbac-proxy-thanos/0.log"
Jul 03 21:19:25.206482 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.206464    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e93f6-8824-4926-8533-87aaf29fe099/init-config-reloader/0.log"
Jul 03 21:19:25.232743 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.232718    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-sfjpr_b38edb65-8c0a-45fb-b4c6-76aa43651c6b/prometheus-operator/0.log"
Jul 03 21:19:25.244181 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.244157    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-sfjpr_b38edb65-8c0a-45fb-b4c6-76aa43651c6b/kube-rbac-proxy/0.log"
Jul 03 21:19:25.293110 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.293087    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ffc97dc85-hmnn4_67efaf64-a2a3-406a-a2b7-c6e52e69e6e5/telemeter-client/0.log"
Jul 03 21:19:25.309697 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.309638    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ffc97dc85-hmnn4_67efaf64-a2a3-406a-a2b7-c6e52e69e6e5/reload/0.log"
Jul 03 21:19:25.328215 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:25.328194    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ffc97dc85-hmnn4_67efaf64-a2a3-406a-a2b7-c6e52e69e6e5/kube-rbac-proxy/0.log"
Jul 03 21:19:27.097455 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.097419    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/1.log"
Jul 03 21:19:27.106137 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.106112    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qqcmk_7c92a97f-20dc-4d06-b9d1-0f4ec059a7eb/console-operator/2.log"
Jul 03 21:19:27.323065 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.323031    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"]
Jul 03 21:19:27.323401 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.323389    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41d0c9d-09c1-4997-bb7e-b0ae9584db06" containerName="main"
Jul 03 21:19:27.323443 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.323402    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41d0c9d-09c1-4997-bb7e-b0ae9584db06" containerName="main"
Jul 03 21:19:27.323601 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.323472    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41d0c9d-09c1-4997-bb7e-b0ae9584db06" containerName="main"
Jul 03 21:19:27.326593 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.326549    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.328491 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.328468    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbmfn\"/\"default-dockercfg-sb5rk\""
Jul 03 21:19:27.328622 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.328471    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbmfn\"/\"kube-root-ca.crt\""
Jul 03 21:19:27.328881 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.328864    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbmfn\"/\"openshift-service-ca.crt\""
Jul 03 21:19:27.332131 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.332106    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"]
Jul 03 21:19:27.364139 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.364081    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-sys\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.364139 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.364111    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-podres\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.364139 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.364139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-proc\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.364314 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.364199    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-lib-modules\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.364314 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.364233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgwpg\" (UniqueName: \"kubernetes.io/projected/cedd426a-a41f-4eea-99d8-8a7139b59244-kube-api-access-cgwpg\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465502 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-sys\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465502 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-podres\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-proc\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-lib-modules\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgwpg\" (UniqueName: \"kubernetes.io/projected/cedd426a-a41f-4eea-99d8-8a7139b59244-kube-api-access-cgwpg\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465594    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-sys\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465664    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-proc\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465670    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-podres\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.465729 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.465710    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cedd426a-a41f-4eea-99d8-8a7139b59244-lib-modules\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.472283 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.472255    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgwpg\" (UniqueName: \"kubernetes.io/projected/cedd426a-a41f-4eea-99d8-8a7139b59244-kube-api-access-cgwpg\") pod \"perf-node-gather-daemonset-lrrjf\" (UID: \"cedd426a-a41f-4eea-99d8-8a7139b59244\") " pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.599584 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.599560    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86f8bd6b4b-jjkjp_520c7e8d-2b97-48cd-8b89-72f161b8a61b/console/0.log"
Jul 03 21:19:27.636765 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.636700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:27.765713 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:27.765686    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"]
Jul 03 21:19:27.767821 ip-10-0-128-87 kubenswrapper[2569]: W0703 21:19:27.767794    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcedd426a_a41f_4eea_99d8_8a7139b59244.slice/crio-ee7e75d2eea7f2a88ee294b3d2f84073445db3eb051b7a220e2b07ec25c84419 WatchSource:0}: Error finding container ee7e75d2eea7f2a88ee294b3d2f84073445db3eb051b7a220e2b07ec25c84419: Status 404 returned error can't find the container with id ee7e75d2eea7f2a88ee294b3d2f84073445db3eb051b7a220e2b07ec25c84419
Jul 03 21:19:28.219489 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:28.219455    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-w5b5j_b0af4eca-1d44-42d0-bcab-df4acb254b46/volume-data-source-validator/0.log"
Jul 03 21:19:28.666290 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:28.666255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf" event={"ID":"cedd426a-a41f-4eea-99d8-8a7139b59244","Type":"ContainerStarted","Data":"154c21590eb64a0f3f9810c211e9be1369af14cbde073944f5e73f040e55b111"}
Jul 03 21:19:28.666504 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:28.666337    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf" event={"ID":"cedd426a-a41f-4eea-99d8-8a7139b59244","Type":"ContainerStarted","Data":"ee7e75d2eea7f2a88ee294b3d2f84073445db3eb051b7a220e2b07ec25c84419"}
Jul 03 21:19:28.666504 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:28.666417    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:28.683639 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:28.683593    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf" podStartSLOduration=1.6835783640000002 podStartE2EDuration="1.683578364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 21:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 21:19:28.68187804 +0000 UTC m=+2534.430884077" watchObservedRunningTime="2026-07-03 21:19:28.683578364 +0000 UTC m=+2534.432584402"
Jul 03 21:19:29.149650 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:29.149620    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fvf9x_bd8c8768-8ac8-431b-8c67-3543adbab1b9/dns/0.log"
Jul 03 21:19:29.165215 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:29.165191    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fvf9x_bd8c8768-8ac8-431b-8c67-3543adbab1b9/kube-rbac-proxy/0.log"
Jul 03 21:19:29.254639 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:29.254611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-99rzh_31443663-2252-44bd-af2e-6b6408ecd69c/dns-node-resolver/0.log"
Jul 03 21:19:29.819582 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:29.819552    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2cq2r_9f5d0788-6048-437e-b01b-bab9557f948e/node-ca/0.log"
Jul 03 21:19:30.834677 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:30.834648    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dff55469-cqbsg_c9e63bba-7dd9-4768-a07e-ad80ffa8093d/kube-auth-proxy/0.log"
Jul 03 21:19:31.090745 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:31.090659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f648dcdf-pj9r7_2b847e39-d44f-461f-89ff-6f6b22406d25/router/0.log"
Jul 03 21:19:31.724521 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:31.724490    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hm5tb_54122702-f841-4ea6-965e-6116ab1bc2b7/serve-healthcheck-canary/0.log"
Jul 03 21:19:32.208096 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:32.208067    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wqhf_3b6211e9-da3e-452f-96cf-c3a550e002d7/kube-rbac-proxy/0.log"
Jul 03 21:19:32.223587 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:32.223565    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wqhf_3b6211e9-da3e-452f-96cf-c3a550e002d7/exporter/0.log"
Jul 03 21:19:32.242048 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:32.242026    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wqhf_3b6211e9-da3e-452f-96cf-c3a550e002d7/extractor/0.log"
Jul 03 21:19:34.680872 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:34.680843    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbmfn/perf-node-gather-daemonset-lrrjf"
Jul 03 21:19:34.968879 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:34.968790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448f4d7cf-kgrgv_34195223-3d7f-4d95-8456-087e5cafca3a/manager/0.log"
Jul 03 21:19:34.985569 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:34.985546    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448f4d7cf-kgrgv_34195223-3d7f-4d95-8456-087e5cafca3a/copy-manifests/0.log"
Jul 03 21:19:36.575983 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:36.575959    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66c99c87c9-ncwmk_9800b369-7d78-4ae0-b90b-7788655451ae/manager/0.log"
Jul 03 21:19:37.774971 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:37.774924    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dff55469-cqbsg_c9e63bba-7dd9-4768-a07e-ad80ffa8093d/kube-auth-proxy/0.log"
Jul 03 21:19:37.924217 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:37.924187    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f648dcdf-pj9r7_2b847e39-d44f-461f-89ff-6f6b22406d25/router/0.log"
Jul 03 21:19:39.264873 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:39.264845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dff55469-cqbsg_c9e63bba-7dd9-4768-a07e-ad80ffa8093d/kube-auth-proxy/0.log"
Jul 03 21:19:39.444146 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:39.444116    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f648dcdf-pj9r7_2b847e39-d44f-461f-89ff-6f6b22406d25/router/0.log"
Jul 03 21:19:43.158668 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.158641    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/kube-multus-additional-cni-plugins/0.log"
Jul 03 21:19:43.174608 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.174584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/egress-router-binary-copy/0.log"
Jul 03 21:19:43.189820 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.189797    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/cni-plugins/0.log"
Jul 03 21:19:43.206076 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.206051    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/bond-cni-plugin/0.log"
Jul 03 21:19:43.221768 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.221742    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/routeoverride-cni/0.log"
Jul 03 21:19:43.237622 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.237603    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/whereabouts-cni-bincopy/0.log"
Jul 03 21:19:43.253440 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.253420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwc49_474329be-b0d8-4922-a5bc-bc5d62fc63be/whereabouts-cni/0.log"
Jul 03 21:19:43.318162 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.318136    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wrbt4_6a214ce6-540e-4a40-bcb9-0b8e5d80b8ed/kube-multus/0.log"
Jul 03 21:19:43.365666 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.365641    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9sckp_9022ab2d-fd3c-4739-b911-d257554cca54/network-metrics-daemon/0.log"
Jul 03 21:19:43.379744 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:43.379716    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9sckp_9022ab2d-fd3c-4739-b911-d257554cca54/kube-rbac-proxy/0.log"
Jul 03 21:19:44.161771 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.161744    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/ovn-controller/0.log"
Jul 03 21:19:44.173467 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.173446    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/ovn-acl-logging/0.log"
Jul 03 21:19:44.199660 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.199639    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/kube-rbac-proxy-node/0.log"
Jul 03 21:19:44.218490 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.218463    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/kube-rbac-proxy-ovn-metrics/0.log"
Jul 03 21:19:44.230412 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.230392    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/northd/0.log"
Jul 03 21:19:44.247124 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.247104    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/nbdb/0.log"
Jul 03 21:19:44.262063 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.262042    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/sbdb/0.log"
Jul 03 21:19:44.330369 ip-10-0-128-87 kubenswrapper[2569]: I0703 21:19:44.330343    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx87t_5de24734-fb4c-4871-b17e-069347aaeb37/ovnkube-controller/0.log"