Jul 03 14:11:42.636999 ip-10-0-141-67 systemd[1]: Starting Kubernetes Kubelet...
Jul 03 14:11:43.012887 ip-10-0-141-67 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 14:11:43.012887 ip-10-0-141-67 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 03 14:11:43.012887 ip-10-0-141-67 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 14:11:43.012887 ip-10-0-141-67 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 03 14:11:43.012887 ip-10-0-141-67 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 14:11:43.013663 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.013572    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 03 14:11:43.018715 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018701    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 14:11:43.018715 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018716    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018720    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018723    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018726    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018729    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018734    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018736    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018739    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018741    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018744    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018746    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018749    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018751    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018754    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018756    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018759    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018762    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018764    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018772    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 14:11:43.018778 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018775    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018778    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018781    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018783    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018786    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018789    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018792    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018794    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018797    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018799    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018801    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018804    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018806    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018809    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018811    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018814    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018817    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018819    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018822    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018825    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 14:11:43.019222 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018827    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018830    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018832    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018834    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018837    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018839    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018844    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018847    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018851    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018854    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018857    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018860    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018863    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018866    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018869    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018872    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018875    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018878    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018881    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018883    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 14:11:43.019741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018886    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018888    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018891    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018893    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018897    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018899    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018902    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018905    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018909    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018912    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018914    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018920    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018923    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018926    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018928    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018930    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018933    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018935    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018937    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018940    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 14:11:43.020233 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018942    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018945    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018947    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018950    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018952    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018955    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018957    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018961    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018964    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018967    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018970    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018973    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018976    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018978    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018981    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018983    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018985    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018988    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.018990    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 14:11:43.020723 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020447    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020454    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020457    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020460    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020463    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020466    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020469    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020473    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020477    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020480    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020482    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020485    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020487    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020490    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020494    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020497    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020499    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020502    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020505    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 14:11:43.021176 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020508    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020510    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020513    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020515    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020518    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020520    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020523    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020527    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020530    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020533    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020536    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020539    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020541    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020544    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020547    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020549    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020552    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020554    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020557    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020560    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 14:11:43.021703 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020562    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020566    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020569    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020572    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020575    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020577    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020580    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020583    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020586    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020588    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020591    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020593    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020596    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020599    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020601    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020604    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020606    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020609    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020611    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 14:11:43.022245 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020614    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020616    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020618    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020621    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020624    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020626    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020629    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020631    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020633    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020636    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020638    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020641    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020643    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020646    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020648    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020651    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020653    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020656    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020658    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020660    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 14:11:43.022724 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020663    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020665    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020668    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020670    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020674    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020693    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020696    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020699    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020701    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020704    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020708    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020710    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020713    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020715    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020718    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020720    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020723    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020726    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020728    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020731    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 14:11:43.023306 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.020733    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021119    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021124    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021126    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021129    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021133    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021136    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021138    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021141    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021143    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021145    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021148    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021151    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021153    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021156    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021159    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021162    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021164    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021167    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021169    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 14:11:43.023812 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021172    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021175    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021177    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021180    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021182    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021185    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021187    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021190    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021192    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021195    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021197    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021200    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021202    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021204    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021207    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021209    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021212    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021214    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021220    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021222    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 14:11:43.024288 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021224    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021228    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021232    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021235    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021238    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021241    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021245    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021249    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021253    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021256    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021259    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021262    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021264    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021267    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021270    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021272    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021274    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021277    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 14:11:43.024779 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021279    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021282    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021286    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021290    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021294    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021298    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021302    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021306    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021324    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021328    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021330    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021333    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021336    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021343    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021346    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021348    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021351    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021354    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021356    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021359    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 14:11:43.025211 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021361    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021364    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021368    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021370    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021374    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021377    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021380    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021383    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021386    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021388    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021391    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021393    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021396    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021398    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021401    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021403    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021405    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021408    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021410    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 14:11:43.025675 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021413    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021415    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.021418    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021489    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021496    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021504    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021508    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021513    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021516    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021521    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021525    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021528    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021530    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021534    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021537    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021540    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021542    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021545    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021548    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021550    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021553    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021558    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021560    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021563    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 03 14:11:43.026162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021566    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021569    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021573    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021575    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021579    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021582    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021585    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021587    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021591    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021594    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021597    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021601    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021604    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021606    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021609    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021612    2563 flags.go:64] FLAG: --enable-server="true"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021615    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021619    2563 flags.go:64] FLAG: --event-burst="100"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021622    2563 flags.go:64] FLAG: --event-qps="50"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021625    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021628    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021631    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021634    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021637    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021640    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 03 14:11:43.026747 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021643    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021646    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021649    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021651    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021654    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021657    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021660    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021663    2563 flags.go:64] FLAG: --feature-gates=""
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021666    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021669    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021672    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021675    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021697    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021702    2563 flags.go:64] FLAG: --help="false"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021706    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021709    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021712    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021715    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021718    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021722    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021724    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021727    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021730    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 03 14:11:43.027332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021732    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021735    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021739    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021741    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021744    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021746    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021749    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021752    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021754    2563 flags.go:64] FLAG: --lock-file=""
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021757    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021759    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021762    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021767    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021770    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021772    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021775    2563 flags.go:64] FLAG: --logging-format="text"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021777    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021780    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021783    2563 flags.go:64] FLAG: --manifest-url=""
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021785    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021792    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021795    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021799    2563 flags.go:64] FLAG: --max-pods="110"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021801    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021804    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 03 14:11:43.027963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021807    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021810    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021812    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021815    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021818    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021824    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021827    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021830    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021833    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021837    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021843    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021846    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021849    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021852    2563 flags.go:64] FLAG: --port="10250"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021854    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021857    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d6d17bbd5ce541e"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021860    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021863    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021865    2563 flags.go:64] FLAG: --register-node="true"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021868    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021871    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021874    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021877    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021879    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021883    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 03 14:11:43.028603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021886    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021888    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021892    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021904    2563 flags.go:64] FLAG: --runonce="false"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021908    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021911    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021914    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021919    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021921    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021924    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021927    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021930    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021933    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021936    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021938    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021941    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021944    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021948    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021951    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021956    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021958    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021961    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021966    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021968    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021971    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 03 14:11:43.029219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021974    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021977    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021980    2563 flags.go:64] FLAG: --v="2"
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021983    2563 flags.go:64] FLAG: --version="false"
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021987    2563 flags.go:64] FLAG: --vmodule=""
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021990    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.021993    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022107    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022111    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022116    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022118    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022121    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022123    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022126    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022129    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022132    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022134    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022137    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022139    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022142    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022144    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022146    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 14:11:43.029846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022150    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022152    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022155    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022158    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022160    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022163    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022167    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022170    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022173    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022175    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022178    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022181    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022183    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022186    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022188    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022191    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022193    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022196    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022198    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 14:11:43.030374 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022201    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022204    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022206    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022209    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022211    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022215    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022217    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022220    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022222    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022225    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022227    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022229    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022232    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022234    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022237    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022239    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022241    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022244    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022247    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022250    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 14:11:43.030875 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022252    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022255    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022259    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022263    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022266    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022269    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022271    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022274    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022277    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022279    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022282    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022284    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022288    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022291    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022296    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022299    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022302    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022306    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022309    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 14:11:43.031399 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022312    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022315    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022317    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022320    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022322    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022325    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022328    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022330    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022333    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022335    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022338    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022340    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022343    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022346    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022348    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022350    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022353    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022355    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022358    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022360    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 14:11:43.031865 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022362    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022365    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022367    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022370    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022372    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.022376    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.022929    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.029577    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.029591    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.030194    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.030203    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030259    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030264    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030267    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 14:11:43.032345 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030270    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030273    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030277    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030279    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030282    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030285    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030287    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030290    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030293    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030295    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030298    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030300    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030303    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030305    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030308    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030310    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030313    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030315    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030317    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030320    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030323    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 14:11:43.032712 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030325    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030328    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030331    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030333    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030336    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030340    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030343    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030346    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030348    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030351    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030353    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030356    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030358    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030361    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030363    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030365    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030367    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030370    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030372    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030375    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 14:11:43.033250 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030378    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030380    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030383    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030386    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030388    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030390    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030393    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030395    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030397    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030400    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030402    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030405    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030407    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030410    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030412    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030415    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030417    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030421    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030424    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 14:11:43.033771 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030427    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030429    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030431    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030434    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030436    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030439    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030441    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030445    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030448    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030452    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030456    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030459    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030462    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030465    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030468    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030471    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030474    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030477    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030480    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 14:11:43.034235 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030483    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030486    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030488    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030491    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030493    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030496    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030498    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030501    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030504    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030506    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030509    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030512    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030515    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030518    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030521    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030524    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 14:11:43.034846 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030526    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.030532    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030643    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030647    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030650    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030652    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030655    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030657    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030660    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030662    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030664    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030667    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030669    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030672    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030674    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 14:11:43.035246 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030691    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030696    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030700    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030702    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030705    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030708    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030711    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030713    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030716    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030718    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030721    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030723    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030727    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030731    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030734    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030737    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030740    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030743    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030746    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030748    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 14:11:43.035626 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030750    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030753    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030755    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030758    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030760    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030763    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030765    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030767    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030770    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030772    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030775    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030777    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030779    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030782    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030784    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030788    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030791    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030794    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030796    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 14:11:43.036112 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030799    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030801    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030804    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030806    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030808    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030811    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030814    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030817    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030819    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030822    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030824    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030827    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030829    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030833    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030836    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030838    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030841    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030843    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030846    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 14:11:43.036562 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030849    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030851    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030853    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030856    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030858    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030861    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030863    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030865    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030868    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030870    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030872    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030875    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030877    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030879    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030882    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030884    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030887    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030890    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030893    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030895    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 14:11:43.037052 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030898    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030900    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030903    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030906    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030908    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030910    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030913    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:43.030915    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.030920    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.031024    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.033046    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.034392    2563 server.go:1019] "Starting client certificate rotation"
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.034493    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.034551    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 14:11:43.037524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.037052    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 14:11:43.042619 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.042595    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 14:11:43.053204 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.053183    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 03 14:11:43.055318 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.055303    2563 log.go:25] "Validated CRI v1 image API"
Jul 03 14:11:43.056153 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.056138    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 03 14:11:43.058458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.058439    2563 fs.go:135] Filesystem UUIDs: map[0cf88133-4719-48de-a9ef-a46c84d2f2bd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9f61528a-8d6c-4866-a0bd-6b4914fdd75e:/dev/nvme0n1p4]
Jul 03 14:11:43.058515 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.058458    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 03 14:11:43.063395 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.063289    2563 manager.go:216] Machine: {Timestamp:2026-07-03 14:11:43.062046411 +0000 UTC m=+0.310703503 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103473 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ad1345aac6ddbf6759bee6adf36f SystemUUID:ec28ad13-45aa-c6dd-bf67-59bee6adf36f BootID:b3c60391-841c-4234-a55c-a70d1a6647bc Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:7b:43:28:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:7b:43:28:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:85:13:f0:d5:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 03 14:11:43.063395 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.063391    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 03 14:11:43.063493 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.063472    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 03 14:11:43.067176 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.067153    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 03 14:11:43.067318 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.067180    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 03 14:11:43.067910 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.067901    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 03 14:11:43.067947 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.067912    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 03 14:11:43.067947 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.067919    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 14:11:43.068573 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.068564    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 14:11:43.069880 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.069871    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 03 14:11:43.072552 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.072541    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 14:11:43.072664 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.072654    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 03 14:11:43.073280 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073271    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 03 14:11:43.073326 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073283    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 03 14:11:43.073326 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073302    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 03 14:11:43.073326 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073314    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 03 14:11:43.073326 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073322    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 03 14:11:43.073650 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073639    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 14:11:43.073704 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.073660    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 14:11:43.076002 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.075986    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 03 14:11:43.077449 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.077433    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 14:11:43.078898 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.078879    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 03 14:11:43.078963 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.078915    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 03 14:11:43.080100 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080085    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080109    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080115    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080122    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080130    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080135    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080154    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 03 14:11:43.080158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080159    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 03 14:11:43.080341 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080165    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 03 14:11:43.080341 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080170    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 03 14:11:43.080341 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080182    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 03 14:11:43.080341 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.080188    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 03 14:11:43.081646 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.081633    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 03 14:11:43.081646 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.081643    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 03 14:11:43.085141 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.085119    2563 server.go:1268] "Started kubelet"
Jul 03 14:11:43.085453 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.085399    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 03 14:11:43.085499 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.085489    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 03 14:11:43.086256 ip-10-0-141-67 systemd[1]: Started Kubernetes Kubelet.
Jul 03 14:11:43.086426 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.086399    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 03 14:11:43.088991 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.088974    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 03 14:11:43.090059 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.090040    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 03 14:11:43.090856 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.090830    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 03 14:11:43.090856 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.090839    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 03 14:11:43.092286 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.092270    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 03 14:11:43.092570 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.092553    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 03 14:11:43.095114 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.094318    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-67.ec2.internal.18becd002aae90ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-67.ec2.internal,UID:ip-10-0-141-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-67.ec2.internal,},FirstTimestamp:2026-07-03 14:11:43.085072557 +0000 UTC m=+0.333729651,LastTimestamp:2026-07-03 14:11:43.085072557 +0000 UTC m=+0.333729651,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-67.ec2.internal,}"
Jul 03 14:11:43.097466 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.097448    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 03 14:11:43.097556 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.097453    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 03 14:11:43.097721 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.097705    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.099013 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.098996    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099014    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099030    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099033    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099047    2563 factory.go:55] Registering systemd factory
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099057    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099097    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 03 14:11:43.099103 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099105    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 03 14:11:43.099437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099237    2563 factory.go:153] Registering CRI-O factory
Jul 03 14:11:43.099437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099250    2563 factory.go:223] Registration of the crio container factory successfully
Jul 03 14:11:43.099437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099270    2563 factory.go:103] Registering Raw factory
Jul 03 14:11:43.099437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099283    2563 manager.go:1196] Started watching for new ooms in manager
Jul 03 14:11:43.099672 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.099658    2563 manager.go:349] Starting recovery of all containers
Jul 03 14:11:43.105078 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.104815    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 03 14:11:43.105161 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.105137    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 03 14:11:43.110022 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.110007    2563 manager.go:354] Recovery completed
Jul 03 14:11:43.114094 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.114080    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.115903 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.115886    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.115965 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.115918    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.115965 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.115930    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.116468 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.116457    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 03 14:11:43.116468 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.116468    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 03 14:11:43.116584 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.116486    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 14:11:43.116584 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.116461    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.117331 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.117317    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.117399 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.117348    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.117399 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.117365    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.117874 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.117862    2563 policy_none.go:49] "None policy: Start"
Jul 03 14:11:43.117937 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.117877    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 03 14:11:43.117937 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.117887    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 03 14:11:43.118968 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.118956    2563 policy_none.go:47] "Start"
Jul 03 14:11:43.121421 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.121358    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-67.ec2.internal.18becd002c84ffe7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-67.ec2.internal,UID:ip-10-0-141-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-67.ec2.internal,},FirstTimestamp:2026-07-03 14:11:43.115902951 +0000 UTC m=+0.364560041,LastTimestamp:2026-07-03 14:11:43.115902951 +0000 UTC m=+0.364560041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-67.ec2.internal,}"
Jul 03 14:11:43.138257 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.138131    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-67.ec2.internal.18becd002c85533b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-67.ec2.internal,UID:ip-10-0-141-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-67.ec2.internal,},FirstTimestamp:2026-07-03 14:11:43.115924283 +0000 UTC m=+0.364581373,LastTimestamp:2026-07-03 14:11:43.115924283 +0000 UTC m=+0.364581373,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-67.ec2.internal,}"
Jul 03 14:11:43.152976 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.152914    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-67.ec2.internal.18becd002c857aed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-67.ec2.internal,UID:ip-10-0-141-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-67.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-67.ec2.internal,},FirstTimestamp:2026-07-03 14:11:43.115934445 +0000 UTC m=+0.364591535,LastTimestamp:2026-07-03 14:11:43.115934445 +0000 UTC m=+0.364591535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-67.ec2.internal,}"
Jul 03 14:11:43.153087 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.153073    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-crgbv"
Jul 03 14:11:43.157200 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157188    2563 manager.go:337] "Starting Device Plugin manager"
Jul 03 14:11:43.157248 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.157218    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 03 14:11:43.157248 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157227    2563 server.go:87] "Starting device plugin registration server"
Jul 03 14:11:43.157486 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157476    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 03 14:11:43.157537 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157488    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 03 14:11:43.157592 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157578    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 03 14:11:43.157707 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157657    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 03 14:11:43.157707 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.157666    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 03 14:11:43.158165 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.158146    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 03 14:11:43.158218 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.158193    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.166400 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.166384    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-crgbv"
Jul 03 14:11:43.169579 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.169518    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-67.ec2.internal.18becd002c84ffe7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-67.ec2.internal.18becd002c84ffe7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-67.ec2.internal,UID:ip-10-0-141-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-67.ec2.internal,},FirstTimestamp:2026-07-03 14:11:43.115902951 +0000 UTC m=+0.364560041,LastTimestamp:2026-07-03 14:11:43.117332055 +0000 UTC m=+0.365989148,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-67.ec2.internal,}"
Jul 03 14:11:43.257738 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.257707    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.258958 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.258819    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.258958 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.258849    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.258958 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.258860    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.258958 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.258892    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.272246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.272201    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.272246 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.272222    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-67.ec2.internal\": node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.294375 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.294351    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.306460 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.306433    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 03 14:11:43.307705 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.307675    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 03 14:11:43.307763 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.307725    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 03 14:11:43.307763 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.307744    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 03 14:11:43.307827 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.307778    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 03 14:11:43.310639 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.310623    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 14:11:43.395113 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.395067    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.408575 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.408533    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"]
Jul 03 14:11:43.408657 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.408626    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.410805 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.410787    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.410902 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.410818    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.410902 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.410832    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.412047 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412034    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.412158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.412206 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412185    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.412841 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412825    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.412923 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412852    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.412923 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412861    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.412923 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412829    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.412923 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412889    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.412923 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.412904    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.414046 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.414031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.414113 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.414056    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:43.415105 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.415087    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:43.415198 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.415115    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:43.415198 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.415124    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:43.439244 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.439225    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-67.ec2.internal\" not found" node="ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.443672 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.443658    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-67.ec2.internal\" not found" node="ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.495870 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.495839    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.501291 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.501277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c61046d56153777361652a1f97e34e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal\" (UID: \"4c61046d56153777361652a1f97e34e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.501376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.501300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c61046d56153777361652a1f97e34e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal\" (UID: \"4c61046d56153777361652a1f97e34e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.501376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.501315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ef37ef919386f7b59fdf6ff33e8d16a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-67.ec2.internal\" (UID: \"7ef37ef919386f7b59fdf6ff33e8d16a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.596212 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.596126    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.601560 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.601530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ef37ef919386f7b59fdf6ff33e8d16a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-67.ec2.internal\" (UID: \"7ef37ef919386f7b59fdf6ff33e8d16a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.601670 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.601576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c61046d56153777361652a1f97e34e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal\" (UID: \"4c61046d56153777361652a1f97e34e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.601670 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.601598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c61046d56153777361652a1f97e34e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal\" (UID: \"4c61046d56153777361652a1f97e34e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.601670 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.601605    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ef37ef919386f7b59fdf6ff33e8d16a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-67.ec2.internal\" (UID: \"7ef37ef919386f7b59fdf6ff33e8d16a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.601670 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.601661    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c61046d56153777361652a1f97e34e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal\" (UID: \"4c61046d56153777361652a1f97e34e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.601836 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.601675    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c61046d56153777361652a1f97e34e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal\" (UID: \"4c61046d56153777361652a1f97e34e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.696753 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.696720    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.743309 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.743284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.747155 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:43.746979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:43.797529 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.797493    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:43.898093 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:43.898018    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.001270 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.001232    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.033779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.033738    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 03 14:11:44.034285 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.033922    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 14:11:44.102115 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.102081    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.146148 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.146111    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 14:11:44.169205 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.169133    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 14:06:43 +0000 UTC" deadline="2028-02-09 00:59:22.713852965 +0000 UTC"
Jul 03 14:11:44.169205 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.169165    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14050h47m38.544690726s"
Jul 03 14:11:44.202184 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.202158    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.289892 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.289839    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 14:11:44.291136 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.291111    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 14:11:44.291267 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.291152    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 14:11:44.291267 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.291174    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeHasSufficientPID"
Jul 03 14:11:44.302252 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.302223    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.361218 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:44.361175    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c61046d56153777361652a1f97e34e2.slice/crio-9f2dfec47d58f5cc82ba061aa96c1ecfae1f23c7fe49784b938614d9cabcd668 WatchSource:0}: Error finding container 9f2dfec47d58f5cc82ba061aa96c1ecfae1f23c7fe49784b938614d9cabcd668: Status 404 returned error can't find the container with id 9f2dfec47d58f5cc82ba061aa96c1ecfae1f23c7fe49784b938614d9cabcd668
Jul 03 14:11:44.361740 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:44.361715    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef37ef919386f7b59fdf6ff33e8d16a.slice/crio-ed2ac193f1d0ac50cb0a9fbecaaac217d9b61b9da1fdd8c83ccb7e7d39698bc0 WatchSource:0}: Error finding container ed2ac193f1d0ac50cb0a9fbecaaac217d9b61b9da1fdd8c83ccb7e7d39698bc0: Status 404 returned error can't find the container with id ed2ac193f1d0ac50cb0a9fbecaaac217d9b61b9da1fdd8c83ccb7e7d39698bc0
Jul 03 14:11:44.368559 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.367060    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 14:11:44.403075 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.403051    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.505181 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.505074    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.605457 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:44.605428    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-67.ec2.internal\" not found"
Jul 03 14:11:44.616752 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.616731    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 14:11:44.618592 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.618575    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 14:11:44.702378 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.702355    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:44.716790 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.716765    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 14:11:44.717834 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.717821    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal"
Jul 03 14:11:44.726293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:44.726269    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 14:11:45.076297 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.076265    2563 apiserver.go:52] "Watching apiserver"
Jul 03 14:11:45.084859 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.084822    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 03 14:11:45.085303 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.085279    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xrhgh","kube-system/global-pull-secret-syncer-85cpn","kube-system/konnectivity-agent-p5jgp","kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh","openshift-dns/node-resolver-fb6nj","openshift-image-registry/node-ca-l447z","openshift-multus/multus-additional-cni-plugins-ff8pz","openshift-network-diagnostics/network-check-target-85mvb","openshift-cluster-node-tuning-operator/tuned-bsqcg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal","openshift-multus/multus-djjvn","openshift-multus/network-metrics-daemon-j7tnq","openshift-network-operator/iptables-alerter-x7ffn"]
Jul 03 14:11:45.086938 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.086916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.088172 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.088148    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.088267 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.088241    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:45.090235 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.089735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.090235 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.090216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lzg6r\""
Jul 03 14:11:45.090457 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.090217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.090733 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.090711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.091287 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.091249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.092924 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.092341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.094277 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.094254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.096414 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.095687    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 03 14:11:45.096414 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.095933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4xjvt\""
Jul 03 14:11:45.096414 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.096141    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 03 14:11:45.097298 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.097277    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.097392 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.097315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:45.097392 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.097373    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:45.097502 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.097484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.097562 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.097546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zw47q\""
Jul 03 14:11:45.097899 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.097880    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.098187 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098170    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.098429 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.098519 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098436    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 03 14:11:45.098519 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098456    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 03 14:11:45.098671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.098733 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-49vwk\""
Jul 03 14:11:45.098983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 03 14:11:45.098983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.098970    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.099171 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.099153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngkqf\""
Jul 03 14:11:45.100235 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.100205    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.100313 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.100285    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.100313 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.100285    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:45.100464 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.100446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5qpf\""
Jul 03 14:11:45.100812 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.100796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.101428 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.101404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.104779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.104736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.105319 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.105298    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.105693 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.105645    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 03 14:11:45.106338 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.106294    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.106512 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.106496    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 03 14:11:45.106739 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.106719    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 03 14:11:45.106868 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.106850    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 03 14:11:45.107015 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.106995    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.107162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.107137    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fqws6\""
Jul 03 14:11:45.107282 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.107232    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 03 14:11:45.107389 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.107372    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 03 14:11:45.108813 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.108775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-log-socket\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.108910 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.108826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.108910 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.108871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-var-lib-kubelet\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.108910 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.108899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df0e63b0-433d-4ffd-b9ba-0f6b64967782-serviceca\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.109096 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.108990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.109096 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-env-overrides\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.109096 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cnibin\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.109243 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-kubernetes\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.109243 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt596\" (UniqueName: \"kubernetes.io/projected/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-kube-api-access-wt596\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.109243 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-registration-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.109396 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-cni-netd\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.109396 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-kubelet-config\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.109396 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.109542 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vftfg\" (UniqueName: \"kubernetes.io/projected/8bab6480-0d48-49fe-ba58-0cfc775d06ba-kube-api-access-vftfg\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.109542 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-socket-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.109652 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-run-netns\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.109652 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovnkube-config\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.109652 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44949a0d-e604-4629-b854-71259296df52-konnectivity-ca\") pod \"konnectivity-agent-p5jgp\" (UID: \"44949a0d-e604-4629-b854-71259296df52\") " pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.109824 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4m4m\" (UniqueName: \"kubernetes.io/projected/bc899a7d-5212-4384-a014-65fdb5cfe509-kube-api-access-s4m4m\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.109824 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-systemd\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.109824 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-cni-bin\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.109824 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovnkube-script-lib\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.109937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmck\" (UniqueName: \"kubernetes.io/projected/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-kube-api-access-8wmck\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110090 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-tmp\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.110090 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9q6t\" (UniqueName: \"kubernetes.io/projected/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-kube-api-access-z9q6t\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.110188 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-systemd-units\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110242 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110297 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.110354 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysctl-d\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.110354 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-iptables-alerter-script\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.110460 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2t5\" (UniqueName: \"kubernetes.io/projected/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-kube-api-access-6v2t5\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.110511 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-sys-fs\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.110568 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-kubelet\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110625 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-var-lib-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110625 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-ovn\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.110725 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-host\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.110725 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-dbus\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.110725 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysconfig\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.110899 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-lib-modules\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.110899 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.110899 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc899a7d-5212-4384-a014-65fdb5cfe509-hosts-file\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.110899 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-node-log\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.111046 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.111046 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-etc-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.111046 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.110986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-modprobe-d\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.111046 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111041    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 03 14:11:45.111269 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-run\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.111269 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4c9\" (UniqueName: \"kubernetes.io/projected/df0e63b0-433d-4ffd-b9ba-0f6b64967782-kube-api-access-nt4c9\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.111269 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovn-node-metrics-cert\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.111269 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df0e63b0-433d-4ffd-b9ba-0f6b64967782-host\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.111269 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-slash\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.111488 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-system-cni-dir\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.111488 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-sys\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.111567 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-host-slash\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.111616 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysctl-conf\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44949a0d-e604-4629-b854-71259296df52-agent-certs\") pod \"konnectivity-agent-p5jgp\" (UID: \"44949a0d-e604-4629-b854-71259296df52\") " pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-device-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.111984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwss\" (UniqueName: \"kubernetes.io/projected/70a13008-f1cf-4f18-8c0a-914c05c2833b-kube-api-access-dmwss\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.112014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-os-release\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.112095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-systemd\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.112145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-tuned\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.112293 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.112181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc899a7d-5212-4384-a014-65fdb5cfe509-tmp-dir\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.116421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.113784    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 03 14:11:45.116421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.113989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vn8dl\""
Jul 03 14:11:45.116421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.115364    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 03 14:11:45.116421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.115613    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vlvrd\""
Jul 03 14:11:45.117227 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.116949    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 03 14:11:45.118380 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.118009    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 03 14:11:45.120281 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.120258    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 14:11:45.144730 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.144709    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6p2s"
Jul 03 14:11:45.154164 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.154141    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6p2s"
Jul 03 14:11:45.200454 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.200428    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.212851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysctl-d\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.212903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-iptables-alerter-script\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.212948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2t5\" (UniqueName: \"kubernetes.io/projected/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-kube-api-access-6v2t5\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.212978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-sys-fs\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-kubelet\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-var-lib-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysctl-d\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-ovn\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-host\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-ovn\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-dbus\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-k8s-cni-cncf-io\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysconfig\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-lib-modules\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc899a7d-5212-4384-a014-65fdb5cfe509-hosts-file\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.214407 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-node-log\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-socket-dir-parent\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-etc-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32b3a7b4-fa2f-419b-8112-3ec5d147d916-cni-binary-copy\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-hostroot\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-modprobe-d\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-iptables-alerter-script\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213546    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-sys-fs\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-run\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213597    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-host\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213601    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-kubelet\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4c9\" (UniqueName: \"kubernetes.io/projected/df0e63b0-433d-4ffd-b9ba-0f6b64967782-kube-api-access-nt4c9\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213648    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-var-lib-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovn-node-metrics-cert\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-conf-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-etc-kubernetes\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.215505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df0e63b0-433d-4ffd-b9ba-0f6b64967782-host\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-slash\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-multus-certs\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213851    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-slash\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-system-cni-dir\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-dbus\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-run\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213899    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-modprobe-d\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213917    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysconfig\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213976    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc899a7d-5212-4384-a014-65fdb5cfe509-hosts-file\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-etc-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214012    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-lib-modules\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.213701    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-node-log\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-sys\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214072    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df0e63b0-433d-4ffd-b9ba-0f6b64967782-host\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214080    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-sys\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.214107    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:45.216361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-host-slash\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214154    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-system-cni-dir\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-host-slash\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.214190    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:45.714151118 +0000 UTC m=+2.962808203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214266    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-cni-multus\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214382    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214382    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysctl-conf\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44949a0d-e604-4629-b854-71259296df52-agent-certs\") pod \"konnectivity-agent-p5jgp\" (UID: \"44949a0d-e604-4629-b854-71259296df52\") " pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-device-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-sysctl-conf\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.217458 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-netns\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214724    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214790    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-device-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwss\" (UniqueName: \"kubernetes.io/projected/70a13008-f1cf-4f18-8c0a-914c05c2833b-kube-api-access-dmwss\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-os-release\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-systemd\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.214989    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-tuned\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc899a7d-5212-4384-a014-65fdb5cfe509-tmp-dir\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-log-socket\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-daemon-config\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-var-lib-kubelet\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df0e63b0-433d-4ffd-b9ba-0f6b64967782-serviceca\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-env-overrides\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.218306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-system-cni-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqd6t\" (UniqueName: \"kubernetes.io/projected/32b3a7b4-fa2f-419b-8112-3ec5d147d916-kube-api-access-kqd6t\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cnibin\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-kubernetes\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt596\" (UniqueName: \"kubernetes.io/projected/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-kube-api-access-wt596\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-registration-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-cni-netd\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-kubelet-config\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-os-release\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215734    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-systemd\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215778    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-log-socket\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215788    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-cni-netd\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215829    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-kubelet-config\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215834    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-var-lib-kubelet\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.215958    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216019    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bab6480-0d48-49fe-ba58-0cfc775d06ba-cnibin\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.219274 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc899a7d-5212-4384-a014-65fdb5cfe509-tmp-dir\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216269    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-env-overrides\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df0e63b0-433d-4ffd-b9ba-0f6b64967782-serviceca\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-os-release\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vftfg\" (UniqueName: \"kubernetes.io/projected/8bab6480-0d48-49fe-ba58-0cfc775d06ba-kube-api-access-vftfg\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.216494    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-socket-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.216551    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:11:45.716535165 +0000 UTC m=+2.965192267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-run-netns\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovnkube-config\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216563    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-registration-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216664    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-socket-dir\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216716    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-kubernetes\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216719    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-run-netns\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-cni-bin\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44949a0d-e604-4629-b854-71259296df52-konnectivity-ca\") pod \"konnectivity-agent-p5jgp\" (UID: \"44949a0d-e604-4629-b854-71259296df52\") " pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.220275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4m4m\" (UniqueName: \"kubernetes.io/projected/bc899a7d-5212-4384-a014-65fdb5cfe509-kube-api-access-s4m4m\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-systemd\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.216983    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-systemd\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-cni-bin\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217183    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovnkube-config\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovnkube-script-lib\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmck\" (UniqueName: \"kubernetes.io/projected/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-kube-api-access-8wmck\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-cni-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-tmp\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9q6t\" (UniqueName: \"kubernetes.io/projected/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-kube-api-access-z9q6t\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-systemd-units\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-cnibin\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-kubelet\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44949a0d-e604-4629-b854-71259296df52-konnectivity-ca\") pod \"konnectivity-agent-p5jgp\" (UID: \"44949a0d-e604-4629-b854-71259296df52\") " pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217575    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-systemd-units\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221178 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-run-openvswitch\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217787    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovnkube-script-lib\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.217970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-host-cni-bin\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.218117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bab6480-0d48-49fe-ba58-0cfc775d06ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.221935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.218622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-ovn-node-metrics-cert\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.221935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.218743    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44949a0d-e604-4629-b854-71259296df52-agent-certs\") pod \"konnectivity-agent-p5jgp\" (UID: \"44949a0d-e604-4629-b854-71259296df52\") " pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.221935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.219851    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-etc-tuned\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.224511 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.224483    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-tmp\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.224803 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.224732    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2t5\" (UniqueName: \"kubernetes.io/projected/341f434c-7bc4-4ebb-b51d-ea73c1d0e236-kube-api-access-6v2t5\") pod \"iptables-alerter-x7ffn\" (UID: \"341f434c-7bc4-4ebb-b51d-ea73c1d0e236\") " pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.226861 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.226836    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:11:45.226946 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.226868    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:11:45.226946 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.226882    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:45.226946 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.226939    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:45.726921036 +0000 UTC m=+2.975578119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:45.227282 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.227216    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4c9\" (UniqueName: \"kubernetes.io/projected/df0e63b0-433d-4ffd-b9ba-0f6b64967782-kube-api-access-nt4c9\") pod \"node-ca-l447z\" (UID: \"df0e63b0-433d-4ffd-b9ba-0f6b64967782\") " pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.229907 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.229698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vftfg\" (UniqueName: \"kubernetes.io/projected/8bab6480-0d48-49fe-ba58-0cfc775d06ba-kube-api-access-vftfg\") pod \"multus-additional-cni-plugins-ff8pz\" (UID: \"8bab6480-0d48-49fe-ba58-0cfc775d06ba\") " pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.230125 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.230081    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt596\" (UniqueName: \"kubernetes.io/projected/a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876-kube-api-access-wt596\") pod \"tuned-bsqcg\" (UID: \"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876\") " pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.230456 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.230435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4m4m\" (UniqueName: \"kubernetes.io/projected/bc899a7d-5212-4384-a014-65fdb5cfe509-kube-api-access-s4m4m\") pod \"node-resolver-fb6nj\" (UID: \"bc899a7d-5212-4384-a014-65fdb5cfe509\") " pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.231563 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.231541    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmck\" (UniqueName: \"kubernetes.io/projected/7bb89cd2-fca2-41e2-9d53-75cd1bd0763c-kube-api-access-8wmck\") pod \"ovnkube-node-xrhgh\" (UID: \"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.232892 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.232857    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwss\" (UniqueName: \"kubernetes.io/projected/70a13008-f1cf-4f18-8c0a-914c05c2833b-kube-api-access-dmwss\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.236671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.236645    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9q6t\" (UniqueName: \"kubernetes.io/projected/8d6f8530-eb15-4027-b57f-3b7e0a774c8c-kube-api-access-z9q6t\") pod \"aws-ebs-csi-driver-node-mjnsh\" (UID: \"8d6f8530-eb15-4027-b57f-3b7e0a774c8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.282744 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.282705    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 14:11:45.314218 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.314146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal" event={"ID":"4c61046d56153777361652a1f97e34e2","Type":"ContainerStarted","Data":"9f2dfec47d58f5cc82ba061aa96c1ecfae1f23c7fe49784b938614d9cabcd668"}
Jul 03 14:11:45.315951 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.315916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal" event={"ID":"7ef37ef919386f7b59fdf6ff33e8d16a","Type":"ContainerStarted","Data":"ed2ac193f1d0ac50cb0a9fbecaaac217d9b61b9da1fdd8c83ccb7e7d39698bc0"}
Jul 03 14:11:45.318296 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-kubelet\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-k8s-cni-cncf-io\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318485 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318414    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-kubelet\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318485 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-socket-dir-parent\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318590 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32b3a7b4-fa2f-419b-8112-3ec5d147d916-cni-binary-copy\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318590 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-hostroot\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318590 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-conf-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318590 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-etc-kubernetes\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-multus-certs\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-cni-multus\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-netns\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-daemon-config\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-system-cni-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqd6t\" (UniqueName: \"kubernetes.io/projected/32b3a7b4-fa2f-419b-8112-3ec5d147d916-kube-api-access-kqd6t\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.318833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-os-release\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319038 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-cni-bin\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319038 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-cni-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319038 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.318920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-cnibin\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319038 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-cnibin\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319204 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319053    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-k8s-cni-cncf-io\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319204 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319107    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-socket-dir-parent\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319270 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319248    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-netns\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319323 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-hostroot\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319371 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319357    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-conf-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319416 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319399    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-etc-kubernetes\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319456 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-run-multus-certs\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319512 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319492    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-cni-multus\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319712 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319693    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32b3a7b4-fa2f-419b-8112-3ec5d147d916-cni-binary-copy\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-os-release\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319879 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319870    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-host-var-lib-cni-bin\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.319984 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.319966    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-cni-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.320036 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.320021    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b3a7b4-fa2f-419b-8112-3ec5d147d916-system-cni-dir\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.320233 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.320214    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32b3a7b4-fa2f-419b-8112-3ec5d147d916-multus-daemon-config\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.330241 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.330177    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqd6t\" (UniqueName: \"kubernetes.io/projected/32b3a7b4-fa2f-419b-8112-3ec5d147d916-kube-api-access-kqd6t\") pod \"multus-djjvn\" (UID: \"32b3a7b4-fa2f-419b-8112-3ec5d147d916\") " pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.405240 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.405202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsqcg"
Jul 03 14:11:45.417060 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.417032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:11:45.418664 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:45.418637    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fd2d25_c8e6_4e36_96cb_3ebfbb3b8876.slice/crio-24aead0c9410c335c237fdc78040722dc5da1e94f5fd17760eb012a00a79f27b WatchSource:0}: Error finding container 24aead0c9410c335c237fdc78040722dc5da1e94f5fd17760eb012a00a79f27b: Status 404 returned error can't find the container with id 24aead0c9410c335c237fdc78040722dc5da1e94f5fd17760eb012a00a79f27b
Jul 03 14:11:45.429932 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.429846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7ffn"
Jul 03 14:11:45.436131 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.436113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh"
Jul 03 14:11:45.442902 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.442882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fb6nj"
Jul 03 14:11:45.451259 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.451086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l447z"
Jul 03 14:11:45.461433 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.461409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ff8pz"
Jul 03 14:11:45.469581 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.469562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:11:45.477644 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.477619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-djjvn"
Jul 03 14:11:45.722050 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.721952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:45.722050 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.722031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:45.722295 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.722137    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:45.722295 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.722153    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:45.722295 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.722213    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:46.722192804 +0000 UTC m=+3.970849882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:45.722295 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.722227    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:11:46.722220793 +0000 UTC m=+3.970877871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:45.823169 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:45.823138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:45.823320 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.823267    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:11:45.823320 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.823283    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:11:45.823320 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.823292    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:45.823420 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:45.823345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:46.82333002 +0000 UTC m=+4.071987099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:46.157793 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.157748    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 14:06:45 +0000 UTC" deadline="2028-04-01 00:52:55.75513946 +0000 UTC"
Jul 03 14:11:46.157793 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.157791    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15298h41m9.597353524s"
Jul 03 14:11:46.307997 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.307960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:46.308160 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.308079    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:46.319043 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.318995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsqcg" event={"ID":"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876","Type":"ContainerStarted","Data":"24aead0c9410c335c237fdc78040722dc5da1e94f5fd17760eb012a00a79f27b"}
Jul 03 14:11:46.485252 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:46.485162    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44949a0d_e604_4629_b854_71259296df52.slice/crio-4a60918f1d98e458c5499220bd40f2be9624ec05733d5bb703e337c2b2380fc0 WatchSource:0}: Error finding container 4a60918f1d98e458c5499220bd40f2be9624ec05733d5bb703e337c2b2380fc0: Status 404 returned error can't find the container with id 4a60918f1d98e458c5499220bd40f2be9624ec05733d5bb703e337c2b2380fc0
Jul 03 14:11:46.511825 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:46.511801    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341f434c_7bc4_4ebb_b51d_ea73c1d0e236.slice/crio-6740052a3a6af6aa2ea0f8e4ad082f949b11861a8a47b65e587cb51343fa5b1b WatchSource:0}: Error finding container 6740052a3a6af6aa2ea0f8e4ad082f949b11861a8a47b65e587cb51343fa5b1b: Status 404 returned error can't find the container with id 6740052a3a6af6aa2ea0f8e4ad082f949b11861a8a47b65e587cb51343fa5b1b
Jul 03 14:11:46.513092 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:46.513070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bab6480_0d48_49fe_ba58_0cfc775d06ba.slice/crio-74f2c58936707ec33e502c68879ca3a6a4b88ecf0ff3542c1b07e9ba914d2d59 WatchSource:0}: Error finding container 74f2c58936707ec33e502c68879ca3a6a4b88ecf0ff3542c1b07e9ba914d2d59: Status 404 returned error can't find the container with id 74f2c58936707ec33e502c68879ca3a6a4b88ecf0ff3542c1b07e9ba914d2d59
Jul 03 14:11:46.514947 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:11:46.514925    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6f8530_eb15_4027_b57f_3b7e0a774c8c.slice/crio-2df3be0706aaf48c2f2b686e719a0123ed501f05c6d3d009af6b9fe4ac19cd82 WatchSource:0}: Error finding container 2df3be0706aaf48c2f2b686e719a0123ed501f05c6d3d009af6b9fe4ac19cd82: Status 404 returned error can't find the container with id 2df3be0706aaf48c2f2b686e719a0123ed501f05c6d3d009af6b9fe4ac19cd82
Jul 03 14:11:46.732550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.732310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:46.732744 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.732489    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:46.732744 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.732628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:46.732744 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.732714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:48.732673748 +0000 UTC m=+5.981330829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:46.732942 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.732764    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:46.732942 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.732816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:11:48.732803849 +0000 UTC m=+5.981460927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:46.833911 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:46.833881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:46.834069 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.834048    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:11:46.834069 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.834072    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:11:46.834248 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.834083    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:46.834248 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:46.834137    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:48.834119543 +0000 UTC m=+6.082776632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:47.159832 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.158766    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 14:06:45 +0000 UTC" deadline="2028-02-15 16:40:27.241480216 +0000 UTC"
Jul 03 14:11:47.159832 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.158826    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14210h28m40.082658252s"
Jul 03 14:11:47.308525 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.308487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:47.308719 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:47.308646    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:47.309118 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.309095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:47.309241 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:47.309215    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:47.344960 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.344925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal" event={"ID":"7ef37ef919386f7b59fdf6ff33e8d16a","Type":"ContainerStarted","Data":"bc58b161c5c9ed0030415493591b176ec24a08c827bb988ed3b37b0f6b84c678"}
Jul 03 14:11:47.350077 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.349995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l447z" event={"ID":"df0e63b0-433d-4ffd-b9ba-0f6b64967782","Type":"ContainerStarted","Data":"74bef030fc048199310c579eebb1349c015caa91858162f99df110ba3118b0fd"}
Jul 03 14:11:47.394098 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.393831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-djjvn" event={"ID":"32b3a7b4-fa2f-419b-8112-3ec5d147d916","Type":"ContainerStarted","Data":"e4f2e362a10309511e7c8590ec33d38254e0a2800374786f4effe13d349d6920"}
Jul 03 14:11:47.413695 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.413586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fb6nj" event={"ID":"bc899a7d-5212-4384-a014-65fdb5cfe509","Type":"ContainerStarted","Data":"63e7d05bd2d7e5de5cdf34321f88555e698a7ede2b643db43115f7d3ee04b552"}
Jul 03 14:11:47.426056 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.423645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7ffn" event={"ID":"341f434c-7bc4-4ebb-b51d-ea73c1d0e236","Type":"ContainerStarted","Data":"6740052a3a6af6aa2ea0f8e4ad082f949b11861a8a47b65e587cb51343fa5b1b"}
Jul 03 14:11:47.426056 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.425502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p5jgp" event={"ID":"44949a0d-e604-4629-b854-71259296df52","Type":"ContainerStarted","Data":"4a60918f1d98e458c5499220bd40f2be9624ec05733d5bb703e337c2b2380fc0"}
Jul 03 14:11:47.441009 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.440866    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c61046d56153777361652a1f97e34e2" containerID="4b4780e23f74e8d86daa9643da4f02c1abe5061ecbd770d76d2087892e1dc3b6" exitCode=0
Jul 03 14:11:47.441009 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.440957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal" event={"ID":"4c61046d56153777361652a1f97e34e2","Type":"ContainerDied","Data":"4b4780e23f74e8d86daa9643da4f02c1abe5061ecbd770d76d2087892e1dc3b6"}
Jul 03 14:11:47.457041 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.457003    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"6444171b359e775bbcb12cdaf4ee8b271eac0c612999b5532c19355f65b8095b"}
Jul 03 14:11:47.472918 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.472861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerStarted","Data":"74f2c58936707ec33e502c68879ca3a6a4b88ecf0ff3542c1b07e9ba914d2d59"}
Jul 03 14:11:47.474056 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.474001    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-67.ec2.internal" podStartSLOduration=2.473982491 podStartE2EDuration="2.473982491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:47.363079346 +0000 UTC m=+4.611736450" watchObservedRunningTime="2026-07-03 14:11:47.473982491 +0000 UTC m=+4.722639595"
Jul 03 14:11:47.493294 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:47.493133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh" event={"ID":"8d6f8530-eb15-4027-b57f-3b7e0a774c8c","Type":"ContainerStarted","Data":"2df3be0706aaf48c2f2b686e719a0123ed501f05c6d3d009af6b9fe4ac19cd82"}
Jul 03 14:11:48.308797 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:48.308763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:48.309263 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.308971    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:48.510845 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:48.510809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal" event={"ID":"4c61046d56153777361652a1f97e34e2","Type":"ContainerStarted","Data":"1cd9b2e09478d4468e63ef6bafdd1407657b50b8f4e20f55f334b70b85bf18bf"}
Jul 03 14:11:48.759959 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:48.759001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:48.759959 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.759218    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:48.759959 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:48.759608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:48.759959 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.759712    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:11:52.759691956 +0000 UTC m=+10.008349048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:48.759959 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.759732    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:48.759959 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.759799    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:52.759786243 +0000 UTC m=+10.008443346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:48.860922 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:48.860883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:48.861110 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.861049    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:11:48.861110 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.861067    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:11:48.861110 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.861082    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:48.861275 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:48.861142    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:52.861122561 +0000 UTC m=+10.109779643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:49.308012 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:49.307970    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:49.308231 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:49.308118    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:49.308544 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:49.308522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:49.308668 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:49.308621    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:50.308692 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:50.308657    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:50.309170 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:50.308811    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:51.312957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:51.312743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:51.312957 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:51.312870    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:51.312957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:51.312935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:51.313497 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:51.313001    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:52.308182 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:52.308154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:52.308331 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.308247    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:52.791479 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:52.790732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:52.791479 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:52.790807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:52.791479 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.790947    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:52.791479 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.791003    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:12:00.790988941 +0000 UTC m=+18.039646018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:11:52.791479 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.791346    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:52.791479 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.791392    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:12:00.791377697 +0000 UTC m=+18.040034779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:11:52.891983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:52.891948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:52.892161 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.892128    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:11:52.892161 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.892149    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:11:52.892240 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.892163    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:52.892240 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:52.892218    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:00.892203607 +0000 UTC m=+18.140860683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:11:53.311361 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:53.311334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:53.311532 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:53.311461    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:53.311606 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:53.311544    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:53.311705 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:53.311671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:54.308731 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:54.308271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:54.308731 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:54.308394    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:55.312605 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:55.312101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:55.312605 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:55.312212    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:55.312605 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:55.312503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:55.312605 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:55.312571    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:56.308432 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:56.308401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:56.308593 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:56.308522    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:57.311742 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:57.311710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:57.312124 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:57.311758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:57.312124 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:57.311848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:11:57.312124 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:57.311969    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:58.308376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:58.308340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:11:58.308549 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:58.308470    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:11:59.308921 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:59.308886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:11:59.309347 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:59.309027    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:11:59.309447 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:11:59.309431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:11:59.309598 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:11:59.309573    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:00.308263 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:00.308228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:00.308436 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.308349    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:00.849446 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:00.849414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:00.849851 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:00.849459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:00.849851 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.849547    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:12:00.849851 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.849551    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:12:00.849851 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.849612    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:12:16.849591913 +0000 UTC m=+34.098249004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:12:00.849851 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.849629    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:12:16.849622176 +0000 UTC m=+34.098279253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:12:00.950108 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:00.950066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:00.950280 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.950243    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:12:00.950280 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.950267    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:12:00.950280 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.950279    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:12:00.950421 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:00.950343    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:16.950323323 +0000 UTC m=+34.198980403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:12:01.308117 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:01.308020    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:01.308117 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:01.308067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:01.308318 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:01.308159    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:01.308444 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:01.308304    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:02.308362 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:02.308328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:02.308765 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:02.308443    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:03.308841 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:03.308806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:03.309271 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:03.308913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:03.309271 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:03.309084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:03.309271 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:03.309206    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:04.308525 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:04.308489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:04.308714 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:04.308607    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:05.308186 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:05.308152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:05.308671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:05.308152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:05.308671 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:05.308268    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:05.308671 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:05.308321    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:05.555189 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:05.554979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsqcg" event={"ID":"a9fd2d25-c8e6-4e36-96cb-3ebfbb3b8876","Type":"ContainerStarted","Data":"d5bfd8c3e4fab6409a6ddb11f0fb553a6dca631ec00a02656a393aa4796f128c"}
Jul 03 14:12:05.556837 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:05.556807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p5jgp" event={"ID":"44949a0d-e604-4629-b854-71259296df52","Type":"ContainerStarted","Data":"ba175ea45d6ba499491f080bb922e2f48d595ea36b41b35c9d34eb8f7fc7d2c8"}
Jul 03 14:12:05.578602 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:05.577967    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bsqcg" podStartSLOduration=2.656971076 podStartE2EDuration="22.577947844s" totalImagesPullingTime="19.920976768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:05.577109253 +0000 UTC m=+22.825766353" watchObservedRunningTime="2026-07-03 14:12:05.577947844 +0000 UTC m=+22.826604944"
Jul 03 14:12:05.578602 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:05.578104    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-67.ec2.internal" podStartSLOduration=20.578097552 podStartE2EDuration="20.578097552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:48.532779231 +0000 UTC m=+5.781436330" watchObservedRunningTime="2026-07-03 14:12:05.578097552 +0000 UTC m=+22.826754652"
Jul 03 14:12:06.173064 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.172739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:12:06.173529 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.173507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:12:06.194723 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.194661    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p5jgp" podStartSLOduration=4.348122132 podStartE2EDuration="23.194642875s" totalImagesPullingTime="18.846520743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:05.602081684 +0000 UTC m=+22.850738784" watchObservedRunningTime="2026-07-03 14:12:06.194642875 +0000 UTC m=+23.443300000"
Jul 03 14:12:06.308460 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.308423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:06.309331 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:06.308572    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:06.561247 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561171    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:12:06.561526 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561506    2563 generic.go:356] "Generic (PLEG): container finished" podID="7bb89cd2-fca2-41e2-9d53-75cd1bd0763c" containerID="afcfaaa6863d9e637b1c5361f7634d36fa4ea7f52de15b6ed9c9e2c5b797a938" exitCode=1
Jul 03 14:12:06.561593 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561571    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"5a24f62838e3b3ea018c92687f0764a79e1f6e7804940d7a3e857f862bfdddb0"}
Jul 03 14:12:06.561652 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"ba55f007fb39f03239684043b39dcaaa760a24e949bf465dd832653e4ae25a08"}
Jul 03 14:12:06.561726 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"301085cb6c27cc64b2c11cb9e038ef97241df092acf9d009fa24bd668dc5ff15"}
Jul 03 14:12:06.561759 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"077290708f92fc938a4b141950126af962fd0bee1c315abb6174b3874203c84c"}
Jul 03 14:12:06.561797 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerDied","Data":"afcfaaa6863d9e637b1c5361f7634d36fa4ea7f52de15b6ed9c9e2c5b797a938"}
Jul 03 14:12:06.561844 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.561815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"38739e970afbaafafc05eda541b0215e908ea0ddc94be72bb06e880c38d77a33"}
Jul 03 14:12:06.563001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.562979    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bab6480-0d48-49fe-ba58-0cfc775d06ba" containerID="41f30851fd9de2e86c27646f897049a4f981387d097c04c45e423eb34eb7718f" exitCode=0
Jul 03 14:12:06.563107 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.563044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerDied","Data":"41f30851fd9de2e86c27646f897049a4f981387d097c04c45e423eb34eb7718f"}
Jul 03 14:12:06.564556 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.564534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh" event={"ID":"8d6f8530-eb15-4027-b57f-3b7e0a774c8c","Type":"ContainerStarted","Data":"28fed7a86dc1638388630bace6c3f32d598b4bdbf4a56a1f7de563c495e2e601"}
Jul 03 14:12:06.565915 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.565895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l447z" event={"ID":"df0e63b0-433d-4ffd-b9ba-0f6b64967782","Type":"ContainerStarted","Data":"c7a8629f21dd5f7babb737e25fe117748470772ca105148d73bfa3e01cdd41e0"}
Jul 03 14:12:06.567219 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.567201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-djjvn" event={"ID":"32b3a7b4-fa2f-419b-8112-3ec5d147d916","Type":"ContainerStarted","Data":"a12139847d8ec305c45c38d6821491d0d36a76d6d77a171d1430d5debd036034"}
Jul 03 14:12:06.568538 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.568517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fb6nj" event={"ID":"bc899a7d-5212-4384-a014-65fdb5cfe509","Type":"ContainerStarted","Data":"2b8e539610a19ea3d245193afac5b4868f704eeb614dc71fafd4e1c0d5613039"}
Jul 03 14:12:06.604273 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.604221    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-djjvn" podStartSLOduration=4.743420459 podStartE2EDuration="23.604206601s" totalImagesPullingTime="18.860786142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:06.60403985 +0000 UTC m=+23.852696949" watchObservedRunningTime="2026-07-03 14:12:06.604206601 +0000 UTC m=+23.852863700"
Jul 03 14:12:06.622186 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.622136    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fb6nj" podStartSLOduration=4.796364937 podStartE2EDuration="23.622121415s" totalImagesPullingTime="18.825756478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:06.621970215 +0000 UTC m=+23.870627313" watchObservedRunningTime="2026-07-03 14:12:06.622121415 +0000 UTC m=+23.870778513"
Jul 03 14:12:06.636866 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.636815    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l447z" podStartSLOduration=4.8033029 podStartE2EDuration="23.636802402s" totalImagesPullingTime="18.833499502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:06.636499223 +0000 UTC m=+23.885156321" watchObservedRunningTime="2026-07-03 14:12:06.636802402 +0000 UTC m=+23.885459545"
Jul 03 14:12:06.995275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:06.995245    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 03 14:12:07.168082 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.167882    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T14:12:06.995265281Z","UUID":"135718fd-f7af-427c-a4f5-037f2c8741ce","Handler":null,"Name":"","Endpoint":""}
Jul 03 14:12:07.169737 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.169707    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 03 14:12:07.169865 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.169757    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 03 14:12:07.308853 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.308814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:07.309247 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:07.308938    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:07.309247 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.308990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:07.309247 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:07.309099    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:07.571450 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.571420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7ffn" event={"ID":"341f434c-7bc4-4ebb-b51d-ea73c1d0e236","Type":"ContainerStarted","Data":"0235a6fa88a4b5aad0de5b10fca97e3dbc2e1b061462abdbbe8eadff1609c3cb"}
Jul 03 14:12:07.575008 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.574977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh" event={"ID":"8d6f8530-eb15-4027-b57f-3b7e0a774c8c","Type":"ContainerStarted","Data":"b55dec8e9ac8e36f7d9e6fa382c8adb92c45c507943ee68f4b2bc09861fbe178"}
Jul 03 14:12:07.575325 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.575294    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 03 14:12:07.597249 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:07.597207    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7ffn" podStartSLOduration=5.744923307 podStartE2EDuration="24.597191831s" totalImagesPullingTime="18.852268524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:07.59700676 +0000 UTC m=+24.845663859" watchObservedRunningTime="2026-07-03 14:12:07.597191831 +0000 UTC m=+24.845848929"
Jul 03 14:12:08.308456 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.308254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:08.308584 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:08.308494    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:08.582627 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.582595    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:12:08.583105 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.583081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"17200209f3142a9c6390554d5df9802d2be2d059e6c29eeda32b10b983732485"}
Jul 03 14:12:08.588998 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.588952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh" event={"ID":"8d6f8530-eb15-4027-b57f-3b7e0a774c8c","Type":"ContainerStarted","Data":"4b5303fd9abd450a58ab7d156e50a26823cb8085d5d690b2254dacc5d4409d0c"}
Jul 03 14:12:08.610204 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.610150    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mjnsh" podStartSLOduration=4.598654991 podStartE2EDuration="25.610134231s" totalImagesPullingTime="21.01147924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:08.609503048 +0000 UTC m=+25.858160147" watchObservedRunningTime="2026-07-03 14:12:08.610134231 +0000 UTC m=+25.858791331"
Jul 03 14:12:08.816400 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.816357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:12:08.816557 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.816491    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 03 14:12:08.816986 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:08.816963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p5jgp"
Jul 03 14:12:09.308300 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:09.308268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:09.308470 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:09.308410    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:09.308529 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:09.308463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:09.308592 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:09.308546    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:10.308636 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:10.308607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:10.309138 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:10.308747    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:11.308148 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.308062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:11.308299 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:11.308199    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:11.308299 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.308231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:11.308419 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:11.308329    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:11.601746 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.601494    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:12:11.602503 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.602074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"8cb408b49ceb40ce9688243524363d0d9640d2c72021781e11f1f6756ae66e26"}
Jul 03 14:12:11.602709 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.602645    2563 scope.go:117] "RemoveContainer" containerID="afcfaaa6863d9e637b1c5361f7634d36fa4ea7f52de15b6ed9c9e2c5b797a938"
Jul 03 14:12:11.603362 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.603342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:12:11.603439 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.603419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:12:11.603488 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.603468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:12:11.623358 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.623339    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:12:11.625432 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:11.625410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:12:12.308553 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:12.308511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:12.308816 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:12.308627    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:12.607482 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:12.607454    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:12:12.607879 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:12.607822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" event={"ID":"7bb89cd2-fca2-41e2-9d53-75cd1bd0763c","Type":"ContainerStarted","Data":"6d4688281147ecf83a437e8efe01f7b5a33d1dbf06d291ba222c8661ef727952"}
Jul 03 14:12:12.609297 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:12.609277    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bab6480-0d48-49fe-ba58-0cfc775d06ba" containerID="a9703378511b7e32d68939079ba02e9cc4128c489a61c934f9f6662e9f776073" exitCode=0
Jul 03 14:12:12.609390 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:12.609310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerDied","Data":"a9703378511b7e32d68939079ba02e9cc4128c489a61c934f9f6662e9f776073"}
Jul 03 14:12:12.638227 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:12.638183    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh" podStartSLOduration=10.537254736 podStartE2EDuration="29.638169897s" totalImagesPullingTime="19.100915161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:12.637559363 +0000 UTC m=+29.886216463" watchObservedRunningTime="2026-07-03 14:12:12.638169897 +0000 UTC m=+29.886826996"
Jul 03 14:12:13.313730 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.313701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:13.313889 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:13.313798    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:13.313889 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.313859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:13.314013 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:13.313966    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:13.412717 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.412525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85mvb"]
Jul 03 14:12:13.413983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.413960    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-85cpn"]
Jul 03 14:12:13.414085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.414001    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7tnq"]
Jul 03 14:12:13.414085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.414071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:13.414187 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:13.414149    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:13.613249 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.613203    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bab6480-0d48-49fe-ba58-0cfc775d06ba" containerID="4bbcf0e1d2cad2b07556541d6006406a526a249ba9648a7e694261b38998329f" exitCode=0
Jul 03 14:12:13.613637 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.613311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerDied","Data":"4bbcf0e1d2cad2b07556541d6006406a526a249ba9648a7e694261b38998329f"}
Jul 03 14:12:13.613637 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.613327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:13.613818 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:13.613804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:13.614475 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:13.613900    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:13.614475 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:13.614010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:14.617791 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:14.617760    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bab6480-0d48-49fe-ba58-0cfc775d06ba" containerID="c6599d1220b1c5c3d5564dd0261f21610b7c5c6cf75c71b582cbf72cbce0403b" exitCode=0
Jul 03 14:12:14.618362 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:14.617804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerDied","Data":"c6599d1220b1c5c3d5564dd0261f21610b7c5c6cf75c71b582cbf72cbce0403b"}
Jul 03 14:12:15.309013 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:15.308924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:15.309197 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:15.308932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:15.309197 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:15.309056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:15.309197 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:15.309069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:15.309197 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:15.309161    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:15.309387 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:15.309243    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:16.869414 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:16.869377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:16.870037 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:16.869434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:16.870037 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.869531    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 14:12:16.870037 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.869539    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:12:16.870037 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.869581    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret podName:34e2e83a-f91b-4c01-a6fe-a56ae51603ee nodeName:}" failed. No retries permitted until 2026-07-03 14:12:48.869568057 +0000 UTC m=+66.118225134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret") pod "global-pull-secret-syncer-85cpn" (UID: "34e2e83a-f91b-4c01-a6fe-a56ae51603ee") : object "kube-system"/"original-pull-secret" not registered
Jul 03 14:12:16.870037 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.869595    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs podName:70a13008-f1cf-4f18-8c0a-914c05c2833b nodeName:}" failed. No retries permitted until 2026-07-03 14:12:48.869588657 +0000 UTC m=+66.118245734 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs") pod "network-metrics-daemon-j7tnq" (UID: "70a13008-f1cf-4f18-8c0a-914c05c2833b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 14:12:16.970009 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:16.969977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:16.970157 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.970110    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 14:12:16.970157 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.970126    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 14:12:16.970157 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.970134    2563 projected.go:196] Error preparing data for projected volume kube-api-access-8ltkw for pod openshift-network-diagnostics/network-check-target-85mvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:12:16.970249 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:16.970182    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw podName:4d51b03e-d44e-4f59-b80c-2a65a76f41b3 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:48.970170609 +0000 UTC m=+66.218827686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8ltkw" (UniqueName: "kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw") pod "network-check-target-85mvb" (UID: "4d51b03e-d44e-4f59-b80c-2a65a76f41b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 14:12:17.308115 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:17.308031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:17.308271 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:17.308031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:17.308271 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:17.308161    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85mvb" podUID="4d51b03e-d44e-4f59-b80c-2a65a76f41b3"
Jul 03 14:12:17.308271 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:17.308253    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7tnq" podUID="70a13008-f1cf-4f18-8c0a-914c05c2833b"
Jul 03 14:12:17.308428 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:17.308312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:17.308428 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:17.308372    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85cpn" podUID="34e2e83a-f91b-4c01-a6fe-a56ae51603ee"
Jul 03 14:12:18.528210 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.528186    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-67.ec2.internal" event="NodeReady"
Jul 03 14:12:18.528721 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.528326    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 03 14:12:18.573612 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.573577    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7chf4"]
Jul 03 14:12:18.597064 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.597030    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-98v7d"]
Jul 03 14:12:18.597184 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.597156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.600079 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.599948    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 03 14:12:18.601203 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.600295    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 03 14:12:18.601203 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.600377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xht5n\""
Jul 03 14:12:18.617554 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.617534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7chf4"]
Jul 03 14:12:18.617653 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.617565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98v7d"]
Jul 03 14:12:18.617653 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.617629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.619955 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.619931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 03 14:12:18.620104 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.620082    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 03 14:12:18.620201 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.620174    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gqn8m\""
Jul 03 14:12:18.620256 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.620217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 03 14:12:18.682945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.682920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3371d07b-f8ce-4e62-8157-6ae926e36e83-tmp-dir\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.682945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.682951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.683182 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.682989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrn8\" (UniqueName: \"kubernetes.io/projected/3371d07b-f8ce-4e62-8157-6ae926e36e83-kube-api-access-qhrn8\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.683182 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.683041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3371d07b-f8ce-4e62-8157-6ae926e36e83-config-volume\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.784296 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdhm\" (UniqueName: \"kubernetes.io/projected/a9209bcf-fa3e-4e3d-99b3-751126378856-kube-api-access-cmdhm\") pod \"ingress-canary-98v7d\" (UID: \"a9209bcf-fa3e-4e3d-99b3-751126378856\") " pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.784296 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3371d07b-f8ce-4e62-8157-6ae926e36e83-tmp-dir\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.784296 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.784558 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrn8\" (UniqueName: \"kubernetes.io/projected/3371d07b-f8ce-4e62-8157-6ae926e36e83-kube-api-access-qhrn8\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.784558 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3371d07b-f8ce-4e62-8157-6ae926e36e83-config-volume\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.784558 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9209bcf-fa3e-4e3d-99b3-751126378856-cert\") pod \"ingress-canary-98v7d\" (UID: \"a9209bcf-fa3e-4e3d-99b3-751126378856\") " pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.784558 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:18.784410    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 14:12:18.784558 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:18.784499    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls podName:3371d07b-f8ce-4e62-8157-6ae926e36e83 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:19.28447858 +0000 UTC m=+36.533135671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls") pod "dns-default-7chf4" (UID: "3371d07b-f8ce-4e62-8157-6ae926e36e83") : secret "dns-default-metrics-tls" not found
Jul 03 14:12:18.784865 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784582    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3371d07b-f8ce-4e62-8157-6ae926e36e83-tmp-dir\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.784865 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.784818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3371d07b-f8ce-4e62-8157-6ae926e36e83-config-volume\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.795391 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.795364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrn8\" (UniqueName: \"kubernetes.io/projected/3371d07b-f8ce-4e62-8157-6ae926e36e83-kube-api-access-qhrn8\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:18.884831 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.884795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9209bcf-fa3e-4e3d-99b3-751126378856-cert\") pod \"ingress-canary-98v7d\" (UID: \"a9209bcf-fa3e-4e3d-99b3-751126378856\") " pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.884987 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.884855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdhm\" (UniqueName: \"kubernetes.io/projected/a9209bcf-fa3e-4e3d-99b3-751126378856-kube-api-access-cmdhm\") pod \"ingress-canary-98v7d\" (UID: \"a9209bcf-fa3e-4e3d-99b3-751126378856\") " pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.887301 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.887281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9209bcf-fa3e-4e3d-99b3-751126378856-cert\") pod \"ingress-canary-98v7d\" (UID: \"a9209bcf-fa3e-4e3d-99b3-751126378856\") " pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.894725 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.894695    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdhm\" (UniqueName: \"kubernetes.io/projected/a9209bcf-fa3e-4e3d-99b3-751126378856-kube-api-access-cmdhm\") pod \"ingress-canary-98v7d\" (UID: \"a9209bcf-fa3e-4e3d-99b3-751126378856\") " pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:18.925785 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:18.925762    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98v7d"
Jul 03 14:12:19.148934 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.148760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98v7d"]
Jul 03 14:12:19.158355 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:19.158332    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9209bcf_fa3e_4e3d_99b3_751126378856.slice/crio-c12a6c3f3b79b2c3ab2b875628d66ed6f827b6ca19a585030ceb17b68cfcfb7a WatchSource:0}: Error finding container c12a6c3f3b79b2c3ab2b875628d66ed6f827b6ca19a585030ceb17b68cfcfb7a: Status 404 returned error can't find the container with id c12a6c3f3b79b2c3ab2b875628d66ed6f827b6ca19a585030ceb17b68cfcfb7a
Jul 03 14:12:19.288657 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.288572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:19.288777 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:19.288705    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 14:12:19.288828 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:19.288778    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls podName:3371d07b-f8ce-4e62-8157-6ae926e36e83 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:20.28876142 +0000 UTC m=+37.537418497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls") pod "dns-default-7chf4" (UID: "3371d07b-f8ce-4e62-8157-6ae926e36e83") : secret "dns-default-metrics-tls" not found
Jul 03 14:12:19.308180 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.308158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:19.308180 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.308172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:19.308369 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.308353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:19.310847 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.310831    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 14:12:19.310993 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.310961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 14:12:19.310993 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.310983    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg466\""
Jul 03 14:12:19.311121 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.310996    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 14:12:19.311121 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.311030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m5fkc\""
Jul 03 14:12:19.311121 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.311105    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 14:12:19.630619 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.630585    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bab6480-0d48-49fe-ba58-0cfc775d06ba" containerID="fe5e573ec9eb1f0141b21fe759a758b0aa42b539119bc28e379fff09db74ca95" exitCode=0
Jul 03 14:12:19.631213 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.630674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerDied","Data":"fe5e573ec9eb1f0141b21fe759a758b0aa42b539119bc28e379fff09db74ca95"}
Jul 03 14:12:19.631703 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:19.631664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98v7d" event={"ID":"a9209bcf-fa3e-4e3d-99b3-751126378856","Type":"ContainerStarted","Data":"c12a6c3f3b79b2c3ab2b875628d66ed6f827b6ca19a585030ceb17b68cfcfb7a"}
Jul 03 14:12:20.296511 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:20.296470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:20.296760 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:20.296638    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 14:12:20.296760 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:20.296734    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls podName:3371d07b-f8ce-4e62-8157-6ae926e36e83 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:22.296710345 +0000 UTC m=+39.545367427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls") pod "dns-default-7chf4" (UID: "3371d07b-f8ce-4e62-8157-6ae926e36e83") : secret "dns-default-metrics-tls" not found
Jul 03 14:12:20.636489 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:20.636459    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bab6480-0d48-49fe-ba58-0cfc775d06ba" containerID="d649cb3deb885d50a6643e239c9941fcd2f966b737f240752248f67042dda331" exitCode=0
Jul 03 14:12:20.636937 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:20.636495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerDied","Data":"d649cb3deb885d50a6643e239c9941fcd2f966b737f240752248f67042dda331"}
Jul 03 14:12:21.642960 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:21.642431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" event={"ID":"8bab6480-0d48-49fe-ba58-0cfc775d06ba","Type":"ContainerStarted","Data":"ef902b02eee77d5284aeb9bef223e12f6b63980a4bfdb6f62c66ea68a5adccff"}
Jul 03 14:12:21.667800 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:21.667466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ff8pz" podStartSLOduration=9.026613182 podStartE2EDuration="38.66743573s" totalImagesPullingTime="29.640822548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:21.666331521 +0000 UTC m=+38.914988622" watchObservedRunningTime="2026-07-03 14:12:21.66743573 +0000 UTC m=+38.916092829"
Jul 03 14:12:22.153177 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.153097    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mcwfp"]
Jul 03 14:12:22.157605 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.157587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.160153 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.160132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 03 14:12:22.160273 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.160217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 03 14:12:22.160273 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.160226    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 03 14:12:22.160273 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.160237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rg4mc\""
Jul 03 14:12:22.160273 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.160244    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 03 14:12:22.170070 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.170042    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 03 14:12:22.170817 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.170798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mcwfp"]
Jul 03 14:12:22.261529 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.261499    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-949ddbdcf-6kjlb"]
Jul 03 14:12:22.278247 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.278197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"]
Jul 03 14:12:22.278399 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.278321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.281157 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281137    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 03 14:12:22.281468 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 03 14:12:22.281611 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281512    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 03 14:12:22.281611 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281538    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n5wwl\""
Jul 03 14:12:22.281611 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281559    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 03 14:12:22.281800 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 03 14:12:22.281876 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.281850    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 03 14:12:22.288884 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.288868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"]
Jul 03 14:12:22.288961 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.288895    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-949ddbdcf-6kjlb"]
Jul 03 14:12:22.288998 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.288969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.291359 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.291340    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 03 14:12:22.291448 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.291342    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-swbkx\""
Jul 03 14:12:22.291448 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.291409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 03 14:12:22.292340 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.292325    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 03 14:12:22.292428 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.292348    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 03 14:12:22.313097 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:22.313193 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871b91f5-548a-47c5-baa4-97887cfc6cf3-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.313243 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.313212    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 14:12:22.313327 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/871b91f5-548a-47c5-baa4-97887cfc6cf3-tmp\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.313445 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.313341    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls podName:3371d07b-f8ce-4e62-8157-6ae926e36e83 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:26.31331874 +0000 UTC m=+43.561975825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls") pod "dns-default-7chf4" (UID: "3371d07b-f8ce-4e62-8157-6ae926e36e83") : secret "dns-default-metrics-tls" not found
Jul 03 14:12:22.313445 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/871b91f5-548a-47c5-baa4-97887cfc6cf3-snapshots\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.313445 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/871b91f5-548a-47c5-baa4-97887cfc6cf3-serving-cert\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.313628 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t788\" (UniqueName: \"kubernetes.io/projected/871b91f5-548a-47c5-baa4-97887cfc6cf3-kube-api-access-6t788\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.313628 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.313480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871b91f5-548a-47c5-baa4-97887cfc6cf3-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.414623 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/871b91f5-548a-47c5-baa4-97887cfc6cf3-snapshots\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.414623 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/871b91f5-548a-47c5-baa4-97887cfc6cf3-serving-cert\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.414623 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.414623 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clspv\" (UniqueName: \"kubernetes.io/projected/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-kube-api-access-clspv\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.414945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t788\" (UniqueName: \"kubernetes.io/projected/871b91f5-548a-47c5-baa4-97887cfc6cf3-kube-api-access-6t788\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.414945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871b91f5-548a-47c5-baa4-97887cfc6cf3-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.414945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.414945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-default-certificate\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.414945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-stats-auth\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.414945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871b91f5-548a-47c5-baa4-97887cfc6cf3-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.415239 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.414990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.415239 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgc8l\" (UniqueName: \"kubernetes.io/projected/889480dc-83a3-41bd-86de-387eba45dbfd-kube-api-access-sgc8l\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.415239 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/871b91f5-548a-47c5-baa4-97887cfc6cf3-tmp\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.415239 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.415239 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415215    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/871b91f5-548a-47c5-baa4-97887cfc6cf3-snapshots\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.415488 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415376    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/871b91f5-548a-47c5-baa4-97887cfc6cf3-tmp\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.415551 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415534    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871b91f5-548a-47c5-baa4-97887cfc6cf3-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.415603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.415538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871b91f5-548a-47c5-baa4-97887cfc6cf3-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.418838 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.418819    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/871b91f5-548a-47c5-baa4-97887cfc6cf3-serving-cert\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.423441 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.423423    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t788\" (UniqueName: \"kubernetes.io/projected/871b91f5-548a-47c5-baa4-97887cfc6cf3-kube-api-access-6t788\") pod \"insights-operator-5c847dcfc4-mcwfp\" (UID: \"871b91f5-548a-47c5-baa4-97887cfc6cf3\") " pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.469364 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.469332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp"
Jul 03 14:12:22.515797 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.515768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.515943 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.515820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.515943 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.515846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clspv\" (UniqueName: \"kubernetes.io/projected/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-kube-api-access-clspv\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.515943 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.515883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.515943 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.515914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-default-certificate\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.516144 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.515952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-stats-auth\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.516144 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.515974    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:22.516144 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.516000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.516144 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.516026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgc8l\" (UniqueName: \"kubernetes.io/projected/889480dc-83a3-41bd-86de-387eba45dbfd-kube-api-access-sgc8l\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.516144 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.516052    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:23.01602967 +0000 UTC m=+40.264686764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : configmap references non-existent config key: service-ca.crt
Jul 03 14:12:22.516553 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.516255    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls podName:d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:23.016239226 +0000 UTC m=+40.264896331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hvw6r" (UID: "d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850") : secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:22.516553 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.516338    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 14:12:22.516553 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:22.516375    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:23.016364142 +0000 UTC m=+40.265021219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : secret "router-metrics-certs-default" not found
Jul 03 14:12:22.516753 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.516589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.518536 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.518512    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-stats-auth\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.519087 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.519062    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-default-certificate\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.526376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.526351    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clspv\" (UniqueName: \"kubernetes.io/projected/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-kube-api-access-clspv\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:22.527081 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.527061    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgc8l\" (UniqueName: \"kubernetes.io/projected/889480dc-83a3-41bd-86de-387eba45dbfd-kube-api-access-sgc8l\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:22.616624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.616439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mcwfp"]
Jul 03 14:12:22.620891 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:22.620867    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871b91f5_548a_47c5_baa4_97887cfc6cf3.slice/crio-5697e30204780466e9abee2311e8e7321e0ca6795d308720caf9f340017c05ee WatchSource:0}: Error finding container 5697e30204780466e9abee2311e8e7321e0ca6795d308720caf9f340017c05ee: Status 404 returned error can't find the container with id 5697e30204780466e9abee2311e8e7321e0ca6795d308720caf9f340017c05ee
Jul 03 14:12:22.646079 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.646047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp" event={"ID":"871b91f5-548a-47c5-baa4-97887cfc6cf3","Type":"ContainerStarted","Data":"5697e30204780466e9abee2311e8e7321e0ca6795d308720caf9f340017c05ee"}
Jul 03 14:12:22.647514 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.647493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98v7d" event={"ID":"a9209bcf-fa3e-4e3d-99b3-751126378856","Type":"ContainerStarted","Data":"8426e8218d65168cc4eb4f9a0c6ead10e88ae7c7837f18f6a3664942e78f0834"}
Jul 03 14:12:22.675261 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:22.675136    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-98v7d" podStartSLOduration=1.95350566 podStartE2EDuration="4.675119498s" totalImagesPullingTime="2.721613838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:22.674392126 +0000 UTC m=+39.923049225" watchObservedRunningTime="2026-07-03 14:12:22.675119498 +0000 UTC m=+39.923776574"
Jul 03 14:12:23.019297 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:23.019263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:23.019437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:23.019323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:23.019437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:23.019352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:23.019437 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:23.019422    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 14:12:23.019531 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:23.019466    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:23.019531 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:23.019471    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:24.019456764 +0000 UTC m=+41.268113855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : configmap references non-existent config key: service-ca.crt
Jul 03 14:12:23.019531 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:23.019521    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:24.019507133 +0000 UTC m=+41.268164210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : secret "router-metrics-certs-default" not found
Jul 03 14:12:23.019531 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:23.019531    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls podName:d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:24.019525112 +0000 UTC m=+41.268182189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hvw6r" (UID: "d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850") : secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:24.026843 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:24.026802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:24.026855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:24.026896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:24.026958    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:24.027009    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:24.027062    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls podName:d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:26.027023125 +0000 UTC m=+43.275680217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hvw6r" (UID: "d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850") : secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:24.027079    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:26.027072478 +0000 UTC m=+43.275729555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : configmap references non-existent config key: service-ca.crt
Jul 03 14:12:24.027277 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:24.027091    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:26.027083417 +0000 UTC m=+43.275740495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : secret "router-metrics-certs-default" not found
Jul 03 14:12:25.132865 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.132827    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"]
Jul 03 14:12:25.154567 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.154541    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"]
Jul 03 14:12:25.154694 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.154627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.158228 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.158209    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 03 14:12:25.159576 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.159553    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5tx8w\""
Jul 03 14:12:25.159707 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.159556    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 03 14:12:25.159707 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.159613    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 03 14:12:25.159707 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.159664    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 03 14:12:25.338599 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.338574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.338779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.338639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zph\" (UniqueName: \"kubernetes.io/projected/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-kube-api-access-n9zph\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.338779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.338767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.439825 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.439786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.440020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.439858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zph\" (UniqueName: \"kubernetes.io/projected/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-kube-api-access-n9zph\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.440020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.439902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.440467 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.440444    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.443002 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.442976    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.451118 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.451095    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zph\" (UniqueName: \"kubernetes.io/projected/4db3a0c5-f930-44eb-8f8e-c57f7c922a23-kube-api-access-n9zph\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9f4d\" (UID: \"4db3a0c5-f930-44eb-8f8e-c57f7c922a23\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.463849 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.463829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"
Jul 03 14:12:25.609125 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.609091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d"]
Jul 03 14:12:25.612200 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:25.612180    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db3a0c5_f930_44eb_8f8e_c57f7c922a23.slice/crio-a469f95117008f7a274c6fb0b69fe7bd89a84b630f4fc8e3ae9608849c7b63f8 WatchSource:0}: Error finding container a469f95117008f7a274c6fb0b69fe7bd89a84b630f4fc8e3ae9608849c7b63f8: Status 404 returned error can't find the container with id a469f95117008f7a274c6fb0b69fe7bd89a84b630f4fc8e3ae9608849c7b63f8
Jul 03 14:12:25.655930 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.655804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp" event={"ID":"871b91f5-548a-47c5-baa4-97887cfc6cf3","Type":"ContainerStarted","Data":"95e504c2e6f426ef9831e01fc81e7dbb192d14b024d2666c250cc52925fafdc3"}
Jul 03 14:12:25.656910 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.656886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d" event={"ID":"4db3a0c5-f930-44eb-8f8e-c57f7c922a23","Type":"ContainerStarted","Data":"a469f95117008f7a274c6fb0b69fe7bd89a84b630f4fc8e3ae9608849c7b63f8"}
Jul 03 14:12:25.680869 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:25.680820    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp" podStartSLOduration=1.002951482 podStartE2EDuration="3.680806479s" totalImagesPullingTime="2.677854997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:25.680307356 +0000 UTC m=+42.928964456" watchObservedRunningTime="2026-07-03 14:12:25.680806479 +0000 UTC m=+42.929463578"
Jul 03 14:12:26.046014 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:26.045931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:26.046014 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:26.045986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:26.046221 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:26.046041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:26.046221 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.046085    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:26.046221 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.046158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls podName:d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:30.046142661 +0000 UTC m=+47.294799738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hvw6r" (UID: "d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850") : secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:26.046221 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.046162    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 14:12:26.046221 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.046185    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:30.04616869 +0000 UTC m=+47.294825767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : configmap references non-existent config key: service-ca.crt
Jul 03 14:12:26.046221 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.046207    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:30.046197489 +0000 UTC m=+47.294854569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : secret "router-metrics-certs-default" not found
Jul 03 14:12:26.347946 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:26.347914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:26.348443 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.348068    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 14:12:26.348561 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:26.348491    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls podName:3371d07b-f8ce-4e62-8157-6ae926e36e83 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:34.34847485 +0000 UTC m=+51.597131927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls") pod "dns-default-7chf4" (UID: "3371d07b-f8ce-4e62-8157-6ae926e36e83") : secret "dns-default-metrics-tls" not found
Jul 03 14:12:27.699310 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.699279    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5flqp"]
Jul 03 14:12:27.734161 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.734123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5flqp"]
Jul 03 14:12:27.734313 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.734258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.736346 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.736317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 03 14:12:27.736346 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.736337    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 03 14:12:27.737340 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.737311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pz6z4\""
Jul 03 14:12:27.865100 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.865046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-crio-socket\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.865266 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.865155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.865266 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.865247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.865356 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.865288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-data-volume\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.865356 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.865331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knqxd\" (UniqueName: \"kubernetes.io/projected/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-api-access-knqxd\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.966552 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.966438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knqxd\" (UniqueName: \"kubernetes.io/projected/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-api-access-knqxd\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.966552 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.966512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-crio-socket\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.966876 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.966585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.966876 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.966703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.966876 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.966731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-data-volume\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.966876 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.966801    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-crio-socket\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.967099 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:27.966901    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 14:12:27.967099 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:27.966931    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:27.967099 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:27.966984    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:28.466954488 +0000 UTC m=+45.715611567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : configmap "kube-rbac-proxy" not found
Jul 03 14:12:27.967099 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:27.967003    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:28.46699337 +0000 UTC m=+45.715650447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:27.967099 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.967023    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-data-volume\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:27.975926 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:27.975884    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knqxd\" (UniqueName: \"kubernetes.io/projected/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-api-access-knqxd\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:28.145652 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.145613    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"]
Jul 03 14:12:28.170803 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.170769    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"]
Jul 03 14:12:28.170966 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.170903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.173838 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.173808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 03 14:12:28.173966 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.173943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pksfg\""
Jul 03 14:12:28.174043 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.173973    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 03 14:12:28.174043 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.173974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 03 14:12:28.174141 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.174054    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 03 14:12:28.269922 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.269825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtth2\" (UniqueName: \"kubernetes.io/projected/2880153f-b83b-43f2-be33-2e989b4a5a3c-kube-api-access-wtth2\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.269922 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.269886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2880153f-b83b-43f2-be33-2e989b4a5a3c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.270141 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.269952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2880153f-b83b-43f2-be33-2e989b4a5a3c-config\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.370867 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.370822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtth2\" (UniqueName: \"kubernetes.io/projected/2880153f-b83b-43f2-be33-2e989b4a5a3c-kube-api-access-wtth2\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.370867 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.370877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2880153f-b83b-43f2-be33-2e989b4a5a3c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.371055 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.370894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2880153f-b83b-43f2-be33-2e989b4a5a3c-config\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.371479 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.371441    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2880153f-b83b-43f2-be33-2e989b4a5a3c-config\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.373286 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.373262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2880153f-b83b-43f2-be33-2e989b4a5a3c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.380920 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.380891    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtth2\" (UniqueName: \"kubernetes.io/projected/2880153f-b83b-43f2-be33-2e989b4a5a3c-kube-api-access-wtth2\") pod \"service-ca-operator-5d46d9ffd4-pgtqc\" (UID: \"2880153f-b83b-43f2-be33-2e989b4a5a3c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.472234 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.472197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:28.472429 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.472317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:28.472429 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:28.472320    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 14:12:28.472429 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:28.472396    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:28.472545 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:28.472441    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:29.47242349 +0000 UTC m=+46.721080571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : configmap "kube-rbac-proxy" not found
Jul 03 14:12:28.472545 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:28.472455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:29.472449276 +0000 UTC m=+46.721106353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:28.483897 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.483866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"
Jul 03 14:12:28.632552 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:28.632511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc"]
Jul 03 14:12:28.710862 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:28.710829    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2880153f_b83b_43f2_be33_2e989b4a5a3c.slice/crio-4cc638f94ea3d33b4ff43be59b34b22b528124ead6306794d3cb8332e271bb8f WatchSource:0}: Error finding container 4cc638f94ea3d33b4ff43be59b34b22b528124ead6306794d3cb8332e271bb8f: Status 404 returned error can't find the container with id 4cc638f94ea3d33b4ff43be59b34b22b528124ead6306794d3cb8332e271bb8f
Jul 03 14:12:29.482529 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:29.482491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:29.482732 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:29.482572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:29.482732 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:29.482643    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:29.482732 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:29.482656    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 14:12:29.482840 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:29.482738    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:31.482722396 +0000 UTC m=+48.731379473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:29.482840 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:29.482755    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:31.482747946 +0000 UTC m=+48.731405023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : configmap "kube-rbac-proxy" not found
Jul 03 14:12:29.673559 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:29.673519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d" event={"ID":"4db3a0c5-f930-44eb-8f8e-c57f7c922a23","Type":"ContainerStarted","Data":"250db6620b8805c9d9c4bc618d488b98f29b640ae3eae088917636809a0cd625"}
Jul 03 14:12:29.674675 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:29.674648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc" event={"ID":"2880153f-b83b-43f2-be33-2e989b4a5a3c","Type":"ContainerStarted","Data":"4cc638f94ea3d33b4ff43be59b34b22b528124ead6306794d3cb8332e271bb8f"}
Jul 03 14:12:29.691311 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:29.691252    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d" podStartSLOduration=1.560025207 podStartE2EDuration="4.691233742s" totalImagesPullingTime="3.131208535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:29.690543586 +0000 UTC m=+46.939200690" watchObservedRunningTime="2026-07-03 14:12:29.691233742 +0000 UTC m=+46.939890841"
Jul 03 14:12:29.878951 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:29.878918    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fb6nj_bc899a7d-5212-4384-a014-65fdb5cfe509/dns-node-resolver/0.log"
Jul 03 14:12:30.088775 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:30.088737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:30.088952 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:30.088812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:30.088952 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:30.088863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:30.089087 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:30.088954    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:38.088934745 +0000 UTC m=+55.337591826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : configmap references non-existent config key: service-ca.crt
Jul 03 14:12:30.089087 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:30.088971    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:30.089087 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:30.088996    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 14:12:30.089087 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:30.089030    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls podName:d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:38.089011761 +0000 UTC m=+55.337668857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hvw6r" (UID: "d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850") : secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:30.089087 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:30.089060    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:38.089050222 +0000 UTC m=+55.337707313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : secret "router-metrics-certs-default" not found
Jul 03 14:12:30.879101 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:30.879075    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l447z_df0e63b0-433d-4ffd-b9ba-0f6b64967782/node-ca/0.log"
Jul 03 14:12:31.278991 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:31.278972    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98v7d_a9209bcf-fa3e-4e3d-99b3-751126378856/serve-healthcheck-canary/0.log"
Jul 03 14:12:31.500606 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:31.500569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:31.500798 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:31.500699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:31.500798 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:31.500707    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 14:12:31.500798 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:31.500770    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:35.500755538 +0000 UTC m=+52.749412618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : configmap "kube-rbac-proxy" not found
Jul 03 14:12:31.500934 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:31.500816    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:31.500934 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:31.500863    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:35.500851763 +0000 UTC m=+52.749508857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:31.680859 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:31.680824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc" event={"ID":"2880153f-b83b-43f2-be33-2e989b4a5a3c","Type":"ContainerStarted","Data":"3a19e568093ba88bbf2da3bb07a288da8e0ad2179139d18958da476e9bc92f0e"}
Jul 03 14:12:31.699744 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:31.699668    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc" podStartSLOduration=1.162007975 podStartE2EDuration="3.699650608s" totalImagesPullingTime="2.537642633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:31.698697157 +0000 UTC m=+48.947354281" watchObservedRunningTime="2026-07-03 14:12:31.699650608 +0000 UTC m=+48.948307707"
Jul 03 14:12:34.425776 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:34.425730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:34.426282 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:34.425888    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 14:12:34.426282 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:34.425961    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls podName:3371d07b-f8ce-4e62-8157-6ae926e36e83 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:50.425939847 +0000 UTC m=+67.674596924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls") pod "dns-default-7chf4" (UID: "3371d07b-f8ce-4e62-8157-6ae926e36e83") : secret "dns-default-metrics-tls" not found
Jul 03 14:12:35.534490 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:35.534453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:35.535055 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:35.534536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:35.535055 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:35.534582    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 14:12:35.535055 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:35.534632    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:35.535055 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:35.534649    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:43.534634443 +0000 UTC m=+60.783291521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : configmap "kube-rbac-proxy" not found
Jul 03 14:12:35.535055 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:35.534672    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:43.534661453 +0000 UTC m=+60.783318530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:38.158867 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:38.158824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:38.158887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:38.158923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:38.158977    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:38.159032    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:38.159045    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls podName:d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:54.15903062 +0000 UTC m=+71.407687696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hvw6r" (UID: "d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850") : secret "cluster-monitoring-operator-tls" not found
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:38.159060    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:54.159053448 +0000 UTC m=+71.407710525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : configmap references non-existent config key: service-ca.crt
Jul 03 14:12:38.159276 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:38.159103    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs podName:889480dc-83a3-41bd-86de-387eba45dbfd nodeName:}" failed. No retries permitted until 2026-07-03 14:12:54.159091347 +0000 UTC m=+71.407748424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs") pod "router-default-949ddbdcf-6kjlb" (UID: "889480dc-83a3-41bd-86de-387eba45dbfd") : secret "router-metrics-certs-default" not found
Jul 03 14:12:43.607443 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:43.607390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:43.607892 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:43.607492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:43.607892 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:43.607613    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:43.607892 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:12:43.607667    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls podName:e4442daa-09b4-4fe7-a0bd-bdbace0b3241 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:59.607652224 +0000 UTC m=+76.856309301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5flqp" (UID: "e4442daa-09b4-4fe7-a0bd-bdbace0b3241") : secret "insights-runtime-extractor-tls" not found
Jul 03 14:12:43.608017 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:43.607937    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:43.624366 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:43.624343    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrhgh"
Jul 03 14:12:48.948463 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:48.948418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:48.949045 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:48.948588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:48.951068 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:48.951048    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 14:12:48.951949 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:48.951933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 14:12:48.961039 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:48.961012    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70a13008-f1cf-4f18-8c0a-914c05c2833b-metrics-certs\") pod \"network-metrics-daemon-j7tnq\" (UID: \"70a13008-f1cf-4f18-8c0a-914c05c2833b\") " pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:48.961151 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:48.961091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e2e83a-f91b-4c01-a6fe-a56ae51603ee-original-pull-secret\") pod \"global-pull-secret-syncer-85cpn\" (UID: \"34e2e83a-f91b-4c01-a6fe-a56ae51603ee\") " pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:49.025830 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.025801    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg466\""
Jul 03 14:12:49.027771 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.027743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85cpn"
Jul 03 14:12:49.033830 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.033810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7tnq"
Jul 03 14:12:49.049999 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.049969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:49.052807 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.052774    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 14:12:49.063673 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.063647    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 14:12:49.075203 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.075134    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltkw\" (UniqueName: \"kubernetes.io/projected/4d51b03e-d44e-4f59-b80c-2a65a76f41b3-kube-api-access-8ltkw\") pod \"network-check-target-85mvb\" (UID: \"4d51b03e-d44e-4f59-b80c-2a65a76f41b3\") " pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:49.174376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.174183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-85cpn"]
Jul 03 14:12:49.177997 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:49.177961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e2e83a_f91b_4c01_a6fe_a56ae51603ee.slice/crio-929879f16ee2c4dfee24a9701a5f8205c92a27684a011e5ba7841bed2e56b1f0 WatchSource:0}: Error finding container 929879f16ee2c4dfee24a9701a5f8205c92a27684a011e5ba7841bed2e56b1f0: Status 404 returned error can't find the container with id 929879f16ee2c4dfee24a9701a5f8205c92a27684a011e5ba7841bed2e56b1f0
Jul 03 14:12:49.192093 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.192052    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7tnq"]
Jul 03 14:12:49.196024 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:49.196001    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a13008_f1cf_4f18_8c0a_914c05c2833b.slice/crio-f5ceded214ebe6283d8fef002f153259f8333b82c9947c77e6babe21def0a29e WatchSource:0}: Error finding container f5ceded214ebe6283d8fef002f153259f8333b82c9947c77e6babe21def0a29e: Status 404 returned error can't find the container with id f5ceded214ebe6283d8fef002f153259f8333b82c9947c77e6babe21def0a29e
Jul 03 14:12:49.320246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.320222    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m5fkc\""
Jul 03 14:12:49.328128 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.328107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:49.463571 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.463494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85mvb"]
Jul 03 14:12:49.466697 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:49.466659    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d51b03e_d44e_4f59_b80c_2a65a76f41b3.slice/crio-3b708bfab455102bd9f0bd5c6fb96e3dd68f7f81a4c4d94c0fdaa1d1d9a61cfb WatchSource:0}: Error finding container 3b708bfab455102bd9f0bd5c6fb96e3dd68f7f81a4c4d94c0fdaa1d1d9a61cfb: Status 404 returned error can't find the container with id 3b708bfab455102bd9f0bd5c6fb96e3dd68f7f81a4c4d94c0fdaa1d1d9a61cfb
Jul 03 14:12:49.725550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.725456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85mvb" event={"ID":"4d51b03e-d44e-4f59-b80c-2a65a76f41b3","Type":"ContainerStarted","Data":"3b708bfab455102bd9f0bd5c6fb96e3dd68f7f81a4c4d94c0fdaa1d1d9a61cfb"}
Jul 03 14:12:49.726882 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.726844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7tnq" event={"ID":"70a13008-f1cf-4f18-8c0a-914c05c2833b","Type":"ContainerStarted","Data":"f5ceded214ebe6283d8fef002f153259f8333b82c9947c77e6babe21def0a29e"}
Jul 03 14:12:49.728148 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:49.728114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-85cpn" event={"ID":"34e2e83a-f91b-4c01-a6fe-a56ae51603ee","Type":"ContainerStarted","Data":"929879f16ee2c4dfee24a9701a5f8205c92a27684a011e5ba7841bed2e56b1f0"}
Jul 03 14:12:50.464078 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:50.464041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:50.466826 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:50.466791    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3371d07b-f8ce-4e62-8157-6ae926e36e83-metrics-tls\") pod \"dns-default-7chf4\" (UID: \"3371d07b-f8ce-4e62-8157-6ae926e36e83\") " pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:50.713326 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:50.713290    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xht5n\""
Jul 03 14:12:50.721669 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:50.721646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:50.902997 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:50.902910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7chf4"]
Jul 03 14:12:50.909741 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:50.909712    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3371d07b_f8ce_4e62_8157_6ae926e36e83.slice/crio-3a1482e7df9ae5911e398e4b076e310665e6b5a3bcdc87d58da04a3c78b4a9a6 WatchSource:0}: Error finding container 3a1482e7df9ae5911e398e4b076e310665e6b5a3bcdc87d58da04a3c78b4a9a6: Status 404 returned error can't find the container with id 3a1482e7df9ae5911e398e4b076e310665e6b5a3bcdc87d58da04a3c78b4a9a6
Jul 03 14:12:51.738057 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:51.737964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7chf4" event={"ID":"3371d07b-f8ce-4e62-8157-6ae926e36e83","Type":"ContainerStarted","Data":"3a1482e7df9ae5911e398e4b076e310665e6b5a3bcdc87d58da04a3c78b4a9a6"}
Jul 03 14:12:51.742186 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:51.742155    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7tnq" event={"ID":"70a13008-f1cf-4f18-8c0a-914c05c2833b","Type":"ContainerStarted","Data":"455c1fccb8686c73cd59942214c648010fc2522536c28bdef19f6694e4fb5acf"}
Jul 03 14:12:51.742334 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:51.742209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7tnq" event={"ID":"70a13008-f1cf-4f18-8c0a-914c05c2833b","Type":"ContainerStarted","Data":"b374448e3b98a392f4e87e58aebc130a70bd0faef5fbc3d6b34eb1a05c380a3a"}
Jul 03 14:12:51.762449 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:51.761454    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j7tnq" podStartSLOduration=67.236525657 podStartE2EDuration="1m8.761429905s" totalImagesPullingTime="1.524904248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:51.760362512 +0000 UTC m=+69.009019612" watchObservedRunningTime="2026-07-03 14:12:51.761429905 +0000 UTC m=+69.010087005"
Jul 03 14:12:54.197403 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.197358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:54.198018 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.197426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:54.198018 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.197470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:54.198212 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.198189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889480dc-83a3-41bd-86de-387eba45dbfd-service-ca-bundle\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:54.200168 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.200144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889480dc-83a3-41bd-86de-387eba45dbfd-metrics-certs\") pod \"router-default-949ddbdcf-6kjlb\" (UID: \"889480dc-83a3-41bd-86de-387eba45dbfd\") " pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:54.200390 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.200366    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hvw6r\" (UID: \"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:54.390078 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.390043    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n5wwl\""
Jul 03 14:12:54.397438 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.397408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:54.400402 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.400021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-swbkx\""
Jul 03 14:12:54.408234 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.408213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"
Jul 03 14:12:54.761007 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.760969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-85cpn" event={"ID":"34e2e83a-f91b-4c01-a6fe-a56ae51603ee","Type":"ContainerStarted","Data":"d4990855a3f456c6ccf4e66f71e93f9b3471cb1e97252317642d05f957cb7970"}
Jul 03 14:12:54.761626 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.761602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r"]
Jul 03 14:12:54.764634 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.764614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-949ddbdcf-6kjlb"]
Jul 03 14:12:54.768051 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:54.767727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31c23d1_1bb5_4eb3_b8fd_ebbc9d908850.slice/crio-68743f6d96ef0a4fcd784ab0b9df47ed1b202ff5dbe5b96f62d3c37912ac5590 WatchSource:0}: Error finding container 68743f6d96ef0a4fcd784ab0b9df47ed1b202ff5dbe5b96f62d3c37912ac5590: Status 404 returned error can't find the container with id 68743f6d96ef0a4fcd784ab0b9df47ed1b202ff5dbe5b96f62d3c37912ac5590
Jul 03 14:12:54.769432 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.768736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85mvb" event={"ID":"4d51b03e-d44e-4f59-b80c-2a65a76f41b3","Type":"ContainerStarted","Data":"0cb3fae43f037c901e84c41ed874bb0d0d18456c9a7421afbf769d14ce90d49d"}
Jul 03 14:12:54.769432 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.769253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:12:54.772853 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.772826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7chf4" event={"ID":"3371d07b-f8ce-4e62-8157-6ae926e36e83","Type":"ContainerStarted","Data":"7c9b26a6af947a57fa508fa1bf5994482e11a0502997e9701c418e38520f40e0"}
Jul 03 14:12:54.791447 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.791392    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-85cpn" podStartSLOduration=66.386060569 podStartE2EDuration="1m11.791369976s" totalImagesPullingTime="5.405309407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:54.790512868 +0000 UTC m=+72.039169966" watchObservedRunningTime="2026-07-03 14:12:54.791369976 +0000 UTC m=+72.040027075"
Jul 03 14:12:54.809216 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:54.809121    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-85mvb" podStartSLOduration=66.707509792 podStartE2EDuration="1m11.809100239s" totalImagesPullingTime="5.101590447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:54.808178399 +0000 UTC m=+72.056835512" watchObservedRunningTime="2026-07-03 14:12:54.809100239 +0000 UTC m=+72.057757340"
Jul 03 14:12:55.778703 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:55.778649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-949ddbdcf-6kjlb" event={"ID":"889480dc-83a3-41bd-86de-387eba45dbfd","Type":"ContainerStarted","Data":"445c44d8ebb8591d0ce9394de9a9928d5fb4b1fd55917314d22b111a49882d3a"}
Jul 03 14:12:55.779173 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:55.778734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-949ddbdcf-6kjlb" event={"ID":"889480dc-83a3-41bd-86de-387eba45dbfd","Type":"ContainerStarted","Data":"f5d400d5ddab2f7cc7734a3bb7f87a368305e2efaa9ebced9e99e32eddf4ad82"}
Jul 03 14:12:55.780062 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:55.780029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r" event={"ID":"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850","Type":"ContainerStarted","Data":"68743f6d96ef0a4fcd784ab0b9df47ed1b202ff5dbe5b96f62d3c37912ac5590"}
Jul 03 14:12:55.782375 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:55.782345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7chf4" event={"ID":"3371d07b-f8ce-4e62-8157-6ae926e36e83","Type":"ContainerStarted","Data":"de014e880c60e8ea583d5e3851fec3aa9e08de6122c51a72f6777f10885ffc1b"}
Jul 03 14:12:55.801785 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:55.801724    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-949ddbdcf-6kjlb" podStartSLOduration=33.801703058 podStartE2EDuration="33.801703058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:55.800064077 +0000 UTC m=+73.048721177" watchObservedRunningTime="2026-07-03 14:12:55.801703058 +0000 UTC m=+73.050360158"
Jul 03 14:12:56.398035 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.397994    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:56.400771 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.400749    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:56.435969 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.432928    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7chf4" podStartSLOduration=34.772677059 podStartE2EDuration="38.432907272s" totalImagesPullingTime="3.660230213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:55.817792432 +0000 UTC m=+73.066449533" watchObservedRunningTime="2026-07-03 14:12:56.432907272 +0000 UTC m=+73.681564372"
Jul 03 14:12:56.437095 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.437056    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"]
Jul 03 14:12:56.463819 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.463788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"]
Jul 03 14:12:56.463973 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.463894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.466572 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.466543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qswqq\""
Jul 03 14:12:56.466726 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.466601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 03 14:12:56.466726 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.466649    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 03 14:12:56.616955 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.616917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a1402d3-2c40-49d8-8796-db66400bb2c3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nxglm\" (UID: \"5a1402d3-2c40-49d8-8796-db66400bb2c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.617124 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.616963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1402d3-2c40-49d8-8796-db66400bb2c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nxglm\" (UID: \"5a1402d3-2c40-49d8-8796-db66400bb2c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.718202 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.718113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a1402d3-2c40-49d8-8796-db66400bb2c3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nxglm\" (UID: \"5a1402d3-2c40-49d8-8796-db66400bb2c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.718202 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.718164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1402d3-2c40-49d8-8796-db66400bb2c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nxglm\" (UID: \"5a1402d3-2c40-49d8-8796-db66400bb2c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.718915 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.718883    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a1402d3-2c40-49d8-8796-db66400bb2c3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nxglm\" (UID: \"5a1402d3-2c40-49d8-8796-db66400bb2c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.720883 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.720861    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1402d3-2c40-49d8-8796-db66400bb2c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nxglm\" (UID: \"5a1402d3-2c40-49d8-8796-db66400bb2c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.775184 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.775147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"
Jul 03 14:12:56.788456 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.788430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7chf4"
Jul 03 14:12:56.788922 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.788814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:56.790110 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:56.790086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-949ddbdcf-6kjlb"
Jul 03 14:12:57.247390 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:57.247358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nxglm"]
Jul 03 14:12:57.252184 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:57.252157    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1402d3_2c40_49d8_8796_db66400bb2c3.slice/crio-1bf47fe6f2c4aa71253f6423a61f74aaa29a58fbbb61a3383ec002cb0dc2afd5 WatchSource:0}: Error finding container 1bf47fe6f2c4aa71253f6423a61f74aaa29a58fbbb61a3383ec002cb0dc2afd5: Status 404 returned error can't find the container with id 1bf47fe6f2c4aa71253f6423a61f74aaa29a58fbbb61a3383ec002cb0dc2afd5
Jul 03 14:12:57.793649 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:57.793550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r" event={"ID":"d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850","Type":"ContainerStarted","Data":"ea82fe374f112118c8e44d76f9d1b0808b0e15ab2c0a4c1f1253c0b02afde90f"}
Jul 03 14:12:57.794846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:57.794825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm" event={"ID":"5a1402d3-2c40-49d8-8796-db66400bb2c3","Type":"ContainerStarted","Data":"1bf47fe6f2c4aa71253f6423a61f74aaa29a58fbbb61a3383ec002cb0dc2afd5"}
Jul 03 14:12:57.813499 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:57.813441    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hvw6r" podStartSLOduration=33.220824884 podStartE2EDuration="35.813419097s" totalImagesPullingTime="2.592594213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:57.81291185 +0000 UTC m=+75.061568959" watchObservedRunningTime="2026-07-03 14:12:57.813419097 +0000 UTC m=+75.062076197"
Jul 03 14:12:58.799235 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:58.799131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm" event={"ID":"5a1402d3-2c40-49d8-8796-db66400bb2c3","Type":"ContainerStarted","Data":"a6d176ce8eab190912e32d56cb4a4653be857b9bdba7c195cbd55ffe45623f58"}
Jul 03 14:12:58.819949 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:58.819896    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nxglm" podStartSLOduration=1.608003028 podStartE2EDuration="2.819878794s" totalImagesPullingTime="1.211875766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:58.818994446 +0000 UTC m=+76.067651545" watchObservedRunningTime="2026-07-03 14:12:58.819878794 +0000 UTC m=+76.068535893"
Jul 03 14:12:59.642987 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:59.642931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:59.645472 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:59.645450    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4442daa-09b4-4fe7-a0bd-bdbace0b3241-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5flqp\" (UID: \"e4442daa-09b4-4fe7-a0bd-bdbace0b3241\") " pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:59.846999 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:59.846968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pz6z4\""
Jul 03 14:12:59.854913 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:59.854893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5flqp"
Jul 03 14:12:59.989695 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:12:59.989640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5flqp"]
Jul 03 14:12:59.993404 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:12:59.993350    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4442daa_09b4_4fe7_a0bd_bdbace0b3241.slice/crio-3407744e49bbfaadde1101ab176768bb5ca905fa9abddbc853cccb27e1a283d0 WatchSource:0}: Error finding container 3407744e49bbfaadde1101ab176768bb5ca905fa9abddbc853cccb27e1a283d0: Status 404 returned error can't find the container with id 3407744e49bbfaadde1101ab176768bb5ca905fa9abddbc853cccb27e1a283d0
Jul 03 14:13:00.808140 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:00.808046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5flqp" event={"ID":"e4442daa-09b4-4fe7-a0bd-bdbace0b3241","Type":"ContainerStarted","Data":"3407744e49bbfaadde1101ab176768bb5ca905fa9abddbc853cccb27e1a283d0"}
Jul 03 14:13:03.695550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.695408    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f6c4d569c-hwh8p"]
Jul 03 14:13:03.697642 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.697614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.700139 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.700114    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 03 14:13:03.700346 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.700323    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 03 14:13:03.700440 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.700425    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 03 14:13:03.701377 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.701338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4q2ln\""
Jul 03 14:13:03.701377 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.701349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 03 14:13:03.701595 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.701401    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 03 14:13:03.701595 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.701341    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 03 14:13:03.701705 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.701669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 03 14:13:03.707550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.707520    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 03 14:13:03.714740 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.714718    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f6c4d569c-hwh8p"]
Jul 03 14:13:03.774118 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-config\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.774118 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-trusted-ca-bundle\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.774365 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-service-ca\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.774365 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bqd5\" (UniqueName: \"kubernetes.io/projected/cd60e171-f55d-4c0f-bc4f-97c2ff502561-kube-api-access-4bqd5\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.774365 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-serving-cert\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.774365 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-oauth-config\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.774525 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.774389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-oauth-serving-cert\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.875244 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-oauth-config\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.875328 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-oauth-serving-cert\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.875328 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-config\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-trusted-ca-bundle\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-service-ca\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bqd5\" (UniqueName: \"kubernetes.io/projected/cd60e171-f55d-4c0f-bc4f-97c2ff502561-kube-api-access-4bqd5\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.875645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-serving-cert\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876237 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.876137    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-config\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876237 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.876156    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-oauth-serving-cert\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876474 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.876444    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-service-ca\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.876556 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.876509    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-trusted-ca-bundle\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.877902 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.877871    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-oauth-config\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.878246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.878226    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-serving-cert\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:03.889015 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:03.888995    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bqd5\" (UniqueName: \"kubernetes.io/projected/cd60e171-f55d-4c0f-bc4f-97c2ff502561-kube-api-access-4bqd5\") pod \"console-f6c4d569c-hwh8p\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") " pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:04.009048 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:04.008954    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:04.148001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:04.147967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f6c4d569c-hwh8p"]
Jul 03 14:13:04.153285 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:13:04.153246    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd60e171_f55d_4c0f_bc4f_97c2ff502561.slice/crio-0625a558cdf68a13a1ea6d7af6ce1b562997041cdf684e8c536dd293994a85c3 WatchSource:0}: Error finding container 0625a558cdf68a13a1ea6d7af6ce1b562997041cdf684e8c536dd293994a85c3: Status 404 returned error can't find the container with id 0625a558cdf68a13a1ea6d7af6ce1b562997041cdf684e8c536dd293994a85c3
Jul 03 14:13:04.827882 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:04.827840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5flqp" event={"ID":"e4442daa-09b4-4fe7-a0bd-bdbace0b3241","Type":"ContainerStarted","Data":"6ce44ef5f179fdcab8c198cfc255cc7194d959590607a43096c1318da95361dd"}
Jul 03 14:13:04.828440 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:04.827916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5flqp" event={"ID":"e4442daa-09b4-4fe7-a0bd-bdbace0b3241","Type":"ContainerStarted","Data":"9abb9091cdaa0e27b76ecfda8d8ed5e8abf14d66112104a06a11029c6c338422"}
Jul 03 14:13:04.829470 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:04.829442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c4d569c-hwh8p" event={"ID":"cd60e171-f55d-4c0f-bc4f-97c2ff502561","Type":"ContainerStarted","Data":"0625a558cdf68a13a1ea6d7af6ce1b562997041cdf684e8c536dd293994a85c3"}
Jul 03 14:13:06.797443 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:06.797398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7chf4"
Jul 03 14:13:08.848359 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:08.848319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5flqp" event={"ID":"e4442daa-09b4-4fe7-a0bd-bdbace0b3241","Type":"ContainerStarted","Data":"3bb7d6847a046c3984f206dd5fd905f3973870d1eb5d3ca98042eb813d4965aa"}
Jul 03 14:13:08.849899 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:08.849874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c4d569c-hwh8p" event={"ID":"cd60e171-f55d-4c0f-bc4f-97c2ff502561","Type":"ContainerStarted","Data":"de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51"}
Jul 03 14:13:08.867026 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:08.866980    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5flqp" podStartSLOduration=33.993894758 podStartE2EDuration="41.866965306s" totalImagesPullingTime="7.873070548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:12:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:08.866364378 +0000 UTC m=+86.115021468" watchObservedRunningTime="2026-07-03 14:13:08.866965306 +0000 UTC m=+86.115622419"
Jul 03 14:13:08.887080 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:08.887026    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f6c4d569c-hwh8p" podStartSLOduration=2.074060407 podStartE2EDuration="5.88701003s" totalImagesPullingTime="3.812949623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:08.886055563 +0000 UTC m=+86.134712677" watchObservedRunningTime="2026-07-03 14:13:08.88701003 +0000 UTC m=+86.135667129"
Jul 03 14:13:14.009367 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:14.009317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:14.009781 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:14.009399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:14.014071 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:14.014045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:14.875386 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:14.875356    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:13:19.297775 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.297733    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"]
Jul 03 14:13:19.302309 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.302289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.305530 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.305501    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 03 14:13:19.305671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.305501    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 03 14:13:19.305671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.305504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g7njv\""
Jul 03 14:13:19.305671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.305535    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 03 14:13:19.307239 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.307216    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"]
Jul 03 14:13:19.310411 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.310390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.313446 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.313427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 03 14:13:19.313645 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.313608    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 03 14:13:19.313844 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.313827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wr8xc\""
Jul 03 14:13:19.314191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.313519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 03 14:13:19.315988 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.315971    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"]
Jul 03 14:13:19.327998 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.327971    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"]
Jul 03 14:13:19.337106 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.337080    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6klng"]
Jul 03 14:13:19.340609 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.340587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.345306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.343907    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 03 14:13:19.345306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.344250    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 03 14:13:19.345306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.344283    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 03 14:13:19.345306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.344326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l7pjz\""
Jul 03 14:13:19.385740 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.385669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/749a11fd-9026-496e-9a17-24242aea01c1-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.385939 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.385844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.385939 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.385885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.385939 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.385925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp9qf\" (UniqueName: \"kubernetes.io/projected/749a11fd-9026-496e-9a17-24242aea01c1-kube-api-access-zp9qf\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.486676 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-wtmp\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.486894 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.486894 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.486894 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6056749f-9ff0-4585-86ca-ea086235cb09-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.486894 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.486894 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.486894 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6bw2\" (UniqueName: \"kubernetes.io/projected/6056749f-9ff0-4585-86ca-ea086235cb09-kube-api-access-v6bw2\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.487091 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.486905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jbf\" (UniqueName: \"kubernetes.io/projected/44d56cb4-386d-44b8-a861-08acc2f3a9ad-kube-api-access-h7jbf\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487091 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:13:19.486973    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 03 14:13:19.487091 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp9qf\" (UniqueName: \"kubernetes.io/projected/749a11fd-9026-496e-9a17-24242aea01c1-kube-api-access-zp9qf\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.487091 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:13:19.487042    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-tls podName:749a11fd-9026-496e-9a17-24242aea01c1 nodeName:}" failed. No retries permitted until 2026-07-03 14:13:19.987024601 +0000 UTC m=+97.235681682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-8xttj" (UID: "749a11fd-9026-496e-9a17-24242aea01c1") : secret "openshift-state-metrics-tls" not found
Jul 03 14:13:19.487091 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6056749f-9ff0-4585-86ca-ea086235cb09-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.487295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.487295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/749a11fd-9026-496e-9a17-24242aea01c1-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.487295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-textfile\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-sys\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-root\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-tls\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487505 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d56cb4-386d-44b8-a861-08acc2f3a9ad-metrics-client-ca\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.487799 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.487784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/749a11fd-9026-496e-9a17-24242aea01c1-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.489499 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.489482    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.504357 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.504317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp9qf\" (UniqueName: \"kubernetes.io/projected/749a11fd-9026-496e-9a17-24242aea01c1-kube-api-access-zp9qf\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.588009 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.587971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.588217 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-textfile\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588217 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588217 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-sys\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588217 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-root\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-tls\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d56cb4-386d-44b8-a861-08acc2f3a9ad-metrics-client-ca\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588292    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-root\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-wtmp\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-sys\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588418 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:13:19.588369    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:13:19.588442    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-tls podName:44d56cb4-386d-44b8-a861-08acc2f3a9ad nodeName:}" failed. No retries permitted until 2026-07-03 14:13:20.088419483 +0000 UTC m=+97.337076562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-tls") pod "node-exporter-6klng" (UID: "44d56cb4-386d-44b8-a861-08acc2f3a9ad") : secret "node-exporter-tls" not found
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588491    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-wtmp\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6056749f-9ff0-4585-86ca-ea086235cb09-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6bw2\" (UniqueName: \"kubernetes.io/projected/6056749f-9ff0-4585-86ca-ea086235cb09-kube-api-access-v6bw2\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jbf\" (UniqueName: \"kubernetes.io/projected/44d56cb4-386d-44b8-a861-08acc2f3a9ad-kube-api-access-h7jbf\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.588773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6056749f-9ff0-4585-86ca-ea086235cb09-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.589176 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588815    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.589176 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.588955    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6056749f-9ff0-4585-86ca-ea086235cb09-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.589176 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.589140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-textfile\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.589395 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.589375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6056749f-9ff0-4585-86ca-ea086235cb09-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.589509 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.589487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.589591 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.589574    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d56cb4-386d-44b8-a861-08acc2f3a9ad-metrics-client-ca\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.591339 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.591313    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.591657 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.591632    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.591722 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.591666    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6056749f-9ff0-4585-86ca-ea086235cb09-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.607871 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.607841    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jbf\" (UniqueName: \"kubernetes.io/projected/44d56cb4-386d-44b8-a861-08acc2f3a9ad-kube-api-access-h7jbf\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:19.607978 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.607915    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6bw2\" (UniqueName: \"kubernetes.io/projected/6056749f-9ff0-4585-86ca-ea086235cb09-kube-api-access-v6bw2\") pod \"kube-state-metrics-7c9dbb8b7d-dsxrm\" (UID: \"6056749f-9ff0-4585-86ca-ea086235cb09\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.620917 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.620888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"
Jul 03 14:13:19.764547 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.764515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm"]
Jul 03 14:13:19.768849 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:13:19.768819    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6056749f_9ff0_4585_86ca_ea086235cb09.slice/crio-27e7712c82e13c607d26f9d2f805a40ecde156581ac6c24d90f1c2e48c7f9cf9 WatchSource:0}: Error finding container 27e7712c82e13c607d26f9d2f805a40ecde156581ac6c24d90f1c2e48c7f9cf9: Status 404 returned error can't find the container with id 27e7712c82e13c607d26f9d2f805a40ecde156581ac6c24d90f1c2e48c7f9cf9
Jul 03 14:13:19.888023 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.887943    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm" event={"ID":"6056749f-9ff0-4585-86ca-ea086235cb09","Type":"ContainerStarted","Data":"27e7712c82e13c607d26f9d2f805a40ecde156581ac6c24d90f1c2e48c7f9cf9"}
Jul 03 14:13:19.991939 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.991905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:19.994419 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:19.994397    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/749a11fd-9026-496e-9a17-24242aea01c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8xttj\" (UID: \"749a11fd-9026-496e-9a17-24242aea01c1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:20.092848 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.092804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-tls\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:20.095342 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.095312    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44d56cb4-386d-44b8-a861-08acc2f3a9ad-node-exporter-tls\") pod \"node-exporter-6klng\" (UID: \"44d56cb4-386d-44b8-a861-08acc2f3a9ad\") " pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:20.212035 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.211956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"
Jul 03 14:13:20.253372 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.253340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6klng"
Jul 03 14:13:20.268801 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:13:20.268748    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d56cb4_386d_44b8_a861_08acc2f3a9ad.slice/crio-8cbc7642e5a5640668898d24b56c9366dc21114e9388375742f09712cb15ac92 WatchSource:0}: Error finding container 8cbc7642e5a5640668898d24b56c9366dc21114e9388375742f09712cb15ac92: Status 404 returned error can't find the container with id 8cbc7642e5a5640668898d24b56c9366dc21114e9388375742f09712cb15ac92
Jul 03 14:13:20.363198 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.363159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj"]
Jul 03 14:13:20.368575 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:13:20.368544    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749a11fd_9026_496e_9a17_24242aea01c1.slice/crio-c5baacb47471537037f2832c48a3bfeeaaa616c5ed7d24b7c3e0dad4ddcd4562 WatchSource:0}: Error finding container c5baacb47471537037f2832c48a3bfeeaaa616c5ed7d24b7c3e0dad4ddcd4562: Status 404 returned error can't find the container with id c5baacb47471537037f2832c48a3bfeeaaa616c5ed7d24b7c3e0dad4ddcd4562
Jul 03 14:13:20.894200 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.894156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6klng" event={"ID":"44d56cb4-386d-44b8-a861-08acc2f3a9ad","Type":"ContainerStarted","Data":"8cbc7642e5a5640668898d24b56c9366dc21114e9388375742f09712cb15ac92"}
Jul 03 14:13:20.896465 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.896441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj" event={"ID":"749a11fd-9026-496e-9a17-24242aea01c1","Type":"ContainerStarted","Data":"960f1c2e3f87bd1bc0560fd21c59e052338ede306c96197b7ee6df7a11e304cd"}
Jul 03 14:13:20.896615 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.896491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj" event={"ID":"749a11fd-9026-496e-9a17-24242aea01c1","Type":"ContainerStarted","Data":"e6b3af1bdb6147d80d52be75834bad4714ccb387ba31a4dc76520e0f15f01784"}
Jul 03 14:13:20.896615 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:20.896523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj" event={"ID":"749a11fd-9026-496e-9a17-24242aea01c1","Type":"ContainerStarted","Data":"c5baacb47471537037f2832c48a3bfeeaaa616c5ed7d24b7c3e0dad4ddcd4562"}
Jul 03 14:13:21.903902 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.903862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm" event={"ID":"6056749f-9ff0-4585-86ca-ea086235cb09","Type":"ContainerStarted","Data":"596acaa2c1050f4c916ada3779fd36b22c8e28e1938d3d9f46ba8a98e5b50205"}
Jul 03 14:13:21.904301 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.903946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm" event={"ID":"6056749f-9ff0-4585-86ca-ea086235cb09","Type":"ContainerStarted","Data":"d29860d45e395a6bf5231156fe32cccc9c0b8383794ef1b62a115bd5944b4e6c"}
Jul 03 14:13:21.904301 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.903976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm" event={"ID":"6056749f-9ff0-4585-86ca-ea086235cb09","Type":"ContainerStarted","Data":"d4ca69bf8d600fc513f65ca8784e40a41ff8e7ea82461def863bcae1d3756787"}
Jul 03 14:13:21.905858 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.905832    2563 generic.go:356] "Generic (PLEG): container finished" podID="44d56cb4-386d-44b8-a861-08acc2f3a9ad" containerID="7c3aef401a6b812b733c1841281621afa39f39d6d8b1cdd74cab14693dfd7c84" exitCode=0
Jul 03 14:13:21.905977 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.905906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6klng" event={"ID":"44d56cb4-386d-44b8-a861-08acc2f3a9ad","Type":"ContainerDied","Data":"7c3aef401a6b812b733c1841281621afa39f39d6d8b1cdd74cab14693dfd7c84"}
Jul 03 14:13:21.908224 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.908199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj" event={"ID":"749a11fd-9026-496e-9a17-24242aea01c1","Type":"ContainerStarted","Data":"63f86d6ff501b97bd6626a6ddcd1ceaf3b83ce6f5ce6e72c0e6290dd27a67fff"}
Jul 03 14:13:21.930037 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.929985    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsxrm" podStartSLOduration=1.407009789 podStartE2EDuration="2.929963657s" totalImagesPullingTime="1.522953868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:21.928143466 +0000 UTC m=+99.176800566" watchObservedRunningTime="2026-07-03 14:13:21.929963657 +0000 UTC m=+99.178620747"
Jul 03 14:13:21.974907 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:21.974844    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8xttj" podStartSLOduration=1.650127104 podStartE2EDuration="2.974818999s" totalImagesPullingTime="1.324691895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:21.972808181 +0000 UTC m=+99.221465282" watchObservedRunningTime="2026-07-03 14:13:21.974818999 +0000 UTC m=+99.223476099"
Jul 03 14:13:22.914305 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:22.914265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6klng" event={"ID":"44d56cb4-386d-44b8-a861-08acc2f3a9ad","Type":"ContainerStarted","Data":"34a8d73753fc7e32bbdf3bb609d0bef6bd932c9e54b6048eaf13bc787be70bd0"}
Jul 03 14:13:22.914743 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:22.914358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6klng" event={"ID":"44d56cb4-386d-44b8-a861-08acc2f3a9ad","Type":"ContainerStarted","Data":"573224d7565ec1ca8de69f2f57c2caf7fe451c4141da4f9de53554ca255abe74"}
Jul 03 14:13:22.935283 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:22.935232    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6klng" podStartSLOduration=2.791850992 podStartE2EDuration="3.935216157s" totalImagesPullingTime="1.025403582s" totalInitContainerRuntime="117.961583ms" isStatefulPod=true podCreationTimestamp="2026-07-03 14:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:22.9338975 +0000 UTC m=+100.182554625" watchObservedRunningTime="2026-07-03 14:13:22.935216157 +0000 UTC m=+100.183873278"
Jul 03 14:13:24.100989 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.100960    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7789c995d6-pjwgw"]
Jul 03 14:13:24.104076 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.104058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.144431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.140033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7789c995d6-pjwgw"]
Jul 03 14:13:24.229866 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.229830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-oauth-config\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.229866 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.229872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-console-config\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.230109 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.229898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtsj\" (UniqueName: \"kubernetes.io/projected/4c2da45a-27c4-48da-915d-b19dd55a538e-kube-api-access-tjtsj\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.230109 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.229996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-service-ca\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.230109 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.230056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-trusted-ca-bundle\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.230109 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.230093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-serving-cert\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.230267 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.230135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-oauth-serving-cert\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331446 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-oauth-config\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331446 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-console-config\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331737 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtsj\" (UniqueName: \"kubernetes.io/projected/4c2da45a-27c4-48da-915d-b19dd55a538e-kube-api-access-tjtsj\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331737 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-service-ca\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331737 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-trusted-ca-bundle\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331737 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-serving-cert\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.331737 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.331638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-oauth-serving-cert\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.332338 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.332310    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-console-config\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.332522 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.332501    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-service-ca\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.332655 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.332632    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-oauth-serving-cert\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.332731 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.332713    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-trusted-ca-bundle\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.334112 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.334090    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-oauth-config\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.334269 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.334251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-serving-cert\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.345643 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.345616    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtsj\" (UniqueName: \"kubernetes.io/projected/4c2da45a-27c4-48da-915d-b19dd55a538e-kube-api-access-tjtsj\") pod \"console-7789c995d6-pjwgw\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") " pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.414597 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.414511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:24.567960 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.567869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7789c995d6-pjwgw"]
Jul 03 14:13:24.570535 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:13:24.570508    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2da45a_27c4_48da_915d_b19dd55a538e.slice/crio-6c15cfc3d255ebe06313fee4a655ffadf544ee50b4c70497e025534fb9f9876f WatchSource:0}: Error finding container 6c15cfc3d255ebe06313fee4a655ffadf544ee50b4c70497e025534fb9f9876f: Status 404 returned error can't find the container with id 6c15cfc3d255ebe06313fee4a655ffadf544ee50b4c70497e025534fb9f9876f
Jul 03 14:13:24.923371 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.923328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7789c995d6-pjwgw" event={"ID":"4c2da45a-27c4-48da-915d-b19dd55a538e","Type":"ContainerStarted","Data":"68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b"}
Jul 03 14:13:24.923523 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.923384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7789c995d6-pjwgw" event={"ID":"4c2da45a-27c4-48da-915d-b19dd55a538e","Type":"ContainerStarted","Data":"6c15cfc3d255ebe06313fee4a655ffadf544ee50b4c70497e025534fb9f9876f"}
Jul 03 14:13:24.944557 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:24.944472    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7789c995d6-pjwgw" podStartSLOduration=0.944456097 podStartE2EDuration="944.456097ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:24.943396947 +0000 UTC m=+102.192054047" watchObservedRunningTime="2026-07-03 14:13:24.944456097 +0000 UTC m=+102.193113195"
Jul 03 14:13:26.791069 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:26.791042    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-85mvb"
Jul 03 14:13:34.415397 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:34.415366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:34.416107 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:34.416074    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:34.422485 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:34.422461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:34.964132 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:34.964104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:13:35.017336 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:35.017304    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f6c4d569c-hwh8p"]
Jul 03 14:13:47.008622 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:47.008586    2563 generic.go:356] "Generic (PLEG): container finished" podID="871b91f5-548a-47c5-baa4-97887cfc6cf3" containerID="95e504c2e6f426ef9831e01fc81e7dbb192d14b024d2666c250cc52925fafdc3" exitCode=0
Jul 03 14:13:47.009050 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:47.008658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp" event={"ID":"871b91f5-548a-47c5-baa4-97887cfc6cf3","Type":"ContainerDied","Data":"95e504c2e6f426ef9831e01fc81e7dbb192d14b024d2666c250cc52925fafdc3"}
Jul 03 14:13:47.009050 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:47.009019    2563 scope.go:117] "RemoveContainer" containerID="95e504c2e6f426ef9831e01fc81e7dbb192d14b024d2666c250cc52925fafdc3"
Jul 03 14:13:48.013951 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:48.013919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mcwfp" event={"ID":"871b91f5-548a-47c5-baa4-97887cfc6cf3","Type":"ContainerStarted","Data":"9e3b767b8d322c66fb917483c98166c518e163fcc86b0222d6172dbb4e469386"}
Jul 03 14:13:52.029477 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:52.029378    2563 generic.go:356] "Generic (PLEG): container finished" podID="2880153f-b83b-43f2-be33-2e989b4a5a3c" containerID="3a19e568093ba88bbf2da3bb07a288da8e0ad2179139d18958da476e9bc92f0e" exitCode=0
Jul 03 14:13:52.029969 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:52.029463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc" event={"ID":"2880153f-b83b-43f2-be33-2e989b4a5a3c","Type":"ContainerDied","Data":"3a19e568093ba88bbf2da3bb07a288da8e0ad2179139d18958da476e9bc92f0e"}
Jul 03 14:13:52.029969 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:52.029912    2563 scope.go:117] "RemoveContainer" containerID="3a19e568093ba88bbf2da3bb07a288da8e0ad2179139d18958da476e9bc92f0e"
Jul 03 14:13:53.034861 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:53.034827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pgtqc" event={"ID":"2880153f-b83b-43f2-be33-2e989b4a5a3c","Type":"ContainerStarted","Data":"36d239995f220757b14f200643fbb944640f423cc38687b92b10d294a4acacd3"}
Jul 03 14:13:55.044163 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:55.044078    2563 generic.go:356] "Generic (PLEG): container finished" podID="4db3a0c5-f930-44eb-8f8e-c57f7c922a23" containerID="250db6620b8805c9d9c4bc618d488b98f29b640ae3eae088917636809a0cd625" exitCode=0
Jul 03 14:13:55.044163 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:55.044149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d" event={"ID":"4db3a0c5-f930-44eb-8f8e-c57f7c922a23","Type":"ContainerDied","Data":"250db6620b8805c9d9c4bc618d488b98f29b640ae3eae088917636809a0cd625"}
Jul 03 14:13:55.044547 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:55.044475    2563 scope.go:117] "RemoveContainer" containerID="250db6620b8805c9d9c4bc618d488b98f29b640ae3eae088917636809a0cd625"
Jul 03 14:13:56.050143 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:13:56.050108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9f4d" event={"ID":"4db3a0c5-f930-44eb-8f8e-c57f7c922a23","Type":"ContainerStarted","Data":"00f710e235750025afbc0bb1b511d4c094962995b349d7a710958d235926c558"}
Jul 03 14:14:00.044123 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.044082    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f6c4d569c-hwh8p" podUID="cd60e171-f55d-4c0f-bc4f-97c2ff502561" containerName="console" containerID="cri-o://de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51" gracePeriod=15
Jul 03 14:14:00.324036 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.324007    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:14:00.436943 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.436917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-serving-cert\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437142 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.436950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-config\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437142 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.436967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-trusted-ca-bundle\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437142 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.436999    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-service-ca\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437312 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437190    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-oauth-config\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437363 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437310    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bqd5\" (UniqueName: \"kubernetes.io/projected/cd60e171-f55d-4c0f-bc4f-97c2ff502561-kube-api-access-4bqd5\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437415 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437364    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:14:00.437415 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437368    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-config" (OuterVolumeSpecName: "console-config") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:14:00.437415 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-oauth-serving-cert\") pod \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\" (UID: \"cd60e171-f55d-4c0f-bc4f-97c2ff502561\") "
Jul 03 14:14:00.437415 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437397    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:14:00.437758 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437736    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-config\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:00.437906 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437884    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:14:00.437996 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.437917    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-trusted-ca-bundle\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:00.438126 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.438092    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-service-ca\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:00.439837 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.439812    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:14:00.439942 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.439841    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:14:00.440040 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.440017    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd60e171-f55d-4c0f-bc4f-97c2ff502561-kube-api-access-4bqd5" (OuterVolumeSpecName: "kube-api-access-4bqd5") pod "cd60e171-f55d-4c0f-bc4f-97c2ff502561" (UID: "cd60e171-f55d-4c0f-bc4f-97c2ff502561"). InnerVolumeSpecName "kube-api-access-4bqd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:14:00.539391 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.539293    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-serving-cert\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:00.539391 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.539331    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd60e171-f55d-4c0f-bc4f-97c2ff502561-console-oauth-config\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:00.539391 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.539348    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bqd5\" (UniqueName: \"kubernetes.io/projected/cd60e171-f55d-4c0f-bc4f-97c2ff502561-kube-api-access-4bqd5\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:00.539391 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:00.539364    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd60e171-f55d-4c0f-bc4f-97c2ff502561-oauth-serving-cert\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:14:01.074942 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.074897    2563 generic.go:356] "Generic (PLEG): container finished" podID="cd60e171-f55d-4c0f-bc4f-97c2ff502561" containerID="de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51" exitCode=0
Jul 03 14:14:01.075421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.074988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c4d569c-hwh8p" event={"ID":"cd60e171-f55d-4c0f-bc4f-97c2ff502561","Type":"ContainerDied","Data":"de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51"}
Jul 03 14:14:01.075421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.075083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c4d569c-hwh8p" event={"ID":"cd60e171-f55d-4c0f-bc4f-97c2ff502561","Type":"ContainerDied","Data":"0625a558cdf68a13a1ea6d7af6ce1b562997041cdf684e8c536dd293994a85c3"}
Jul 03 14:14:01.075421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.075128    2563 scope.go:117] "RemoveContainer" containerID="de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51"
Jul 03 14:14:01.075421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.075302    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c4d569c-hwh8p"
Jul 03 14:14:01.092075 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.092054    2563 scope.go:117] "RemoveContainer" containerID="de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51"
Jul 03 14:14:01.092442 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:14:01.092416    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51\": container with ID starting with de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51 not found: ID does not exist" containerID="de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51"
Jul 03 14:14:01.092534 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.092449    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51"} err="failed to get container status \"de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51\": rpc error: code = NotFound desc = could not find container \"de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51\": container with ID starting with de76e4d034da3a7390a626f22a4a1452b6a457df150dd09474ec9a14122b2b51 not found: ID does not exist"
Jul 03 14:14:01.102139 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.102114    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f6c4d569c-hwh8p"]
Jul 03 14:14:01.106349 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.106325    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f6c4d569c-hwh8p"]
Jul 03 14:14:01.313459 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:01.313425    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd60e171-f55d-4c0f-bc4f-97c2ff502561" path="/var/lib/kubelet/pods/cd60e171-f55d-4c0f-bc4f-97c2ff502561/volumes"
Jul 03 14:14:58.409056 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:14:58.409020    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7789c995d6-pjwgw"]
Jul 03 14:15:23.434934 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.434884    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7789c995d6-pjwgw" podUID="4c2da45a-27c4-48da-915d-b19dd55a538e" containerName="console" containerID="cri-o://68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b" gracePeriod=15
Jul 03 14:15:23.680031 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.680008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:15:23.709484 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709416    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-oauth-config\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.709484 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709458    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjtsj\" (UniqueName: \"kubernetes.io/projected/4c2da45a-27c4-48da-915d-b19dd55a538e-kube-api-access-tjtsj\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.709714 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709485    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-oauth-serving-cert\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.709714 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-service-ca\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.709714 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709538    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-serving-cert\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.709714 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-trusted-ca-bundle\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.709714 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.709625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-console-config\") pod \"4c2da45a-27c4-48da-915d-b19dd55a538e\" (UID: \"4c2da45a-27c4-48da-915d-b19dd55a538e\") "
Jul 03 14:15:23.710127 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.710096    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:15:23.710226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.710106    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:15:23.710628 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.710587    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:15:23.710760 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.710728    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-console-config" (OuterVolumeSpecName: "console-config") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:15:23.711889 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.711833    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:15:23.711969 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.711929    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2da45a-27c4-48da-915d-b19dd55a538e-kube-api-access-tjtsj" (OuterVolumeSpecName: "kube-api-access-tjtsj") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "kube-api-access-tjtsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:15:23.711969 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.711927    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c2da45a-27c4-48da-915d-b19dd55a538e" (UID: "4c2da45a-27c4-48da-915d-b19dd55a538e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:15:23.810392 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810352    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-oauth-config\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:23.810392 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810385    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjtsj\" (UniqueName: \"kubernetes.io/projected/4c2da45a-27c4-48da-915d-b19dd55a538e-kube-api-access-tjtsj\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:23.810392 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810395    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-oauth-serving-cert\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:23.810642 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810404    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-service-ca\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:23.810642 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810414    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2da45a-27c4-48da-915d-b19dd55a538e-console-serving-cert\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:23.810642 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810422    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-trusted-ca-bundle\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:23.810642 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:23.810431    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2da45a-27c4-48da-915d-b19dd55a538e-console-config\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:15:24.381259 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.381230    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c2da45a-27c4-48da-915d-b19dd55a538e" containerID="68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b" exitCode=0
Jul 03 14:15:24.381434 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.381278    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7789c995d6-pjwgw"
Jul 03 14:15:24.381434 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.381296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7789c995d6-pjwgw" event={"ID":"4c2da45a-27c4-48da-915d-b19dd55a538e","Type":"ContainerDied","Data":"68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b"}
Jul 03 14:15:24.381434 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.381334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7789c995d6-pjwgw" event={"ID":"4c2da45a-27c4-48da-915d-b19dd55a538e","Type":"ContainerDied","Data":"6c15cfc3d255ebe06313fee4a655ffadf544ee50b4c70497e025534fb9f9876f"}
Jul 03 14:15:24.381434 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.381355    2563 scope.go:117] "RemoveContainer" containerID="68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b"
Jul 03 14:15:24.389659 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.389645    2563 scope.go:117] "RemoveContainer" containerID="68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b"
Jul 03 14:15:24.389933 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:15:24.389915    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b\": container with ID starting with 68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b not found: ID does not exist" containerID="68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b"
Jul 03 14:15:24.389985 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.389941    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b"} err="failed to get container status \"68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b\": rpc error: code = NotFound desc = could not find container \"68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b\": container with ID starting with 68f12981f9c4b861cfeb8d787b8025121a7811f0de7ff7bf68fdb31bd7b1344b not found: ID does not exist"
Jul 03 14:15:24.402840 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.402820    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7789c995d6-pjwgw"]
Jul 03 14:15:24.407802 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:24.407781    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7789c995d6-pjwgw"]
Jul 03 14:15:25.313849 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:25.313814    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2da45a-27c4-48da-915d-b19dd55a538e" path="/var/lib/kubelet/pods/4c2da45a-27c4-48da-915d-b19dd55a538e/volumes"
Jul 03 14:15:57.459779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.459743    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbcb7cbbd-8slmk"]
Jul 03 14:15:57.460226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.459996    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2da45a-27c4-48da-915d-b19dd55a538e" containerName="console"
Jul 03 14:15:57.460226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.460008    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2da45a-27c4-48da-915d-b19dd55a538e" containerName="console"
Jul 03 14:15:57.460226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.460017    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd60e171-f55d-4c0f-bc4f-97c2ff502561" containerName="console"
Jul 03 14:15:57.460226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.460022    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd60e171-f55d-4c0f-bc4f-97c2ff502561" containerName="console"
Jul 03 14:15:57.460226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.460071    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd60e171-f55d-4c0f-bc4f-97c2ff502561" containerName="console"
Jul 03 14:15:57.460226 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.460079    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2da45a-27c4-48da-915d-b19dd55a538e" containerName="console"
Jul 03 14:15:57.468510 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.468480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.471299 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.471273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 03 14:15:57.471439 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.471307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 03 14:15:57.471605 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.471591    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 03 14:15:57.472276 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.472259    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4q2ln\""
Jul 03 14:15:57.472800 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.472780    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 03 14:15:57.473047 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.473026    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 03 14:15:57.473257 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.473241    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 03 14:15:57.473257 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.473255    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 03 14:15:57.474184 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.474159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbcb7cbbd-8slmk"]
Jul 03 14:15:57.477135 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.477101    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 03 14:15:57.539627 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-trusted-ca-bundle\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.539627 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-console-config\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.539912 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f259z\" (UniqueName: \"kubernetes.io/projected/ec322645-91ca-4124-aa2c-0c849147ad8d-kube-api-access-f259z\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.539912 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-serving-cert\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.539912 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-oauth-serving-cert\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.539912 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-service-ca\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.539912 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.539889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-oauth-config\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641149 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-serving-cert\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641149 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-oauth-serving-cert\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641362 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-service-ca\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641362 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-oauth-config\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641362 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-trusted-ca-bundle\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641466 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-console-config\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641466 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f259z\" (UniqueName: \"kubernetes.io/projected/ec322645-91ca-4124-aa2c-0c849147ad8d-kube-api-access-f259z\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.641902 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.641880    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-oauth-serving-cert\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.642070 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.642038    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-service-ca\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.642164 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.642086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-console-config\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.642477 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.642457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-trusted-ca-bundle\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.643976 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.643943    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-oauth-config\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.644069 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.644027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-serving-cert\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.650373 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.650354    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f259z\" (UniqueName: \"kubernetes.io/projected/ec322645-91ca-4124-aa2c-0c849147ad8d-kube-api-access-f259z\") pod \"console-6fbcb7cbbd-8slmk\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") " pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.780111 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.780025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:15:57.912115 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:57.911937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbcb7cbbd-8slmk"]
Jul 03 14:15:57.914940 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:15:57.914904    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec322645_91ca_4124_aa2c_0c849147ad8d.slice/crio-0e32a9675f2b4e3ec599d80668307cf1273c4d5fd37bc3d913842913e4d35e9b WatchSource:0}: Error finding container 0e32a9675f2b4e3ec599d80668307cf1273c4d5fd37bc3d913842913e4d35e9b: Status 404 returned error can't find the container with id 0e32a9675f2b4e3ec599d80668307cf1273c4d5fd37bc3d913842913e4d35e9b
Jul 03 14:15:58.508762 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:58.508729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbcb7cbbd-8slmk" event={"ID":"ec322645-91ca-4124-aa2c-0c849147ad8d","Type":"ContainerStarted","Data":"d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4"}
Jul 03 14:15:58.509150 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:58.508775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbcb7cbbd-8slmk" event={"ID":"ec322645-91ca-4124-aa2c-0c849147ad8d","Type":"ContainerStarted","Data":"0e32a9675f2b4e3ec599d80668307cf1273c4d5fd37bc3d913842913e4d35e9b"}
Jul 03 14:15:58.527635 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:15:58.527575    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbcb7cbbd-8slmk" podStartSLOduration=1.52755763 podStartE2EDuration="1.52755763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:15:58.527498243 +0000 UTC m=+255.776155342" watchObservedRunningTime="2026-07-03 14:15:58.52755763 +0000 UTC m=+255.776214730"
Jul 03 14:16:07.780871 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:07.780770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:16:07.781350 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:07.780889    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:16:07.785719 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:07.785672    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:16:08.550637 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:08.550606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:16:31.150774 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.150739    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"]
Jul 03 14:16:31.153372 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.153355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.156550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.156488    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 03 14:16:31.156719 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.156570    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 03 14:16:31.156719 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.156581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 03 14:16:31.156719 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.156571    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 03 14:16:31.164543 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.164519    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"]
Jul 03 14:16:31.308801 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.308763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-tmp\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.308801 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.308804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4pn\" (UniqueName: \"kubernetes.io/projected/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-kube-api-access-rf4pn\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.309006 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.308840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-klusterlet-config\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.410013 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.409928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-tmp\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.410013 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.409964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4pn\" (UniqueName: \"kubernetes.io/projected/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-kube-api-access-rf4pn\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.410013 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.409995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-klusterlet-config\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.410395 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.410376    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-tmp\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.412571 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.412551    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-klusterlet-config\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.419177 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.419153    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4pn\" (UniqueName: \"kubernetes.io/projected/0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82-kube-api-access-rf4pn\") pod \"klusterlet-addon-workmgr-84656d7bb6-2gwwj\" (UID: \"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.463398 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.463366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:31.594130 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.594107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"]
Jul 03 14:16:31.596642 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:16:31.596614    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3dbb4f_08ff_43d1_bb06_afa7e85b1f82.slice/crio-81cb361e163f14d7f4308faa7b4ff842a03c96d1a036af2817f62fb7473c5650 WatchSource:0}: Error finding container 81cb361e163f14d7f4308faa7b4ff842a03c96d1a036af2817f62fb7473c5650: Status 404 returned error can't find the container with id 81cb361e163f14d7f4308faa7b4ff842a03c96d1a036af2817f62fb7473c5650
Jul 03 14:16:31.630284 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:31.630253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj" event={"ID":"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82","Type":"ContainerStarted","Data":"81cb361e163f14d7f4308faa7b4ff842a03c96d1a036af2817f62fb7473c5650"}
Jul 03 14:16:36.658037 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:36.657986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj" event={"ID":"0d3dbb4f-08ff-43d1-bb06-afa7e85b1f82","Type":"ContainerStarted","Data":"344e8c3dc1d1b8ae7753c3cf3f5cfac0f38916dcc34fbf9332c15124bf43b3df"}
Jul 03 14:16:36.658427 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:36.658208    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:36.659951 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:36.659935    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj"
Jul 03 14:16:36.675325 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:36.675090    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84656d7bb6-2gwwj" podStartSLOduration=1.622148972 podStartE2EDuration="5.675071236s" totalImagesPullingTime="4.052922264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:16:36.675020441 +0000 UTC m=+293.923677564" watchObservedRunningTime="2026-07-03 14:16:36.675071236 +0000 UTC m=+293.923728320"
Jul 03 14:16:43.109435 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:43.109408    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:16:43.115672 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:43.115646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:16:43.117283 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:43.117260    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 03 14:16:59.269751 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.269716    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"]
Jul 03 14:16:59.273927 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.273911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.276575 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.276536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48pc4\""
Jul 03 14:16:59.276810 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.276794    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 03 14:16:59.277500 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.277485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 03 14:16:59.285073 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.285054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"]
Jul 03 14:16:59.327636 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.327608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.327768 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.327644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjcz5\" (UniqueName: \"kubernetes.io/projected/63d29703-0478-448a-be74-ced2bd05c183-kube-api-access-qjcz5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.327768 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.327740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.428589 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.428558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.428775 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.428613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.428775 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.428647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjcz5\" (UniqueName: \"kubernetes.io/projected/63d29703-0478-448a-be74-ced2bd05c183-kube-api-access-qjcz5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.429016 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.428991    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.429074 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.429019    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.439197 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.439176    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjcz5\" (UniqueName: \"kubernetes.io/projected/63d29703-0478-448a-be74-ced2bd05c183-kube-api-access-qjcz5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.582610 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.582585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:16:59.709295 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.709265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"]
Jul 03 14:16:59.712760 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:16:59.712733    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d29703_0478_448a_be74_ced2bd05c183.slice/crio-5939179f42929bd03ead909578af7fe576a2a1abcb8136949ccfc2ab8eae2ab1 WatchSource:0}: Error finding container 5939179f42929bd03ead909578af7fe576a2a1abcb8136949ccfc2ab8eae2ab1: Status 404 returned error can't find the container with id 5939179f42929bd03ead909578af7fe576a2a1abcb8136949ccfc2ab8eae2ab1
Jul 03 14:16:59.714719 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.714666    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 14:16:59.739080 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:16:59.739053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm" event={"ID":"63d29703-0478-448a-be74-ced2bd05c183","Type":"ContainerStarted","Data":"5939179f42929bd03ead909578af7fe576a2a1abcb8136949ccfc2ab8eae2ab1"}
Jul 03 14:17:05.772088 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:05.771990    2563 generic.go:356] "Generic (PLEG): container finished" podID="63d29703-0478-448a-be74-ced2bd05c183" containerID="c1090891e7800f41764f5218bc287fc1cae5ff8332203f22e37d77549e3ca5bc" exitCode=0
Jul 03 14:17:05.772088 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:05.772073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm" event={"ID":"63d29703-0478-448a-be74-ced2bd05c183","Type":"ContainerDied","Data":"c1090891e7800f41764f5218bc287fc1cae5ff8332203f22e37d77549e3ca5bc"}
Jul 03 14:17:08.784353 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:08.784316    2563 generic.go:356] "Generic (PLEG): container finished" podID="63d29703-0478-448a-be74-ced2bd05c183" containerID="1a401a78c71ac99a45b42b627fc7b0b3c916401d55bfde8619ac9ee82ae6817b" exitCode=0
Jul 03 14:17:08.784755 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:08.784399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm" event={"ID":"63d29703-0478-448a-be74-ced2bd05c183","Type":"ContainerDied","Data":"1a401a78c71ac99a45b42b627fc7b0b3c916401d55bfde8619ac9ee82ae6817b"}
Jul 03 14:17:16.818079 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:16.818045    2563 generic.go:356] "Generic (PLEG): container finished" podID="63d29703-0478-448a-be74-ced2bd05c183" containerID="3bd60677aaf888021128e5be13dfc9cf95489ccae7f686c49f88f57537a581e5" exitCode=0
Jul 03 14:17:16.818474 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:16.818118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm" event={"ID":"63d29703-0478-448a-be74-ced2bd05c183","Type":"ContainerDied","Data":"3bd60677aaf888021128e5be13dfc9cf95489ccae7f686c49f88f57537a581e5"}
Jul 03 14:17:17.944663 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:17.944640    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:17:18.085125 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.085033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjcz5\" (UniqueName: \"kubernetes.io/projected/63d29703-0478-448a-be74-ced2bd05c183-kube-api-access-qjcz5\") pod \"63d29703-0478-448a-be74-ced2bd05c183\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") "
Jul 03 14:17:18.085125 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.085074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-util\") pod \"63d29703-0478-448a-be74-ced2bd05c183\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") "
Jul 03 14:17:18.085125 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.085125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-bundle\") pod \"63d29703-0478-448a-be74-ced2bd05c183\" (UID: \"63d29703-0478-448a-be74-ced2bd05c183\") "
Jul 03 14:17:18.085882 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.085854    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-bundle" (OuterVolumeSpecName: "bundle") pod "63d29703-0478-448a-be74-ced2bd05c183" (UID: "63d29703-0478-448a-be74-ced2bd05c183"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:17:18.087455 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.087427    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d29703-0478-448a-be74-ced2bd05c183-kube-api-access-qjcz5" (OuterVolumeSpecName: "kube-api-access-qjcz5") pod "63d29703-0478-448a-be74-ced2bd05c183" (UID: "63d29703-0478-448a-be74-ced2bd05c183"). InnerVolumeSpecName "kube-api-access-qjcz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:17:18.089223 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.089203    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-util" (OuterVolumeSpecName: "util") pod "63d29703-0478-448a-be74-ced2bd05c183" (UID: "63d29703-0478-448a-be74-ced2bd05c183"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:17:18.186338 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.186303    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjcz5\" (UniqueName: \"kubernetes.io/projected/63d29703-0478-448a-be74-ced2bd05c183-kube-api-access-qjcz5\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:18.186338 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.186334    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-util\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:18.186338 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.186344    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d29703-0478-448a-be74-ced2bd05c183-bundle\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:18.826418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.826385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm" event={"ID":"63d29703-0478-448a-be74-ced2bd05c183","Type":"ContainerDied","Data":"5939179f42929bd03ead909578af7fe576a2a1abcb8136949ccfc2ab8eae2ab1"}
Jul 03 14:17:18.826418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.826416    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ccxnm"
Jul 03 14:17:18.826622 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:18.826436    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5939179f42929bd03ead909578af7fe576a2a1abcb8136949ccfc2ab8eae2ab1"
Jul 03 14:17:22.247875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.247840    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"]
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="extract"
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248170    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="extract"
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248181    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="util"
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248186    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="util"
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248192    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="pull"
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248198    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="pull"
Jul 03 14:17:22.248314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.248247    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d29703-0478-448a-be74-ced2bd05c183" containerName="extract"
Jul 03 14:17:22.280152 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.280123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"]
Jul 03 14:17:22.280292 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.280240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.283059 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.283040    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ltrvk\""
Jul 03 14:17:22.283292 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.283276    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 03 14:17:22.283516 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.283504    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 03 14:17:22.419514 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.419476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clc7\" (UniqueName: \"kubernetes.io/projected/c1e493cf-a899-4d37-9c07-975acc3dac60-kube-api-access-6clc7\") pod \"cert-manager-operator-controller-manager-55c444bf86-84dn7\" (UID: \"c1e493cf-a899-4d37-9c07-975acc3dac60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.419739 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.419528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1e493cf-a899-4d37-9c07-975acc3dac60-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-84dn7\" (UID: \"c1e493cf-a899-4d37-9c07-975acc3dac60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.520993 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.520905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1e493cf-a899-4d37-9c07-975acc3dac60-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-84dn7\" (UID: \"c1e493cf-a899-4d37-9c07-975acc3dac60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.521142 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.521002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clc7\" (UniqueName: \"kubernetes.io/projected/c1e493cf-a899-4d37-9c07-975acc3dac60-kube-api-access-6clc7\") pod \"cert-manager-operator-controller-manager-55c444bf86-84dn7\" (UID: \"c1e493cf-a899-4d37-9c07-975acc3dac60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.521303 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.521280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1e493cf-a899-4d37-9c07-975acc3dac60-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-84dn7\" (UID: \"c1e493cf-a899-4d37-9c07-975acc3dac60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.534514 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.534484    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clc7\" (UniqueName: \"kubernetes.io/projected/c1e493cf-a899-4d37-9c07-975acc3dac60-kube-api-access-6clc7\") pod \"cert-manager-operator-controller-manager-55c444bf86-84dn7\" (UID: \"c1e493cf-a899-4d37-9c07-975acc3dac60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.588805 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.588768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"
Jul 03 14:17:22.747313 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.747292    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7"]
Jul 03 14:17:22.750066 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:17:22.750036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e493cf_a899_4d37_9c07_975acc3dac60.slice/crio-007a1da8cdf309aaf2df4ebb56adac31858800d2222f0c4dfdd0a0dc6bdc9a6e WatchSource:0}: Error finding container 007a1da8cdf309aaf2df4ebb56adac31858800d2222f0c4dfdd0a0dc6bdc9a6e: Status 404 returned error can't find the container with id 007a1da8cdf309aaf2df4ebb56adac31858800d2222f0c4dfdd0a0dc6bdc9a6e
Jul 03 14:17:22.843655 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:22.843618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7" event={"ID":"c1e493cf-a899-4d37-9c07-975acc3dac60","Type":"ContainerStarted","Data":"007a1da8cdf309aaf2df4ebb56adac31858800d2222f0c4dfdd0a0dc6bdc9a6e"}
Jul 03 14:17:25.859298 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:25.859261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7" event={"ID":"c1e493cf-a899-4d37-9c07-975acc3dac60","Type":"ContainerStarted","Data":"5c9f19d22c2171021319ba033a572ee95ea54a090a8d4081a81d33a126504ebe"}
Jul 03 14:17:25.884794 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:25.884720    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84dn7" podStartSLOduration=0.997847293 podStartE2EDuration="3.884666246s" totalImagesPullingTime="2.886818953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:17:25.883456386 +0000 UTC m=+343.132113484" watchObservedRunningTime="2026-07-03 14:17:25.884666246 +0000 UTC m=+343.133323344"
Jul 03 14:17:26.673306 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.673267    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"]
Jul 03 14:17:26.675932 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.675913    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.678557 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.678528    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 03 14:17:26.678806 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.678787    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48pc4\""
Jul 03 14:17:26.679620 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.679605    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 03 14:17:26.692675 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.692645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"]
Jul 03 14:17:26.756582 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.756544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7xkk\" (UniqueName: \"kubernetes.io/projected/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-kube-api-access-f7xkk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.756582 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.756584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.756831 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.756665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.822438 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.822403    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2sxlx"]
Jul 03 14:17:26.824811 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.824795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:26.827707 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.827670    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 03 14:17:26.827833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.827708    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 03 14:17:26.827833 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.827719    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6zt6j\""
Jul 03 14:17:26.836338 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.836315    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2sxlx"]
Jul 03 14:17:26.857254 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.857229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7xkk\" (UniqueName: \"kubernetes.io/projected/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-kube-api-access-f7xkk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.857389 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.857260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.857389 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.857305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.857715 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.857667    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.857756 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.857728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.868009 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.867984    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7xkk\" (UniqueName: \"kubernetes.io/projected/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-kube-api-access-f7xkk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:26.958032 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.957933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrw72\" (UniqueName: \"kubernetes.io/projected/8ecbc6c9-15af-4759-9573-be7b47d44d7b-kube-api-access-nrw72\") pod \"cert-manager-webhook-6486ffd997-2sxlx\" (UID: \"8ecbc6c9-15af-4759-9573-be7b47d44d7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:26.958032 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.957993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecbc6c9-15af-4759-9573-be7b47d44d7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2sxlx\" (UID: \"8ecbc6c9-15af-4759-9573-be7b47d44d7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:26.984882 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:26.984848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:27.058928 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.058892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw72\" (UniqueName: \"kubernetes.io/projected/8ecbc6c9-15af-4759-9573-be7b47d44d7b-kube-api-access-nrw72\") pod \"cert-manager-webhook-6486ffd997-2sxlx\" (UID: \"8ecbc6c9-15af-4759-9573-be7b47d44d7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:27.059081 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.058937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecbc6c9-15af-4759-9573-be7b47d44d7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2sxlx\" (UID: \"8ecbc6c9-15af-4759-9573-be7b47d44d7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:27.071657 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.071627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecbc6c9-15af-4759-9573-be7b47d44d7b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2sxlx\" (UID: \"8ecbc6c9-15af-4759-9573-be7b47d44d7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:27.073006 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.072954    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrw72\" (UniqueName: \"kubernetes.io/projected/8ecbc6c9-15af-4759-9573-be7b47d44d7b-kube-api-access-nrw72\") pod \"cert-manager-webhook-6486ffd997-2sxlx\" (UID: \"8ecbc6c9-15af-4759-9573-be7b47d44d7b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:27.132642 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.132495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"]
Jul 03 14:17:27.135363 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:17:27.135332    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3882fe96_1511_4bd7_87f8_d04a6a3c9fbc.slice/crio-09e26e9b6340f8e37d2b00020108309445c9a9748a700f2ec41f9e8f5a771366 WatchSource:0}: Error finding container 09e26e9b6340f8e37d2b00020108309445c9a9748a700f2ec41f9e8f5a771366: Status 404 returned error can't find the container with id 09e26e9b6340f8e37d2b00020108309445c9a9748a700f2ec41f9e8f5a771366
Jul 03 14:17:27.144701 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.144665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:27.295473 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.295432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2sxlx"]
Jul 03 14:17:27.297634 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:17:27.297608    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ecbc6c9_15af_4759_9573_be7b47d44d7b.slice/crio-8c6587601b1b17f25b5fa1eb80d00871ca84e82c31574218b0f0d364a66b5819 WatchSource:0}: Error finding container 8c6587601b1b17f25b5fa1eb80d00871ca84e82c31574218b0f0d364a66b5819: Status 404 returned error can't find the container with id 8c6587601b1b17f25b5fa1eb80d00871ca84e82c31574218b0f0d364a66b5819
Jul 03 14:17:27.869405 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.869374    2563 generic.go:356] "Generic (PLEG): container finished" podID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerID="78682dc863fb887c9cdd990f24a9714508688bc1c5ba6fb07066bbab859f8480" exitCode=0
Jul 03 14:17:27.869983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.869464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf" event={"ID":"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc","Type":"ContainerDied","Data":"78682dc863fb887c9cdd990f24a9714508688bc1c5ba6fb07066bbab859f8480"}
Jul 03 14:17:27.869983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.869517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf" event={"ID":"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc","Type":"ContainerStarted","Data":"09e26e9b6340f8e37d2b00020108309445c9a9748a700f2ec41f9e8f5a771366"}
Jul 03 14:17:27.871006 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:27.870978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx" event={"ID":"8ecbc6c9-15af-4759-9573-be7b47d44d7b","Type":"ContainerStarted","Data":"8c6587601b1b17f25b5fa1eb80d00871ca84e82c31574218b0f0d364a66b5819"}
Jul 03 14:17:29.883083 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:29.883051    2563 generic.go:356] "Generic (PLEG): container finished" podID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerID="dab3244fa9f723dacbed7c4e605dfe2314d0a23ed23f953fdd71d799eea31948" exitCode=0
Jul 03 14:17:29.883459 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:29.883129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf" event={"ID":"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc","Type":"ContainerDied","Data":"dab3244fa9f723dacbed7c4e605dfe2314d0a23ed23f953fdd71d799eea31948"}
Jul 03 14:17:30.889836 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:30.889800    2563 generic.go:356] "Generic (PLEG): container finished" podID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerID="bcd4c819c798903083c2b6ec1b708f3de4720951738f77cb6c0f60c0dd08acd7" exitCode=0
Jul 03 14:17:30.890207 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:30.889845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf" event={"ID":"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc","Type":"ContainerDied","Data":"bcd4c819c798903083c2b6ec1b708f3de4720951738f77cb6c0f60c0dd08acd7"}
Jul 03 14:17:32.025112 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.025087    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:32.100568 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.100532    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-util\") pod \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") "
Jul 03 14:17:32.100568 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.100575    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7xkk\" (UniqueName: \"kubernetes.io/projected/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-kube-api-access-f7xkk\") pod \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") "
Jul 03 14:17:32.100804 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.100647    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-bundle\") pod \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\" (UID: \"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc\") "
Jul 03 14:17:32.101087 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.101060    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-bundle" (OuterVolumeSpecName: "bundle") pod "3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" (UID: "3882fe96-1511-4bd7-87f8-d04a6a3c9fbc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:17:32.102932 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.102914    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-kube-api-access-f7xkk" (OuterVolumeSpecName: "kube-api-access-f7xkk") pod "3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" (UID: "3882fe96-1511-4bd7-87f8-d04a6a3c9fbc"). InnerVolumeSpecName "kube-api-access-f7xkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:17:32.108773 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.108748    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-util" (OuterVolumeSpecName: "util") pod "3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" (UID: "3882fe96-1511-4bd7-87f8-d04a6a3c9fbc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:17:32.202193 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.202105    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-bundle\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:32.202193 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.202135    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-util\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:32.202193 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.202144    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7xkk\" (UniqueName: \"kubernetes.io/projected/3882fe96-1511-4bd7-87f8-d04a6a3c9fbc-kube-api-access-f7xkk\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:32.906020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.905994    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf"
Jul 03 14:17:32.906020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.906005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gnjf" event={"ID":"3882fe96-1511-4bd7-87f8-d04a6a3c9fbc","Type":"ContainerDied","Data":"09e26e9b6340f8e37d2b00020108309445c9a9748a700f2ec41f9e8f5a771366"}
Jul 03 14:17:32.906227 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:32.906044    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09e26e9b6340f8e37d2b00020108309445c9a9748a700f2ec41f9e8f5a771366"
Jul 03 14:17:38.306827 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.306748    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gpqhx"]
Jul 03 14:17:38.307191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307089    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="pull"
Jul 03 14:17:38.307191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="pull"
Jul 03 14:17:38.307191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307112    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="extract"
Jul 03 14:17:38.307191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307118    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="extract"
Jul 03 14:17:38.307191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307126    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="util"
Jul 03 14:17:38.307191 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307131    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="util"
Jul 03 14:17:38.307374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.307199    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3882fe96-1511-4bd7-87f8-d04a6a3c9fbc" containerName="extract"
Jul 03 14:17:38.310916 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.310896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.313216 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.313196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6c95h\""
Jul 03 14:17:38.321095 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.321071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gpqhx"]
Jul 03 14:17:38.454086 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.454045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc1a937d-1edd-4e32-9176-af01506c893c-bound-sa-token\") pod \"cert-manager-55b4d954d5-gpqhx\" (UID: \"fc1a937d-1edd-4e32-9176-af01506c893c\") " pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.454086 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.454091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wnqz\" (UniqueName: \"kubernetes.io/projected/fc1a937d-1edd-4e32-9176-af01506c893c-kube-api-access-2wnqz\") pod \"cert-manager-55b4d954d5-gpqhx\" (UID: \"fc1a937d-1edd-4e32-9176-af01506c893c\") " pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.554651 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.554614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc1a937d-1edd-4e32-9176-af01506c893c-bound-sa-token\") pod \"cert-manager-55b4d954d5-gpqhx\" (UID: \"fc1a937d-1edd-4e32-9176-af01506c893c\") " pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.554876 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.554658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wnqz\" (UniqueName: \"kubernetes.io/projected/fc1a937d-1edd-4e32-9176-af01506c893c-kube-api-access-2wnqz\") pod \"cert-manager-55b4d954d5-gpqhx\" (UID: \"fc1a937d-1edd-4e32-9176-af01506c893c\") " pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.564574 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.564505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc1a937d-1edd-4e32-9176-af01506c893c-bound-sa-token\") pod \"cert-manager-55b4d954d5-gpqhx\" (UID: \"fc1a937d-1edd-4e32-9176-af01506c893c\") " pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.564574 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.564561    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wnqz\" (UniqueName: \"kubernetes.io/projected/fc1a937d-1edd-4e32-9176-af01506c893c-kube-api-access-2wnqz\") pod \"cert-manager-55b4d954d5-gpqhx\" (UID: \"fc1a937d-1edd-4e32-9176-af01506c893c\") " pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.619701 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.619638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gpqhx"
Jul 03 14:17:38.751313 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.751278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gpqhx"]
Jul 03 14:17:38.753924 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:17:38.753896    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc1a937d_1edd_4e32_9176_af01506c893c.slice/crio-f7aef409809971c54ddf19c79dbff357b0258ae9a18f7d9773dc6026430da138 WatchSource:0}: Error finding container f7aef409809971c54ddf19c79dbff357b0258ae9a18f7d9773dc6026430da138: Status 404 returned error can't find the container with id f7aef409809971c54ddf19c79dbff357b0258ae9a18f7d9773dc6026430da138
Jul 03 14:17:38.932663 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:38.932629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gpqhx" event={"ID":"fc1a937d-1edd-4e32-9176-af01506c893c","Type":"ContainerStarted","Data":"f7aef409809971c54ddf19c79dbff357b0258ae9a18f7d9773dc6026430da138"}
Jul 03 14:17:41.948418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:41.948385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gpqhx" event={"ID":"fc1a937d-1edd-4e32-9176-af01506c893c","Type":"ContainerStarted","Data":"8651d9bc211489a03e652b482bdf6e34b79ce864af4a59c715c131a54a04679a"}
Jul 03 14:17:41.966091 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:41.966026    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gpqhx" podStartSLOduration=1.160949084 podStartE2EDuration="3.96600594s" totalImagesPullingTime="2.805056856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:17:41.965773976 +0000 UTC m=+359.214431075" watchObservedRunningTime="2026-07-03 14:17:41.96600594 +0000 UTC m=+359.214663040"
Jul 03 14:17:45.571242 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.571205    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"]
Jul 03 14:17:45.574151 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.574125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.576568 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.576549    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 03 14:17:45.577414 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.577387    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 03 14:17:45.577414 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.577414    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48pc4\""
Jul 03 14:17:45.583081 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.583058    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"]
Jul 03 14:17:45.714779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.714744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.714779 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.714784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4lz\" (UniqueName: \"kubernetes.io/projected/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-kube-api-access-sg4lz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.715034 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.714889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.815803 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.815763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.815803 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.815805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4lz\" (UniqueName: \"kubernetes.io/projected/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-kube-api-access-sg4lz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.816076 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.815852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.816303 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.816279    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.816375 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.816302    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.825887 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.825810    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4lz\" (UniqueName: \"kubernetes.io/projected/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-kube-api-access-sg4lz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:45.885237 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:45.885202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:46.022460 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:46.022434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"]
Jul 03 14:17:46.024796 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:17:46.024769    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4d82e8_fb5f_44b6_b9a7_efac646c4421.slice/crio-02481a52506544d27f3ee9b19f082003ccf73e00378c2ceaf198e89def05833d WatchSource:0}: Error finding container 02481a52506544d27f3ee9b19f082003ccf73e00378c2ceaf198e89def05833d: Status 404 returned error can't find the container with id 02481a52506544d27f3ee9b19f082003ccf73e00378c2ceaf198e89def05833d
Jul 03 14:17:46.971667 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:46.971628    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerID="45ecfd395255cff725bebf20c5370190fffe3e716d73e92110e726f8eee4db1b" exitCode=0
Jul 03 14:17:46.972094 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:46.971724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc" event={"ID":"ae4d82e8-fb5f-44b6-b9a7-efac646c4421","Type":"ContainerDied","Data":"45ecfd395255cff725bebf20c5370190fffe3e716d73e92110e726f8eee4db1b"}
Jul 03 14:17:46.972094 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:46.971809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc" event={"ID":"ae4d82e8-fb5f-44b6-b9a7-efac646c4421","Type":"ContainerStarted","Data":"02481a52506544d27f3ee9b19f082003ccf73e00378c2ceaf198e89def05833d"}
Jul 03 14:17:48.981792 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:48.981754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx" event={"ID":"8ecbc6c9-15af-4759-9573-be7b47d44d7b","Type":"ContainerStarted","Data":"c33fab5fc9e27e6634019e18c8c5a642a48308fc4b4a4599902b2b0d1927c2bc"}
Jul 03 14:17:48.982358 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:48.981809    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:17:48.983545 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:48.983513    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerID="ea92c39e0422b3d12ef40c427c2d80f41e5a47c3d5f2cf4c68d98f668336a152" exitCode=0
Jul 03 14:17:48.983651 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:48.983584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc" event={"ID":"ae4d82e8-fb5f-44b6-b9a7-efac646c4421","Type":"ContainerDied","Data":"ea92c39e0422b3d12ef40c427c2d80f41e5a47c3d5f2cf4c68d98f668336a152"}
Jul 03 14:17:49.003145 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:49.003109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx" podStartSLOduration=2.010057744 podStartE2EDuration="23.003095109s" totalImagesPullingTime="20.993037365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:17:49.000998182 +0000 UTC m=+366.249655282" watchObservedRunningTime="2026-07-03 14:17:49.003095109 +0000 UTC m=+366.251752209"
Jul 03 14:17:49.990241 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:49.990208    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerID="717da16140221b8d3102fc4b0f12f3e25c6f1ccae196297354f00dbf773d0838" exitCode=0
Jul 03 14:17:49.990606 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:49.990283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc" event={"ID":"ae4d82e8-fb5f-44b6-b9a7-efac646c4421","Type":"ContainerDied","Data":"717da16140221b8d3102fc4b0f12f3e25c6f1ccae196297354f00dbf773d0838"}
Jul 03 14:17:51.119022 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.118996    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:51.156341 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.156316    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-util\") pod \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") "
Jul 03 14:17:51.156484 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.156366    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-bundle\") pod \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") "
Jul 03 14:17:51.156484 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.156397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg4lz\" (UniqueName: \"kubernetes.io/projected/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-kube-api-access-sg4lz\") pod \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\" (UID: \"ae4d82e8-fb5f-44b6-b9a7-efac646c4421\") "
Jul 03 14:17:51.157166 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.157140    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-bundle" (OuterVolumeSpecName: "bundle") pod "ae4d82e8-fb5f-44b6-b9a7-efac646c4421" (UID: "ae4d82e8-fb5f-44b6-b9a7-efac646c4421"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:17:51.158502 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.158483    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-kube-api-access-sg4lz" (OuterVolumeSpecName: "kube-api-access-sg4lz") pod "ae4d82e8-fb5f-44b6-b9a7-efac646c4421" (UID: "ae4d82e8-fb5f-44b6-b9a7-efac646c4421"). InnerVolumeSpecName "kube-api-access-sg4lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:17:51.161704 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.161655    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-util" (OuterVolumeSpecName: "util") pod "ae4d82e8-fb5f-44b6-b9a7-efac646c4421" (UID: "ae4d82e8-fb5f-44b6-b9a7-efac646c4421"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:17:51.257503 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.257438    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-bundle\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:51.257503 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.257460    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg4lz\" (UniqueName: \"kubernetes.io/projected/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-kube-api-access-sg4lz\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:51.257503 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:51.257469    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae4d82e8-fb5f-44b6-b9a7-efac646c4421-util\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:17:52.000972 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:52.000945    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc"
Jul 03 14:17:52.001143 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:52.000940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxbhc" event={"ID":"ae4d82e8-fb5f-44b6-b9a7-efac646c4421","Type":"ContainerDied","Data":"02481a52506544d27f3ee9b19f082003ccf73e00378c2ceaf198e89def05833d"}
Jul 03 14:17:52.001143 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:52.001059    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02481a52506544d27f3ee9b19f082003ccf73e00378c2ceaf198e89def05833d"
Jul 03 14:17:54.992577 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:17:54.992547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2sxlx"
Jul 03 14:18:03.333631 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333602    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"]
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333895    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="pull"
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333907    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="pull"
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333919    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="extract"
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333925    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="extract"
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333941    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="util"
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333946    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="util"
Jul 03 14:18:03.334116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.333995    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4d82e8-fb5f-44b6-b9a7-efac646c4421" containerName="extract"
Jul 03 14:18:03.337807 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.337789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.340243 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.340223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 03 14:18:03.340243 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.340237    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 03 14:18:03.340924 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.340903    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 03 14:18:03.341160 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.341136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kf7mt\""
Jul 03 14:18:03.341309 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.340948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 03 14:18:03.354789 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.354762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11db2e69-a71b-4760-a71f-32bfe6820c29-manifests\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.354940 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.354812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11db2e69-a71b-4760-a71f-32bfe6820c29-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.354940 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.354852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11db2e69-a71b-4760-a71f-32bfe6820c29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.354940 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.354911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f2m5\" (UniqueName: \"kubernetes.io/projected/11db2e69-a71b-4760-a71f-32bfe6820c29-kube-api-access-9f2m5\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.355068 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.354969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11db2e69-a71b-4760-a71f-32bfe6820c29-tmp\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.360237 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.360207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"]
Jul 03 14:18:03.455554 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.455516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11db2e69-a71b-4760-a71f-32bfe6820c29-manifests\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.455554 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.455557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11db2e69-a71b-4760-a71f-32bfe6820c29-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.455846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.455575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11db2e69-a71b-4760-a71f-32bfe6820c29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.455846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.455608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f2m5\" (UniqueName: \"kubernetes.io/projected/11db2e69-a71b-4760-a71f-32bfe6820c29-kube-api-access-9f2m5\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.455846 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.455728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11db2e69-a71b-4760-a71f-32bfe6820c29-tmp\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.456054 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.456028    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11db2e69-a71b-4760-a71f-32bfe6820c29-manifests\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.458126 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.458102    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11db2e69-a71b-4760-a71f-32bfe6820c29-tmp\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.458325 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.458307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11db2e69-a71b-4760-a71f-32bfe6820c29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.458368 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.458330    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11db2e69-a71b-4760-a71f-32bfe6820c29-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.468149 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.468126    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f2m5\" (UniqueName: \"kubernetes.io/projected/11db2e69-a71b-4760-a71f-32bfe6820c29-kube-api-access-9f2m5\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-46x47\" (UID: \"11db2e69-a71b-4760-a71f-32bfe6820c29\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.653821 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.653731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:03.808799 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:03.808765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"]
Jul 03 14:18:03.812401 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:18:03.812377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11db2e69_a71b_4760_a71f_32bfe6820c29.slice/crio-1daca239621e8f63030f79297d5ff2d97a4fe179a7f05b37f6d7351a17cd85c4 WatchSource:0}: Error finding container 1daca239621e8f63030f79297d5ff2d97a4fe179a7f05b37f6d7351a17cd85c4: Status 404 returned error can't find the container with id 1daca239621e8f63030f79297d5ff2d97a4fe179a7f05b37f6d7351a17cd85c4
Jul 03 14:18:04.055396 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:04.055318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47" event={"ID":"11db2e69-a71b-4760-a71f-32bfe6820c29","Type":"ContainerStarted","Data":"1daca239621e8f63030f79297d5ff2d97a4fe179a7f05b37f6d7351a17cd85c4"}
Jul 03 14:18:07.074265 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:07.074230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47" event={"ID":"11db2e69-a71b-4760-a71f-32bfe6820c29","Type":"ContainerStarted","Data":"ef6fcbbe3819912588dd3c70563b98db9579892e0b8e576f140450bedb0a2c38"}
Jul 03 14:18:08.080448 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:08.080415    2563 generic.go:356] "Generic (PLEG): container finished" podID="11db2e69-a71b-4760-a71f-32bfe6820c29" containerID="ef6fcbbe3819912588dd3c70563b98db9579892e0b8e576f140450bedb0a2c38" exitCode=0
Jul 03 14:18:08.080864 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:08.080500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47" event={"ID":"11db2e69-a71b-4760-a71f-32bfe6820c29","Type":"ContainerDied","Data":"ef6fcbbe3819912588dd3c70563b98db9579892e0b8e576f140450bedb0a2c38"}
Jul 03 14:18:09.087184 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:09.087152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47" event={"ID":"11db2e69-a71b-4760-a71f-32bfe6820c29","Type":"ContainerStarted","Data":"0701e7e42cc19adf8d4fc2bbb28921cd0aa08d7dedb53ab6223d2396c38a3f6e"}
Jul 03 14:18:09.087591 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:09.087285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:09.111321 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:09.111278    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47" podStartSLOduration=1.8744927260000002 podStartE2EDuration="6.111262397s" totalImagesPullingTime="3.148348954s" totalInitContainerRuntime="1.088420717s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:09.109244075 +0000 UTC m=+386.357901174" watchObservedRunningTime="2026-07-03 14:18:09.111262397 +0000 UTC m=+386.359919495"
Jul 03 14:18:20.094224 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:20.094195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-46x47"
Jul 03 14:18:22.162262 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.162232    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"]
Jul 03 14:18:22.167896 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.167864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.170657 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.170634    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 03 14:18:22.170821 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.170753    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 03 14:18:22.170821 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.170774    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t5tq5\""
Jul 03 14:18:22.177935 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.177903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"]
Jul 03 14:18:22.317552 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.317515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afb1e616-c348-43c2-8bfc-b686c4955161-tls-certs\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.317552 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.317551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afb1e616-c348-43c2-8bfc-b686c4955161-tmp\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.317786 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.317575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhn7x\" (UniqueName: \"kubernetes.io/projected/afb1e616-c348-43c2-8bfc-b686c4955161-kube-api-access-dhn7x\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.418298 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.418215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afb1e616-c348-43c2-8bfc-b686c4955161-tls-certs\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.418298 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.418249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afb1e616-c348-43c2-8bfc-b686c4955161-tmp\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.418544 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.418316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhn7x\" (UniqueName: \"kubernetes.io/projected/afb1e616-c348-43c2-8bfc-b686c4955161-kube-api-access-dhn7x\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.418544 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:18:22.418378    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 03 14:18:22.418544 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:18:22.418472    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb1e616-c348-43c2-8bfc-b686c4955161-tls-certs podName:afb1e616-c348-43c2-8bfc-b686c4955161 nodeName:}" failed. No retries permitted until 2026-07-03 14:18:22.918452759 +0000 UTC m=+400.167109837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/afb1e616-c348-43c2-8bfc-b686c4955161-tls-certs") pod "kube-auth-proxy-75b86bc795-5ws4j" (UID: "afb1e616-c348-43c2-8bfc-b686c4955161") : secret "kube-auth-proxy-tls" not found
Jul 03 14:18:22.420588 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.420567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afb1e616-c348-43c2-8bfc-b686c4955161-tmp\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.442550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.442522    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhn7x\" (UniqueName: \"kubernetes.io/projected/afb1e616-c348-43c2-8bfc-b686c4955161-kube-api-access-dhn7x\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.922783 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.922747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afb1e616-c348-43c2-8bfc-b686c4955161-tls-certs\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:22.925329 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:22.925303    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afb1e616-c348-43c2-8bfc-b686c4955161-tls-certs\") pod \"kube-auth-proxy-75b86bc795-5ws4j\" (UID: \"afb1e616-c348-43c2-8bfc-b686c4955161\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:23.077811 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.077776    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"
Jul 03 14:18:23.246259 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.246227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j"]
Jul 03 14:18:23.249989 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:18:23.249967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb1e616_c348_43c2_8bfc_b686c4955161.slice/crio-ed8e5ed81d054305cfb715ffa0b730d88d2887dad294b57b07b8064c88c80527 WatchSource:0}: Error finding container ed8e5ed81d054305cfb715ffa0b730d88d2887dad294b57b07b8064c88c80527: Status 404 returned error can't find the container with id ed8e5ed81d054305cfb715ffa0b730d88d2887dad294b57b07b8064c88c80527
Jul 03 14:18:23.709280 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.709249    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ftv7j"]
Jul 03 14:18:23.712026 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.712005    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:23.714401 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.714378    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 03 14:18:23.733116 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.733095    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ftv7j"]
Jul 03 14:18:23.830486 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.830451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brlt\" (UniqueName: \"kubernetes.io/projected/d908e1a9-e9ce-42b6-b555-5bfdadedeb18-kube-api-access-6brlt\") pod \"model-serving-api-54d89bd5fc-ftv7j\" (UID: \"d908e1a9-e9ce-42b6-b555-5bfdadedeb18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:23.830647 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.830513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d908e1a9-e9ce-42b6-b555-5bfdadedeb18-tls-certs\") pod \"model-serving-api-54d89bd5fc-ftv7j\" (UID: \"d908e1a9-e9ce-42b6-b555-5bfdadedeb18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:23.931832 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.931799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brlt\" (UniqueName: \"kubernetes.io/projected/d908e1a9-e9ce-42b6-b555-5bfdadedeb18-kube-api-access-6brlt\") pod \"model-serving-api-54d89bd5fc-ftv7j\" (UID: \"d908e1a9-e9ce-42b6-b555-5bfdadedeb18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:23.932017 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.931867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d908e1a9-e9ce-42b6-b555-5bfdadedeb18-tls-certs\") pod \"model-serving-api-54d89bd5fc-ftv7j\" (UID: \"d908e1a9-e9ce-42b6-b555-5bfdadedeb18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:23.934594 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.934563    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d908e1a9-e9ce-42b6-b555-5bfdadedeb18-tls-certs\") pod \"model-serving-api-54d89bd5fc-ftv7j\" (UID: \"d908e1a9-e9ce-42b6-b555-5bfdadedeb18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:23.941352 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:23.941322    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brlt\" (UniqueName: \"kubernetes.io/projected/d908e1a9-e9ce-42b6-b555-5bfdadedeb18-kube-api-access-6brlt\") pod \"model-serving-api-54d89bd5fc-ftv7j\" (UID: \"d908e1a9-e9ce-42b6-b555-5bfdadedeb18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:24.022321 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:24.022230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:24.166214 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:24.166169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j" event={"ID":"afb1e616-c348-43c2-8bfc-b686c4955161","Type":"ContainerStarted","Data":"ed8e5ed81d054305cfb715ffa0b730d88d2887dad294b57b07b8064c88c80527"}
Jul 03 14:18:24.185978 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:24.185906    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ftv7j"]
Jul 03 14:18:24.188511 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:18:24.188478    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd908e1a9_e9ce_42b6_b555_5bfdadedeb18.slice/crio-3f0f23a6633b3bc28f23f0b93660a589db2931db0142e34ae948154cf56f1108 WatchSource:0}: Error finding container 3f0f23a6633b3bc28f23f0b93660a589db2931db0142e34ae948154cf56f1108: Status 404 returned error can't find the container with id 3f0f23a6633b3bc28f23f0b93660a589db2931db0142e34ae948154cf56f1108
Jul 03 14:18:25.173769 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:25.173721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j" event={"ID":"d908e1a9-e9ce-42b6-b555-5bfdadedeb18","Type":"ContainerStarted","Data":"3f0f23a6633b3bc28f23f0b93660a589db2931db0142e34ae948154cf56f1108"}
Jul 03 14:18:27.184999 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:27.184961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j" event={"ID":"d908e1a9-e9ce-42b6-b555-5bfdadedeb18","Type":"ContainerStarted","Data":"06f15cd128e127fda4c858f02f1deac76c20fa83919854f6d9561f6644dd6386"}
Jul 03 14:18:27.185454 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:27.185048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:27.186731 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:27.186709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j" event={"ID":"afb1e616-c348-43c2-8bfc-b686c4955161","Type":"ContainerStarted","Data":"77174f7e959042a064ab38bc46c6c1086111e36ebdd096fe48edd253e01112a9"}
Jul 03 14:18:27.203332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:27.203293    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j" podStartSLOduration=1.956622955 podStartE2EDuration="4.203280308s" totalImagesPullingTime="2.246657353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:27.201877201 +0000 UTC m=+404.450534301" watchObservedRunningTime="2026-07-03 14:18:27.203280308 +0000 UTC m=+404.451937415"
Jul 03 14:18:27.218285 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:27.218243    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75b86bc795-5ws4j" podStartSLOduration=2.031919891 podStartE2EDuration="5.218228221s" totalImagesPullingTime="3.18630833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:27.216578123 +0000 UTC m=+404.465235221" watchObservedRunningTime="2026-07-03 14:18:27.218228221 +0000 UTC m=+404.466885350"
Jul 03 14:18:29.637267 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.637235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"]
Jul 03 14:18:29.639521 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.639502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.642487 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.642029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 03 14:18:29.642487 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.642100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 03 14:18:29.642487 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.642230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 03 14:18:29.642487 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.642354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 03 14:18:29.642487 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.642491    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g48vm\""
Jul 03 14:18:29.660000 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.659974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"]
Jul 03 14:18:29.784064 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.784258 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8c6j\" (UniqueName: \"kubernetes.io/projected/6f366185-c986-4a08-918a-cc5a60e3f768-kube-api-access-r8c6j\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.784258 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f366185-c986-4a08-918a-cc5a60e3f768-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.784258 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.784258 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f366185-c986-4a08-918a-cc5a60e3f768-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.784410 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.784410 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.784319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f366185-c986-4a08-918a-cc5a60e3f768-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.885878 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.885849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886062 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.885887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f366185-c986-4a08-918a-cc5a60e3f768-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886062 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.885912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886062 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.885958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f366185-c986-4a08-918a-cc5a60e3f768-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886062 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.886021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886062 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.886052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8c6j\" (UniqueName: \"kubernetes.io/projected/6f366185-c986-4a08-918a-cc5a60e3f768-kube-api-access-r8c6j\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886332 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.886088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f366185-c986-4a08-918a-cc5a60e3f768-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.886892 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.886815    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f366185-c986-4a08-918a-cc5a60e3f768-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.888700 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.888619    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f366185-c986-4a08-918a-cc5a60e3f768-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.888852 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.888699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.888938 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.888921    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.889006 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.888982    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f366185-c986-4a08-918a-cc5a60e3f768-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.903014 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.902987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8c6j\" (UniqueName: \"kubernetes.io/projected/6f366185-c986-4a08-918a-cc5a60e3f768-kube-api-access-r8c6j\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.904618 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.904598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f366185-c986-4a08-918a-cc5a60e3f768-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-645vp\" (UID: \"6f366185-c986-4a08-918a-cc5a60e3f768\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:29.953776 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:29.953744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:30.100961 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.100934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"]
Jul 03 14:18:30.103627 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:18:30.103603    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f366185_c986_4a08_918a_cc5a60e3f768.slice/crio-e66d20ceda5210c0a67b6d80110a31f48c980d9fafe0beadfb680d26d2183a25 WatchSource:0}: Error finding container e66d20ceda5210c0a67b6d80110a31f48c980d9fafe0beadfb680d26d2183a25: Status 404 returned error can't find the container with id e66d20ceda5210c0a67b6d80110a31f48c980d9fafe0beadfb680d26d2183a25
Jul 03 14:18:30.201175 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.201078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp" event={"ID":"6f366185-c986-4a08-918a-cc5a60e3f768","Type":"ContainerStarted","Data":"e66d20ceda5210c0a67b6d80110a31f48c980d9fafe0beadfb680d26d2183a25"}
Jul 03 14:18:30.388288 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.388260    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"]
Jul 03 14:18:30.391320 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.391303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.394612 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.394585    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 03 14:18:30.394940 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.394922    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 03 14:18:30.395283 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.395264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j8m2t\""
Jul 03 14:18:30.396016 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.395902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 03 14:18:30.396016 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.395989    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 03 14:18:30.397835 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.396200    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 03 14:18:30.404651 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.404389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"]
Jul 03 14:18:30.491526 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.491457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/affefb83-55b5-4454-8d0d-0b73bd67af3d-cert\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.491526 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.491491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm86k\" (UniqueName: \"kubernetes.io/projected/affefb83-55b5-4454-8d0d-0b73bd67af3d-kube-api-access-zm86k\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.491763 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.491662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/affefb83-55b5-4454-8d0d-0b73bd67af3d-metrics-cert\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.491808 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.491779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/affefb83-55b5-4454-8d0d-0b73bd67af3d-manager-config\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.593236 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.593182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/affefb83-55b5-4454-8d0d-0b73bd67af3d-metrics-cert\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.593431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.593259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/affefb83-55b5-4454-8d0d-0b73bd67af3d-manager-config\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.593431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.593296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/affefb83-55b5-4454-8d0d-0b73bd67af3d-cert\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.593431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.593318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm86k\" (UniqueName: \"kubernetes.io/projected/affefb83-55b5-4454-8d0d-0b73bd67af3d-kube-api-access-zm86k\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.594411 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.594359    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/affefb83-55b5-4454-8d0d-0b73bd67af3d-manager-config\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.597412 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.597383    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/affefb83-55b5-4454-8d0d-0b73bd67af3d-cert\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.599629 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.599595    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/affefb83-55b5-4454-8d0d-0b73bd67af3d-metrics-cert\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.606055 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.606033    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm86k\" (UniqueName: \"kubernetes.io/projected/affefb83-55b5-4454-8d0d-0b73bd67af3d-kube-api-access-zm86k\") pod \"lws-controller-manager-77cf67f8d7-8zbzq\" (UID: \"affefb83-55b5-4454-8d0d-0b73bd67af3d\") " pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.707211 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.707172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:30.865486 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:30.865457    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"]
Jul 03 14:18:31.045937 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:18:31.045861    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffefb83_55b5_4454_8d0d_0b73bd67af3d.slice/crio-4345e86d751d0425add999d5ec6fc7c9adbc3db1cfc0984f73931b9786f97e3c WatchSource:0}: Error finding container 4345e86d751d0425add999d5ec6fc7c9adbc3db1cfc0984f73931b9786f97e3c: Status 404 returned error can't find the container with id 4345e86d751d0425add999d5ec6fc7c9adbc3db1cfc0984f73931b9786f97e3c
Jul 03 14:18:31.207579 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:31.207517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq" event={"ID":"affefb83-55b5-4454-8d0d-0b73bd67af3d","Type":"ContainerStarted","Data":"4345e86d751d0425add999d5ec6fc7c9adbc3db1cfc0984f73931b9786f97e3c"}
Jul 03 14:18:32.389324 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:32.389277    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 14:18:32.389727 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:32.389360    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 14:18:33.220488 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:33.220448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp" event={"ID":"6f366185-c986-4a08-918a-cc5a60e3f768","Type":"ContainerStarted","Data":"64436d6b14c29bcad5deec40fe6e997ea4eb9206225d08b97c85dab3252cd3c4"}
Jul 03 14:18:33.220659 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:33.220566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:33.222648 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:33.222616    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-645vp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 03 14:18:33.222804 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:33.222675    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp" podUID="6f366185-c986-4a08-918a-cc5a60e3f768" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 14:18:33.243724 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:33.243641    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp" podStartSLOduration=1.961045726 podStartE2EDuration="4.24362412s" totalImagesPullingTime="2.282578394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:33.242065316 +0000 UTC m=+410.490722612" watchObservedRunningTime="2026-07-03 14:18:33.24362412 +0000 UTC m=+410.492281218"
Jul 03 14:18:34.226577 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:34.226536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq" event={"ID":"affefb83-55b5-4454-8d0d-0b73bd67af3d","Type":"ContainerStarted","Data":"9258e35e5d9d436a0621521e5064e778b778484f9491f3a89b442c17302add23"}
Jul 03 14:18:34.227079 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:34.226815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:18:34.227375 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:34.227352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-645vp"
Jul 03 14:18:34.283396 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:34.283336    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq" podStartSLOduration=2.006359541 podStartE2EDuration="4.283314694s" totalImagesPullingTime="2.276955153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:34.254889315 +0000 UTC m=+411.503546427" watchObservedRunningTime="2026-07-03 14:18:34.283314694 +0000 UTC m=+411.531971793"
Jul 03 14:18:38.195605 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:38.195575    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ftv7j"
Jul 03 14:18:45.233636 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:18:45.233603    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77cf67f8d7-8zbzq"
Jul 03 14:20:10.749134 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:10.749099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbcb7cbbd-8slmk"]
Jul 03 14:20:35.770945 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:35.770852    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fbcb7cbbd-8slmk" podUID="ec322645-91ca-4124-aa2c-0c849147ad8d" containerName="console" containerID="cri-o://d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4" gracePeriod=15
Jul 03 14:20:36.018322 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.018301    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:20:36.066736 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066644    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-trusted-ca-bundle\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.066736 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-serving-cert\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.066736 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f259z\" (UniqueName: \"kubernetes.io/projected/ec322645-91ca-4124-aa2c-0c849147ad8d-kube-api-access-f259z\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.066992 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066765    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-console-config\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.066992 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066792    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-oauth-config\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.066992 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-oauth-serving-cert\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.066992 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.066841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-service-ca\") pod \"ec322645-91ca-4124-aa2c-0c849147ad8d\" (UID: \"ec322645-91ca-4124-aa2c-0c849147ad8d\") "
Jul 03 14:20:36.067203 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.067152    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:20:36.067260 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.067207    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-console-config" (OuterVolumeSpecName: "console-config") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:20:36.067314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.067277    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:20:36.067459 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.067435    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 14:20:36.068988 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.068965    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:20:36.069469 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.069447    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:20:36.069469 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.069459    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec322645-91ca-4124-aa2c-0c849147ad8d-kube-api-access-f259z" (OuterVolumeSpecName: "kube-api-access-f259z") pod "ec322645-91ca-4124-aa2c-0c849147ad8d" (UID: "ec322645-91ca-4124-aa2c-0c849147ad8d"). InnerVolumeSpecName "kube-api-access-f259z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:20:36.168139 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168104    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-trusted-ca-bundle\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.168139 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168135    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-serving-cert\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.168139 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168145    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f259z\" (UniqueName: \"kubernetes.io/projected/ec322645-91ca-4124-aa2c-0c849147ad8d-kube-api-access-f259z\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.168366 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168155    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-console-config\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.168366 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168163    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec322645-91ca-4124-aa2c-0c849147ad8d-console-oauth-config\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.168366 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168171    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-oauth-serving-cert\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.168366 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.168179    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec322645-91ca-4124-aa2c-0c849147ad8d-service-ca\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:20:36.798848 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.798815    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec322645-91ca-4124-aa2c-0c849147ad8d" containerID="d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4" exitCode=0
Jul 03 14:20:36.799330 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.798860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbcb7cbbd-8slmk"
Jul 03 14:20:36.799330 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.798887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbcb7cbbd-8slmk" event={"ID":"ec322645-91ca-4124-aa2c-0c849147ad8d","Type":"ContainerDied","Data":"d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4"}
Jul 03 14:20:36.799330 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.798934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbcb7cbbd-8slmk" event={"ID":"ec322645-91ca-4124-aa2c-0c849147ad8d","Type":"ContainerDied","Data":"0e32a9675f2b4e3ec599d80668307cf1273c4d5fd37bc3d913842913e4d35e9b"}
Jul 03 14:20:36.799330 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.798964    2563 scope.go:117] "RemoveContainer" containerID="d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4"
Jul 03 14:20:36.808047 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.808028    2563 scope.go:117] "RemoveContainer" containerID="d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4"
Jul 03 14:20:36.808313 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:20:36.808293    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4\": container with ID starting with d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4 not found: ID does not exist" containerID="d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4"
Jul 03 14:20:36.808376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.808323    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4"} err="failed to get container status \"d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4\": rpc error: code = NotFound desc = could not find container \"d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4\": container with ID starting with d06fc97a7c0d2010b033fabedc018645ed33ca1fce76948227ef6bc1191929e4 not found: ID does not exist"
Jul 03 14:20:36.826604 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.826581    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbcb7cbbd-8slmk"]
Jul 03 14:20:36.832247 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:36.832224    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbcb7cbbd-8slmk"]
Jul 03 14:20:37.314049 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:20:37.314009    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec322645-91ca-4124-aa2c-0c849147ad8d" path="/var/lib/kubelet/pods/ec322645-91ca-4124-aa2c-0c849147ad8d/volumes"
Jul 03 14:21:43.139547 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:21:43.139515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:21:43.144241 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:21:43.144221    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:26:43.167863 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:26:43.167786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:26:43.170581 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:26:43.170559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:31:43.198998 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:31:43.198966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:31:43.200533 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:31:43.200511    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:36:43.230745 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:36:43.230717    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:36:43.231271 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:36:43.230717    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:41:43.258320 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:41:43.258293    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:41:43.260492 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:41:43.260474    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:45:16.593767 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.593736    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"]
Jul 03 14:45:16.594265 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.594183    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec322645-91ca-4124-aa2c-0c849147ad8d" containerName="console"
Jul 03 14:45:16.594265 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.594200    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec322645-91ca-4124-aa2c-0c849147ad8d" containerName="console"
Jul 03 14:45:16.594374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.594287    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec322645-91ca-4124-aa2c-0c849147ad8d" containerName="console"
Jul 03 14:45:16.597238 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.597217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.599818 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.599797    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e58844\"/\"openshift-service-ca.crt\""
Jul 03 14:45:16.600736 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.600714    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e58844\"/\"kube-root-ca.crt\""
Jul 03 14:45:16.600736 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.600722    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e58844\"/\"test-model-e58844-kserve-self-signed-certs\""
Jul 03 14:45:16.600870 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.600792    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e58844\"/\"default-dockercfg-9knzv\""
Jul 03 14:45:16.614055 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.610742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"]
Jul 03 14:45:16.747471 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.747419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-model-cache\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.747471 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.747477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5b8w\" (UniqueName: \"kubernetes.io/projected/820a6a27-ec39-4ce3-a841-e37f4ba4c205-kube-api-access-m5b8w\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.747711 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.747563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tmp-dir\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.747711 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.747617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tls-certs\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.747711 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.747639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-dshm\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.747711 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.747659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-home\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848170 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-model-cache\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848170 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5b8w\" (UniqueName: \"kubernetes.io/projected/820a6a27-ec39-4ce3-a841-e37f4ba4c205-kube-api-access-m5b8w\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848170 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tmp-dir\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848405 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tls-certs\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848405 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-dshm\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848405 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-home\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848558 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tmp-dir\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848615 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848551    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-model-cache\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.848732 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.848716    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-home\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.850699 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.850659    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-dshm\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.850917 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.850899    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tls-certs\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.858867 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.858847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5b8w\" (UniqueName: \"kubernetes.io/projected/820a6a27-ec39-4ce3-a841-e37f4ba4c205-kube-api-access-m5b8w\") pod \"test-model-e58844-kserve-7c84d7fd85-fhhh4\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") " pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:16.907172 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:16.907147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:17.043931 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:17.043904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"]
Jul 03 14:45:17.045269 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:45:17.045241    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod820a6a27_ec39_4ce3_a841_e37f4ba4c205.slice/crio-da97352805c71627bc37bcb7710e21e9055d5f75a79aafbbcc0ae1c6e48c53d7 WatchSource:0}: Error finding container da97352805c71627bc37bcb7710e21e9055d5f75a79aafbbcc0ae1c6e48c53d7: Status 404 returned error can't find the container with id da97352805c71627bc37bcb7710e21e9055d5f75a79aafbbcc0ae1c6e48c53d7
Jul 03 14:45:17.047174 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:17.047157    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 14:45:17.513141 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:17.513101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4" event={"ID":"820a6a27-ec39-4ce3-a841-e37f4ba4c205","Type":"ContainerStarted","Data":"da97352805c71627bc37bcb7710e21e9055d5f75a79aafbbcc0ae1c6e48c53d7"}
Jul 03 14:45:18.520121 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:18.520040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4" event={"ID":"820a6a27-ec39-4ce3-a841-e37f4ba4c205","Type":"ContainerStarted","Data":"e7e81f83261d5922ddf504f4b7e139f886d2f7eafc938d9563287dc1d87b4854"}
Jul 03 14:45:18.540173 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:18.540128    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4" podStartSLOduration=1.430491768 podStartE2EDuration="2.54011398s" totalImagesPullingTime="1.109622212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:45:18.539578788 +0000 UTC m=+2015.788235889" watchObservedRunningTime="2026-07-03 14:45:18.54011398 +0000 UTC m=+2015.788771079"
Jul 03 14:45:26.907472 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:26.907429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:26.907472 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:26.907475    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:26.920211 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:26.920189    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:27.574510 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:27.574478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:45:50.550751 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:45:50.550713    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"]
Jul 03 14:46:05.571204 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.571107    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4" podUID="820a6a27-ec39-4ce3-a841-e37f4ba4c205" containerName="main" containerID="cri-o://e7e81f83261d5922ddf504f4b7e139f886d2f7eafc938d9563287dc1d87b4854" gracePeriod=45
Jul 03 14:46:05.744086 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.744051    2563 generic.go:356] "Generic (PLEG): container finished" podID="820a6a27-ec39-4ce3-a841-e37f4ba4c205" containerID="e7e81f83261d5922ddf504f4b7e139f886d2f7eafc938d9563287dc1d87b4854" exitCode=0
Jul 03 14:46:05.744200 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.744119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4" event={"ID":"820a6a27-ec39-4ce3-a841-e37f4ba4c205","Type":"ContainerDied","Data":"e7e81f83261d5922ddf504f4b7e139f886d2f7eafc938d9563287dc1d87b4854"}
Jul 03 14:46:05.823975 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.823923    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:46:05.966044 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966021    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-model-cache\") pod \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") "
Jul 03 14:46:05.966188 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tmp-dir\") pod \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") "
Jul 03 14:46:05.966188 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966114    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-dshm\") pod \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") "
Jul 03 14:46:05.966188 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-home\") pod \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") "
Jul 03 14:46:05.966188 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5b8w\" (UniqueName: \"kubernetes.io/projected/820a6a27-ec39-4ce3-a841-e37f4ba4c205-kube-api-access-m5b8w\") pod \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") "
Jul 03 14:46:05.966188 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966175    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tls-certs\") pod \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\" (UID: \"820a6a27-ec39-4ce3-a841-e37f4ba4c205\") "
Jul 03 14:46:05.966431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966298    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-model-cache" (OuterVolumeSpecName: "model-cache") pod "820a6a27-ec39-4ce3-a841-e37f4ba4c205" (UID: "820a6a27-ec39-4ce3-a841-e37f4ba4c205"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:46:05.966431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966406    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-model-cache\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:46:05.966431 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966400    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "820a6a27-ec39-4ce3-a841-e37f4ba4c205" (UID: "820a6a27-ec39-4ce3-a841-e37f4ba4c205"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:46:05.966570 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.966434    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-home" (OuterVolumeSpecName: "home") pod "820a6a27-ec39-4ce3-a841-e37f4ba4c205" (UID: "820a6a27-ec39-4ce3-a841-e37f4ba4c205"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:46:05.968418 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.968389    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-dshm" (OuterVolumeSpecName: "dshm") pod "820a6a27-ec39-4ce3-a841-e37f4ba4c205" (UID: "820a6a27-ec39-4ce3-a841-e37f4ba4c205"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:46:05.968520 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.968465    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "820a6a27-ec39-4ce3-a841-e37f4ba4c205" (UID: "820a6a27-ec39-4ce3-a841-e37f4ba4c205"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:46:05.968520 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:05.968497    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820a6a27-ec39-4ce3-a841-e37f4ba4c205-kube-api-access-m5b8w" (OuterVolumeSpecName: "kube-api-access-m5b8w") pod "820a6a27-ec39-4ce3-a841-e37f4ba4c205" (UID: "820a6a27-ec39-4ce3-a841-e37f4ba4c205"). InnerVolumeSpecName "kube-api-access-m5b8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:46:06.067022 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.066993    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-home\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:46:06.067022 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.067017    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5b8w\" (UniqueName: \"kubernetes.io/projected/820a6a27-ec39-4ce3-a841-e37f4ba4c205-kube-api-access-m5b8w\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:46:06.067181 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.067028    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tls-certs\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:46:06.067181 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.067056    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-tmp-dir\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:46:06.067181 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.067064    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820a6a27-ec39-4ce3-a841-e37f4ba4c205-dshm\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:46:06.750646 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.750607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4" event={"ID":"820a6a27-ec39-4ce3-a841-e37f4ba4c205","Type":"ContainerDied","Data":"da97352805c71627bc37bcb7710e21e9055d5f75a79aafbbcc0ae1c6e48c53d7"}
Jul 03 14:46:06.751064 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.750668    2563 scope.go:117] "RemoveContainer" containerID="e7e81f83261d5922ddf504f4b7e139f886d2f7eafc938d9563287dc1d87b4854"
Jul 03 14:46:06.751064 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.750622    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"
Jul 03 14:46:06.772410 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.772380    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"]
Jul 03 14:46:06.776837 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:06.776807    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e58844/test-model-e58844-kserve-7c84d7fd85-fhhh4"]
Jul 03 14:46:07.314405 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:07.314370    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820a6a27-ec39-4ce3-a841-e37f4ba4c205" path="/var/lib/kubelet/pods/820a6a27-ec39-4ce3-a841-e37f4ba4c205/volumes"
Jul 03 14:46:43.286036 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:43.286011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:46:43.287983 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:46:43.287962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:47:55.899360 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.899274    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"]
Jul 03 14:47:55.899851 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.899621    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820a6a27-ec39-4ce3-a841-e37f4ba4c205" containerName="main"
Jul 03 14:47:55.899851 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.899632    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="820a6a27-ec39-4ce3-a841-e37f4ba4c205" containerName="main"
Jul 03 14:47:55.899851 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.899717    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="820a6a27-ec39-4ce3-a841-e37f4ba4c205" containerName="main"
Jul 03 14:47:55.902954 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.902938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:55.906321 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.906289    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6ebb6a\"/\"openshift-service-ca.crt\""
Jul 03 14:47:55.906321 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.906314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6ebb6a\"/\"default-dockercfg-9x89m\""
Jul 03 14:47:55.906531 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.906345    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6ebb6a\"/\"kube-root-ca.crt\""
Jul 03 14:47:55.906531 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.906292    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6ebb6a\"/\"auth-test-model-6ebb6a-kserve-self-signed-certs\""
Jul 03 14:47:55.912508 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.912478    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"]
Jul 03 14:47:55.963376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.963334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-model-cache\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:55.963573 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.963401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-dshm\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:55.963573 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.963467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa579ca5-c410-4457-86df-4037a185a1e0-tls-certs\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:55.963573 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.963505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-home\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:55.963735 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.963576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsdpf\" (UniqueName: \"kubernetes.io/projected/aa579ca5-c410-4457-86df-4037a185a1e0-kube-api-access-bsdpf\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:55.963735 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:55.963618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-tmp-dir\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064070 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-dshm\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa579ca5-c410-4457-86df-4037a185a1e0-tls-certs\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-home\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsdpf\" (UniqueName: \"kubernetes.io/projected/aa579ca5-c410-4457-86df-4037a185a1e0-kube-api-access-bsdpf\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064246 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-tmp-dir\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064541 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-home\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064663 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-model-cache\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.064956 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.064934    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-tmp-dir\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.065094 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.065072    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-model-cache\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.066614 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.066585    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-dshm\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.067300 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.067275    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa579ca5-c410-4457-86df-4037a185a1e0-tls-certs\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.073334 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.073309    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsdpf\" (UniqueName: \"kubernetes.io/projected/aa579ca5-c410-4457-86df-4037a185a1e0-kube-api-access-bsdpf\") pod \"auth-test-model-6ebb6a-kserve-fdbd896c5-c524r\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") " pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.212543 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.212451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:47:56.356509 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:56.356483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"]
Jul 03 14:47:56.359131 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:47:56.359104    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa579ca5_c410_4457_86df_4037a185a1e0.slice/crio-9fbc0d36152cadb47f07f4f07a92bc3e9ece94382b6b499b4a0c96c9560cea73 WatchSource:0}: Error finding container 9fbc0d36152cadb47f07f4f07a92bc3e9ece94382b6b499b4a0c96c9560cea73: Status 404 returned error can't find the container with id 9fbc0d36152cadb47f07f4f07a92bc3e9ece94382b6b499b4a0c96c9560cea73
Jul 03 14:47:57.256936 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:57.256899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r" event={"ID":"aa579ca5-c410-4457-86df-4037a185a1e0","Type":"ContainerStarted","Data":"063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538"}
Jul 03 14:47:57.256936 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:57.256936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r" event={"ID":"aa579ca5-c410-4457-86df-4037a185a1e0","Type":"ContainerStarted","Data":"9fbc0d36152cadb47f07f4f07a92bc3e9ece94382b6b499b4a0c96c9560cea73"}
Jul 03 14:47:57.276125 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:47:57.276078    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r" podStartSLOduration=2.276062438 podStartE2EDuration="2.276062438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:47:57.274316227 +0000 UTC m=+2174.522973326" watchObservedRunningTime="2026-07-03 14:47:57.276062438 +0000 UTC m=+2174.524719536"
Jul 03 14:48:06.213320 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:06.213280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:48:06.213820 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:06.213366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:48:06.225925 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:06.225900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:48:06.309376 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:06.309348    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:48:29.006799 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.006760    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"]
Jul 03 14:48:29.010055 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.010034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.012749 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.012731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"auth-test-model-1dd877-kserve-self-signed-certs\""
Jul 03 14:48:29.012878 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.012863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"default-dockercfg-55zl4\""
Jul 03 14:48:29.013668 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.013646    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"openshift-service-ca.crt\""
Jul 03 14:48:29.013668 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.013705    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"kube-root-ca.crt\""
Jul 03 14:48:29.021892 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.021870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"]
Jul 03 14:48:29.040439 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.040407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32449d7f-3949-4a11-a138-dc02ec6e3da3-tls-certs\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.040550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.040449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-dshm\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.040550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.040474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-model-cache\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.040550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.040492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxqs\" (UniqueName: \"kubernetes.io/projected/32449d7f-3949-4a11-a138-dc02ec6e3da3-kube-api-access-xxxqs\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.040550 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.040514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-tmp-dir\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.040730 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.040621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-home\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.141659 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.141573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-home\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.141927 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.141905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32449d7f-3949-4a11-a138-dc02ec6e3da3-tls-certs\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.142173 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.142151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-dshm\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.142275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.142201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-model-cache\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.142275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.142227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxqs\" (UniqueName: \"kubernetes.io/projected/32449d7f-3949-4a11-a138-dc02ec6e3da3-kube-api-access-xxxqs\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.142275 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.142262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-tmp-dir\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.142710 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.142642    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-home\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.142795 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.142769    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-tmp-dir\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.143030 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.143008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-model-cache\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.144746 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.144728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-dshm\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.144832 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.144818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32449d7f-3949-4a11-a138-dc02ec6e3da3-tls-certs\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.153874 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.153826    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxqs\" (UniqueName: \"kubernetes.io/projected/32449d7f-3949-4a11-a138-dc02ec6e3da3-kube-api-access-xxxqs\") pod \"auth-test-model-1dd877-kserve-74c9586d55-g7rpt\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") " pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.319026 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.318999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:29.452020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:29.451927    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"]
Jul 03 14:48:29.454152 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:48:29.454123    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32449d7f_3949_4a11_a138_dc02ec6e3da3.slice/crio-e19b3544680ca820a3accfe1b719e9cc610439ae66f64bafdb8607fea2047059 WatchSource:0}: Error finding container e19b3544680ca820a3accfe1b719e9cc610439ae66f64bafdb8607fea2047059: Status 404 returned error can't find the container with id e19b3544680ca820a3accfe1b719e9cc610439ae66f64bafdb8607fea2047059
Jul 03 14:48:30.404507 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:30.404474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt" event={"ID":"32449d7f-3949-4a11-a138-dc02ec6e3da3","Type":"ContainerStarted","Data":"a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e"}
Jul 03 14:48:30.404507 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:30.404512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt" event={"ID":"32449d7f-3949-4a11-a138-dc02ec6e3da3","Type":"ContainerStarted","Data":"e19b3544680ca820a3accfe1b719e9cc610439ae66f64bafdb8607fea2047059"}
Jul 03 14:48:30.424577 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:30.424530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt" podStartSLOduration=2.4245153249999998 podStartE2EDuration="2.424515325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:48:30.4233423 +0000 UTC m=+2207.671999400" watchObservedRunningTime="2026-07-03 14:48:30.424515325 +0000 UTC m=+2207.673172425"
Jul 03 14:48:39.319201 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:39.319169    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:39.319744 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:39.319223    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:39.332138 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:39.332115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:48:39.457005 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:48:39.456981    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:50:32.723400 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:32.723360    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"]
Jul 03 14:50:33.609208 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:33.609127    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"]
Jul 03 14:50:47.743904 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:47.743859    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r" podUID="aa579ca5-c410-4457-86df-4037a185a1e0" containerName="main" containerID="cri-o://063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538" gracePeriod=45
Jul 03 14:50:47.992132 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:47.992107    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:50:48.052624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.052542    2563 generic.go:356] "Generic (PLEG): container finished" podID="aa579ca5-c410-4457-86df-4037a185a1e0" containerID="063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538" exitCode=0
Jul 03 14:50:48.052624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.052585    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"
Jul 03 14:50:48.052890 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.052634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r" event={"ID":"aa579ca5-c410-4457-86df-4037a185a1e0","Type":"ContainerDied","Data":"063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538"}
Jul 03 14:50:48.052890 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.052705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r" event={"ID":"aa579ca5-c410-4457-86df-4037a185a1e0","Type":"ContainerDied","Data":"9fbc0d36152cadb47f07f4f07a92bc3e9ece94382b6b499b4a0c96c9560cea73"}
Jul 03 14:50:48.052890 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.052740    2563 scope.go:117] "RemoveContainer" containerID="063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538"
Jul 03 14:50:48.061273 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.061257    2563 scope.go:117] "RemoveContainer" containerID="063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538"
Jul 03 14:50:48.061538 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:50:48.061519    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538\": container with ID starting with 063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538 not found: ID does not exist" containerID="063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538"
Jul 03 14:50:48.061599 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.061552    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538"} err="failed to get container status \"063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538\": rpc error: code = NotFound desc = could not find container \"063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538\": container with ID starting with 063db3f50bc875f0095ee0aad1497ad5813fb208675561886b5c4af5f5cbc538 not found: ID does not exist"
Jul 03 14:50:48.092010 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.091981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-dshm\") pod \"aa579ca5-c410-4457-86df-4037a185a1e0\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") "
Jul 03 14:50:48.092096 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092030    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa579ca5-c410-4457-86df-4037a185a1e0-tls-certs\") pod \"aa579ca5-c410-4457-86df-4037a185a1e0\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") "
Jul 03 14:50:48.092096 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092050    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-home\") pod \"aa579ca5-c410-4457-86df-4037a185a1e0\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") "
Jul 03 14:50:48.092096 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-model-cache\") pod \"aa579ca5-c410-4457-86df-4037a185a1e0\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") "
Jul 03 14:50:48.092318 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092292    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsdpf\" (UniqueName: \"kubernetes.io/projected/aa579ca5-c410-4457-86df-4037a185a1e0-kube-api-access-bsdpf\") pod \"aa579ca5-c410-4457-86df-4037a185a1e0\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") "
Jul 03 14:50:48.092374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092320    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa579ca5-c410-4457-86df-4037a185a1e0" (UID: "aa579ca5-c410-4457-86df-4037a185a1e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:48.092374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092331    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-home" (OuterVolumeSpecName: "home") pod "aa579ca5-c410-4457-86df-4037a185a1e0" (UID: "aa579ca5-c410-4457-86df-4037a185a1e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:48.092374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-tmp-dir\") pod \"aa579ca5-c410-4457-86df-4037a185a1e0\" (UID: \"aa579ca5-c410-4457-86df-4037a185a1e0\") "
Jul 03 14:50:48.092551 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092532    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa579ca5-c410-4457-86df-4037a185a1e0" (UID: "aa579ca5-c410-4457-86df-4037a185a1e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:48.092696 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092625    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-home\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:48.092696 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092655    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-model-cache\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:48.092696 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.092666    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-tmp-dir\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:48.094433 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.094398    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-dshm" (OuterVolumeSpecName: "dshm") pod "aa579ca5-c410-4457-86df-4037a185a1e0" (UID: "aa579ca5-c410-4457-86df-4037a185a1e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:48.094541 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.094435    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa579ca5-c410-4457-86df-4037a185a1e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa579ca5-c410-4457-86df-4037a185a1e0" (UID: "aa579ca5-c410-4457-86df-4037a185a1e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:50:48.094541 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.094489    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa579ca5-c410-4457-86df-4037a185a1e0-kube-api-access-bsdpf" (OuterVolumeSpecName: "kube-api-access-bsdpf") pod "aa579ca5-c410-4457-86df-4037a185a1e0" (UID: "aa579ca5-c410-4457-86df-4037a185a1e0"). InnerVolumeSpecName "kube-api-access-bsdpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:50:48.193146 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.193122    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa579ca5-c410-4457-86df-4037a185a1e0-dshm\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:48.193146 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.193144    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa579ca5-c410-4457-86df-4037a185a1e0-tls-certs\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:48.193322 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.193154    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsdpf\" (UniqueName: \"kubernetes.io/projected/aa579ca5-c410-4457-86df-4037a185a1e0-kube-api-access-bsdpf\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:48.376031 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.376006    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"]
Jul 03 14:50:48.381745 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.381724    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6ebb6a/auth-test-model-6ebb6a-kserve-fdbd896c5-c524r"]
Jul 03 14:50:48.629907 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.629807    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt" podUID="32449d7f-3949-4a11-a138-dc02ec6e3da3" containerName="main" containerID="cri-o://a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e" gracePeriod=45
Jul 03 14:50:48.891757 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:48.891672    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:50:49.000261 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32449d7f-3949-4a11-a138-dc02ec6e3da3-tls-certs\") pod \"32449d7f-3949-4a11-a138-dc02ec6e3da3\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") "
Jul 03 14:50:49.000437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000312    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-model-cache\") pod \"32449d7f-3949-4a11-a138-dc02ec6e3da3\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") "
Jul 03 14:50:49.000437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000335    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxxqs\" (UniqueName: \"kubernetes.io/projected/32449d7f-3949-4a11-a138-dc02ec6e3da3-kube-api-access-xxxqs\") pod \"32449d7f-3949-4a11-a138-dc02ec6e3da3\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") "
Jul 03 14:50:49.000437 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000366    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-tmp-dir\") pod \"32449d7f-3949-4a11-a138-dc02ec6e3da3\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") "
Jul 03 14:50:49.000609 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-home\") pod \"32449d7f-3949-4a11-a138-dc02ec6e3da3\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") "
Jul 03 14:50:49.000609 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000571    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-dshm\") pod \"32449d7f-3949-4a11-a138-dc02ec6e3da3\" (UID: \"32449d7f-3949-4a11-a138-dc02ec6e3da3\") "
Jul 03 14:50:49.000609 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000577    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-model-cache" (OuterVolumeSpecName: "model-cache") pod "32449d7f-3949-4a11-a138-dc02ec6e3da3" (UID: "32449d7f-3949-4a11-a138-dc02ec6e3da3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:49.000818 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000661    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-home" (OuterVolumeSpecName: "home") pod "32449d7f-3949-4a11-a138-dc02ec6e3da3" (UID: "32449d7f-3949-4a11-a138-dc02ec6e3da3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:49.000818 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000717    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32449d7f-3949-4a11-a138-dc02ec6e3da3" (UID: "32449d7f-3949-4a11-a138-dc02ec6e3da3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:49.000914 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000887    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-home\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:49.000914 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000900    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-model-cache\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:49.000914 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.000910    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-tmp-dir\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:49.002774 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.002749    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-dshm" (OuterVolumeSpecName: "dshm") pod "32449d7f-3949-4a11-a138-dc02ec6e3da3" (UID: "32449d7f-3949-4a11-a138-dc02ec6e3da3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:50:49.002884 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.002786    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32449d7f-3949-4a11-a138-dc02ec6e3da3-kube-api-access-xxxqs" (OuterVolumeSpecName: "kube-api-access-xxxqs") pod "32449d7f-3949-4a11-a138-dc02ec6e3da3" (UID: "32449d7f-3949-4a11-a138-dc02ec6e3da3"). InnerVolumeSpecName "kube-api-access-xxxqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:50:49.002884 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.002863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32449d7f-3949-4a11-a138-dc02ec6e3da3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32449d7f-3949-4a11-a138-dc02ec6e3da3" (UID: "32449d7f-3949-4a11-a138-dc02ec6e3da3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:50:49.058314 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.058274    2563 generic.go:356] "Generic (PLEG): container finished" podID="32449d7f-3949-4a11-a138-dc02ec6e3da3" containerID="a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e" exitCode=0
Jul 03 14:50:49.058496 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.058325    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"
Jul 03 14:50:49.058496 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.058357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt" event={"ID":"32449d7f-3949-4a11-a138-dc02ec6e3da3","Type":"ContainerDied","Data":"a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e"}
Jul 03 14:50:49.058496 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.058409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt" event={"ID":"32449d7f-3949-4a11-a138-dc02ec6e3da3","Type":"ContainerDied","Data":"e19b3544680ca820a3accfe1b719e9cc610439ae66f64bafdb8607fea2047059"}
Jul 03 14:50:49.058496 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.058434    2563 scope.go:117] "RemoveContainer" containerID="a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e"
Jul 03 14:50:49.068053 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.068036    2563 scope.go:117] "RemoveContainer" containerID="a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e"
Jul 03 14:50:49.068312 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:50:49.068293    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e\": container with ID starting with a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e not found: ID does not exist" containerID="a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e"
Jul 03 14:50:49.068370 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.068321    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e"} err="failed to get container status \"a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e\": rpc error: code = NotFound desc = could not find container \"a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e\": container with ID starting with a68830bb6e4fc05f3e514ec0b521c83ae1b4c36c81c97231e11f24a92bafa40e not found: ID does not exist"
Jul 03 14:50:49.083336 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.083307    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"]
Jul 03 14:50:49.089592 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.089570    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/auth-test-model-1dd877-kserve-74c9586d55-g7rpt"]
Jul 03 14:50:49.101311 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.101289    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxxqs\" (UniqueName: \"kubernetes.io/projected/32449d7f-3949-4a11-a138-dc02ec6e3da3-kube-api-access-xxxqs\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:49.101311 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.101310    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32449d7f-3949-4a11-a138-dc02ec6e3da3-dshm\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:49.101421 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.101323    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32449d7f-3949-4a11-a138-dc02ec6e3da3-tls-certs\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:50:49.314379 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.314283    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32449d7f-3949-4a11-a138-dc02ec6e3da3" path="/var/lib/kubelet/pods/32449d7f-3949-4a11-a138-dc02ec6e3da3/volumes"
Jul 03 14:50:49.314808 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:50:49.314786    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa579ca5-c410-4457-86df-4037a185a1e0" path="/var/lib/kubelet/pods/aa579ca5-c410-4457-86df-4037a185a1e0/volumes"
Jul 03 14:51:24.877115 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877069    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"]
Jul 03 14:51:24.877624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877525    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa579ca5-c410-4457-86df-4037a185a1e0" containerName="main"
Jul 03 14:51:24.877624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877540    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa579ca5-c410-4457-86df-4037a185a1e0" containerName="main"
Jul 03 14:51:24.877624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877572    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32449d7f-3949-4a11-a138-dc02ec6e3da3" containerName="main"
Jul 03 14:51:24.877624 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877581    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32449d7f-3949-4a11-a138-dc02ec6e3da3" containerName="main"
Jul 03 14:51:24.877829 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877650    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32449d7f-3949-4a11-a138-dc02ec6e3da3" containerName="main"
Jul 03 14:51:24.877829 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.877668    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa579ca5-c410-4457-86df-4037a185a1e0" containerName="main"
Jul 03 14:51:24.880709 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.880659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:24.884135 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.884109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"sub-test-model-1dd877-kserve-self-signed-certs\""
Jul 03 14:51:24.884262 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.884122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"kube-root-ca.crt\""
Jul 03 14:51:24.884262 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.884136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"default-dockercfg-55zl4\""
Jul 03 14:51:24.884384 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.884170    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"openshift-service-ca.crt\""
Jul 03 14:51:24.890654 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:24.890629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"]
Jul 03 14:51:25.003498 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.003460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-home\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.003674 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.003543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42tkn\" (UniqueName: \"kubernetes.io/projected/31210f9d-0581-4c65-baf6-4de97180b734-kube-api-access-42tkn\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.003674 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.003565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-dshm\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.003674 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.003583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-model-cache\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.003674 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.003608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31210f9d-0581-4c65-baf6-4de97180b734-tls-certs\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.003674 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.003648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-tmp-dir\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.104746 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.104693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42tkn\" (UniqueName: \"kubernetes.io/projected/31210f9d-0581-4c65-baf6-4de97180b734-kube-api-access-42tkn\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.104957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.104757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-dshm\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.104957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.104788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-model-cache\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.104957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.104821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31210f9d-0581-4c65-baf6-4de97180b734-tls-certs\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.104957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.104845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-tmp-dir\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.104957 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.104876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-home\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.105238 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.105214    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-model-cache\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.105303 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.105266    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-tmp-dir\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.105355 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.105307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-home\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.107309 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.107288    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-dshm\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.107491 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.107474    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31210f9d-0581-4c65-baf6-4de97180b734-tls-certs\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.114749 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.114674    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42tkn\" (UniqueName: \"kubernetes.io/projected/31210f9d-0581-4c65-baf6-4de97180b734-kube-api-access-42tkn\") pod \"sub-test-model-1dd877-kserve-64c4cb75d5-q22pl\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") " pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.191614 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.191519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:25.325549 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:25.325459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"]
Jul 03 14:51:25.328238 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:51:25.328212    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31210f9d_0581_4c65_baf6_4de97180b734.slice/crio-daf335fcda04111e4d2bf94ddf93104d527cc2b3250d366806e4d6e9ccb39bbf WatchSource:0}: Error finding container daf335fcda04111e4d2bf94ddf93104d527cc2b3250d366806e4d6e9ccb39bbf: Status 404 returned error can't find the container with id daf335fcda04111e4d2bf94ddf93104d527cc2b3250d366806e4d6e9ccb39bbf
Jul 03 14:51:26.233598 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:26.233562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl" event={"ID":"31210f9d-0581-4c65-baf6-4de97180b734","Type":"ContainerStarted","Data":"7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95"}
Jul 03 14:51:26.233981 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:26.233606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl" event={"ID":"31210f9d-0581-4c65-baf6-4de97180b734","Type":"ContainerStarted","Data":"daf335fcda04111e4d2bf94ddf93104d527cc2b3250d366806e4d6e9ccb39bbf"}
Jul 03 14:51:26.252937 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:26.252887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl" podStartSLOduration=2.252871901 podStartE2EDuration="2.252871901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:51:26.251082647 +0000 UTC m=+2383.499739748" watchObservedRunningTime="2026-07-03 14:51:26.252871901 +0000 UTC m=+2383.501529047"
Jul 03 14:51:35.191764 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:35.191710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:35.192281 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:35.191790    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:35.204745 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:35.204720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:35.288343 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:35.288314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:51:43.315925 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:43.315899    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:51:43.318402 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:51:43.318378    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrhgh_7bb89cd2-fca2-41e2-9d53-75cd1bd0763c/ovn-acl-logging/0.log"
Jul 03 14:52:00.629162 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:00.629128    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"]
Jul 03 14:52:15.649425 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:15.649338    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl" podUID="31210f9d-0581-4c65-baf6-4de97180b734" containerName="main" containerID="cri-o://7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95" gracePeriod=45
Jul 03 14:52:15.894523 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:15.894501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:52:16.056427 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056331    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42tkn\" (UniqueName: \"kubernetes.io/projected/31210f9d-0581-4c65-baf6-4de97180b734-kube-api-access-42tkn\") pod \"31210f9d-0581-4c65-baf6-4de97180b734\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") "
Jul 03 14:52:16.056427 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056383    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-home\") pod \"31210f9d-0581-4c65-baf6-4de97180b734\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") "
Jul 03 14:52:16.056427 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056416    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-dshm\") pod \"31210f9d-0581-4c65-baf6-4de97180b734\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") "
Jul 03 14:52:16.056795 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-tmp-dir\") pod \"31210f9d-0581-4c65-baf6-4de97180b734\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") "
Jul 03 14:52:16.056795 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31210f9d-0581-4c65-baf6-4de97180b734-tls-certs\") pod \"31210f9d-0581-4c65-baf6-4de97180b734\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") "
Jul 03 14:52:16.056795 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056552    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-model-cache\") pod \"31210f9d-0581-4c65-baf6-4de97180b734\" (UID: \"31210f9d-0581-4c65-baf6-4de97180b734\") "
Jul 03 14:52:16.056931 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056804    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-home" (OuterVolumeSpecName: "home") pod "31210f9d-0581-4c65-baf6-4de97180b734" (UID: "31210f9d-0581-4c65-baf6-4de97180b734"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:52:16.056931 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056814    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31210f9d-0581-4c65-baf6-4de97180b734" (UID: "31210f9d-0581-4c65-baf6-4de97180b734"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:52:16.057030 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.056956    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-model-cache" (OuterVolumeSpecName: "model-cache") pod "31210f9d-0581-4c65-baf6-4de97180b734" (UID: "31210f9d-0581-4c65-baf6-4de97180b734"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:52:16.058715 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.058666    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-dshm" (OuterVolumeSpecName: "dshm") pod "31210f9d-0581-4c65-baf6-4de97180b734" (UID: "31210f9d-0581-4c65-baf6-4de97180b734"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:52:16.058825 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.058745    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31210f9d-0581-4c65-baf6-4de97180b734-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31210f9d-0581-4c65-baf6-4de97180b734" (UID: "31210f9d-0581-4c65-baf6-4de97180b734"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:52:16.058825 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.058755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31210f9d-0581-4c65-baf6-4de97180b734-kube-api-access-42tkn" (OuterVolumeSpecName: "kube-api-access-42tkn") pod "31210f9d-0581-4c65-baf6-4de97180b734" (UID: "31210f9d-0581-4c65-baf6-4de97180b734"). InnerVolumeSpecName "kube-api-access-42tkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:52:16.157974 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.157940    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42tkn\" (UniqueName: \"kubernetes.io/projected/31210f9d-0581-4c65-baf6-4de97180b734-kube-api-access-42tkn\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:52:16.157974 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.157970    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-home\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:52:16.157974 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.157982    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-dshm\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:52:16.158212 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.157992    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-tmp-dir\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:52:16.158212 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.158000    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31210f9d-0581-4c65-baf6-4de97180b734-tls-certs\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:52:16.158212 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.158008    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31210f9d-0581-4c65-baf6-4de97180b734-model-cache\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:52:16.464148 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.464118    2563 generic.go:356] "Generic (PLEG): container finished" podID="31210f9d-0581-4c65-baf6-4de97180b734" containerID="7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95" exitCode=0
Jul 03 14:52:16.464328 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.464160    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"
Jul 03 14:52:16.464328 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.464215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl" event={"ID":"31210f9d-0581-4c65-baf6-4de97180b734","Type":"ContainerDied","Data":"7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95"}
Jul 03 14:52:16.464328 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.464254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl" event={"ID":"31210f9d-0581-4c65-baf6-4de97180b734","Type":"ContainerDied","Data":"daf335fcda04111e4d2bf94ddf93104d527cc2b3250d366806e4d6e9ccb39bbf"}
Jul 03 14:52:16.464328 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.464270    2563 scope.go:117] "RemoveContainer" containerID="7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95"
Jul 03 14:52:16.473668 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.473650    2563 scope.go:117] "RemoveContainer" containerID="7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95"
Jul 03 14:52:16.473947 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:52:16.473917    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95\": container with ID starting with 7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95 not found: ID does not exist" containerID="7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95"
Jul 03 14:52:16.474002 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.473954    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95"} err="failed to get container status \"7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95\": rpc error: code = NotFound desc = could not find container \"7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95\": container with ID starting with 7c760f5ceae5cc7c88011c37e406b6e3916b40ceccbe831383eff64bb1a11f95 not found: ID does not exist"
Jul 03 14:52:16.487094 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.487066    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"]
Jul 03 14:52:16.493101 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:16.493080    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/sub-test-model-1dd877-kserve-64c4cb75d5-q22pl"]
Jul 03 14:52:17.315049 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:17.315017    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31210f9d-0581-4c65-baf6-4de97180b734" path="/var/lib/kubelet/pods/31210f9d-0581-4c65-baf6-4de97180b734/volumes"
Jul 03 14:52:26.792634 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.792601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"]
Jul 03 14:52:26.793088 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.792933    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31210f9d-0581-4c65-baf6-4de97180b734" containerName="main"
Jul 03 14:52:26.793088 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.792946    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31210f9d-0581-4c65-baf6-4de97180b734" containerName="main"
Jul 03 14:52:26.793088 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.793000    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31210f9d-0581-4c65-baf6-4de97180b734" containerName="main"
Jul 03 14:52:26.795851 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.795834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.798640 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.798622    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"openshift-service-ca.crt\""
Jul 03 14:52:26.799647 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.799626    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"kube-root-ca.crt\""
Jul 03 14:52:26.799796 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.799652    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"default-dockercfg-55zl4\""
Jul 03 14:52:26.799796 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.799652    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1dd877\"/\"rate-test-model-1dd877-kserve-self-signed-certs\""
Jul 03 14:52:26.806693 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.806658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"]
Jul 03 14:52:26.831137 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.831107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-dshm\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.831261 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.831154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-model-cache\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.831261 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.831204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tmp-dir\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.831261 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.831233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tls-certs\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.831419 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.831262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-home\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.831419 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.831292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws87g\" (UniqueName: \"kubernetes.io/projected/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-kube-api-access-ws87g\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.931891 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.931858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-dshm\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.931901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-model-cache\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.931921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tmp-dir\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.931939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tls-certs\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.932022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-home\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932085 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.932056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws87g\" (UniqueName: \"kubernetes.io/projected/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-kube-api-access-ws87g\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932353 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.932320    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tmp-dir\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932409 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.932375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-model-cache\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.932447 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.932427    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-home\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.934586 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.934562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-dshm\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.934702 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.934671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tls-certs\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:26.941141 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:26.941100    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws87g\" (UniqueName: \"kubernetes.io/projected/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-kube-api-access-ws87g\") pod \"rate-test-model-1dd877-kserve-54d5fb488c-rxb9k\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") " pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:27.105148 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:27.105111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:27.247397 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:27.247361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"]
Jul 03 14:52:27.250111 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:52:27.250081    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d7ca1c_ab31_49c5_b0c8_b03a0b7f557f.slice/crio-bf9da4b29e3b0d12c96e81888d1bf811a01dc064450ecfe26f5c3539729be2f4 WatchSource:0}: Error finding container bf9da4b29e3b0d12c96e81888d1bf811a01dc064450ecfe26f5c3539729be2f4: Status 404 returned error can't find the container with id bf9da4b29e3b0d12c96e81888d1bf811a01dc064450ecfe26f5c3539729be2f4
Jul 03 14:52:27.517263 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:27.517173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k" event={"ID":"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f","Type":"ContainerStarted","Data":"353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960"}
Jul 03 14:52:27.517263 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:27.517213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k" event={"ID":"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f","Type":"ContainerStarted","Data":"bf9da4b29e3b0d12c96e81888d1bf811a01dc064450ecfe26f5c3539729be2f4"}
Jul 03 14:52:27.537452 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:27.537403    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k" podStartSLOduration=1.537386967 podStartE2EDuration="1.537386967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:52:27.535301748 +0000 UTC m=+2444.783958859" watchObservedRunningTime="2026-07-03 14:52:27.537386967 +0000 UTC m=+2444.786044066"
Jul 03 14:52:37.105826 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:37.105791    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:37.106278 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:37.105974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:37.118601 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:37.118576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:52:37.574892 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:52:37.574866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:53:10.317320 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:10.317288    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"]
Jul 03 14:53:25.338205 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.338159    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k" podUID="c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" containerName="main" containerID="cri-o://353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960" gracePeriod=45
Jul 03 14:53:25.584639 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.584612    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:53:25.642834 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.642742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-model-cache\") pod \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") "
Jul 03 14:53:25.642834 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.642796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws87g\" (UniqueName: \"kubernetes.io/projected/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-kube-api-access-ws87g\") pod \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") "
Jul 03 14:53:25.642834 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.642825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-home\") pod \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") "
Jul 03 14:53:25.643106 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.642863    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-dshm\") pod \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") "
Jul 03 14:53:25.643106 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.642879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tmp-dir\") pod \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") "
Jul 03 14:53:25.643106 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643002    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tls-certs\") pod \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\" (UID: \"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f\") "
Jul 03 14:53:25.643106 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643074    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" (UID: "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:53:25.643255 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643118    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" (UID: "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:53:25.643255 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643135    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-home" (OuterVolumeSpecName: "home") pod "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" (UID: "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:53:25.643335 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643316    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-home\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:53:25.643374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643343    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tmp-dir\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:53:25.643374 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.643358    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-model-cache\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:53:25.645242 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.645223    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" (UID: "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 14:53:25.645324 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.645293    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-dshm" (OuterVolumeSpecName: "dshm") pod "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" (UID: "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 14:53:25.645383 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.645349    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-kube-api-access-ws87g" (OuterVolumeSpecName: "kube-api-access-ws87g") pod "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" (UID: "c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f"). InnerVolumeSpecName "kube-api-access-ws87g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 14:53:25.744084 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.744054    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws87g\" (UniqueName: \"kubernetes.io/projected/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-kube-api-access-ws87g\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:53:25.744084 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.744078    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-dshm\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:53:25.744084 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.744091    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f-tls-certs\") on node \"ip-10-0-141-67.ec2.internal\" DevicePath \"\""
Jul 03 14:53:25.788874 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.788843    2563 generic.go:356] "Generic (PLEG): container finished" podID="c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" containerID="353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960" exitCode=0
Jul 03 14:53:25.789020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.788892    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"
Jul 03 14:53:25.789020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.788934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k" event={"ID":"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f","Type":"ContainerDied","Data":"353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960"}
Jul 03 14:53:25.789020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.788984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k" event={"ID":"c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f","Type":"ContainerDied","Data":"bf9da4b29e3b0d12c96e81888d1bf811a01dc064450ecfe26f5c3539729be2f4"}
Jul 03 14:53:25.789020 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.789007    2563 scope.go:117] "RemoveContainer" containerID="353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960"
Jul 03 14:53:25.798158 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.798141    2563 scope.go:117] "RemoveContainer" containerID="353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960"
Jul 03 14:53:25.798416 ip-10-0-141-67 kubenswrapper[2563]: E0703 14:53:25.798395    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960\": container with ID starting with 353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960 not found: ID does not exist" containerID="353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960"
Jul 03 14:53:25.798461 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.798424    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960"} err="failed to get container status \"353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960\": rpc error: code = NotFound desc = could not find container \"353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960\": container with ID starting with 353c97bd7dd9eaa8697841a3d5a99cb271cd3ef48ce20e359b1e26850115a960 not found: ID does not exist"
Jul 03 14:53:25.810946 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.810924    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"]
Jul 03 14:53:25.817960 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:25.817940    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1dd877/rate-test-model-1dd877-kserve-54d5fb488c-rxb9k"]
Jul 03 14:53:27.318164 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:53:27.318132    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" path="/var/lib/kubelet/pods/c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f/volumes"
Jul 03 14:54:08.377671 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:08.377637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ftv7j_d908e1a9-e9ce-42b6-b555-5bfdadedeb18/server/0.log"
Jul 03 14:54:08.618037 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:08.618009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-46x47_11db2e69-a71b-4760-a71f-32bfe6820c29/copy-manifests/0.log"
Jul 03 14:54:08.630044 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:08.629968    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-46x47_11db2e69-a71b-4760-a71f-32bfe6820c29/manager/0.log"
Jul 03 14:54:11.715173 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:11.715139    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-645vp_6f366185-c986-4a08-918a-cc5a60e3f768/discovery/0.log"
Jul 03 14:54:11.829609 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:11.829577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-5ws4j_afb1e616-c348-43c2-8bfc-b686c4955161/kube-auth-proxy/0.log"
Jul 03 14:54:12.446304 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:12.446275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-949ddbdcf-6kjlb_889480dc-83a3-41bd-86de-387eba45dbfd/router/0.log"
Jul 03 14:54:20.477298 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:20.477264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-85cpn_34e2e83a-f91b-4c01-a6fe-a56ae51603ee/global-pull-secret-syncer/0.log"
Jul 03 14:54:20.722367 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:20.722329    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p5jgp_44949a0d-e604-4629-b854-71259296df52/konnectivity-agent/0.log"
Jul 03 14:54:20.814305 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:20.814230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-67.ec2.internal_7ef37ef919386f7b59fdf6ff33e8d16a/haproxy/0.log"
Jul 03 14:54:28.062566 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.062512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-hvw6r_d31c23d1-1bb5-4eb3-b8fd-ebbc9d908850/cluster-monitoring-operator/0.log"
Jul 03 14:54:28.094694 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.094654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dsxrm_6056749f-9ff0-4585-86ca-ea086235cb09/kube-state-metrics/0.log"
Jul 03 14:54:28.119282 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.119248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dsxrm_6056749f-9ff0-4585-86ca-ea086235cb09/kube-rbac-proxy-main/0.log"
Jul 03 14:54:28.143791 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.143766    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dsxrm_6056749f-9ff0-4585-86ca-ea086235cb09/kube-rbac-proxy-self/0.log"
Jul 03 14:54:28.253842 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.253812    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6klng_44d56cb4-386d-44b8-a861-08acc2f3a9ad/node-exporter/0.log"
Jul 03 14:54:28.279375 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.279354    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6klng_44d56cb4-386d-44b8-a861-08acc2f3a9ad/kube-rbac-proxy/0.log"
Jul 03 14:54:28.302750 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.302729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6klng_44d56cb4-386d-44b8-a861-08acc2f3a9ad/init-textfile/0.log"
Jul 03 14:54:28.544016 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.543986    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8xttj_749a11fd-9026-496e-9a17-24242aea01c1/kube-rbac-proxy-main/0.log"
Jul 03 14:54:28.580540 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.580512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8xttj_749a11fd-9026-496e-9a17-24242aea01c1/kube-rbac-proxy-self/0.log"
Jul 03 14:54:28.608915 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:28.608884    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8xttj_749a11fd-9026-496e-9a17-24242aea01c1/openshift-state-metrics/0.log"
Jul 03 14:54:30.118601 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.118552    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"]
Jul 03 14:54:30.119136 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.119039    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" containerName="main"
Jul 03 14:54:30.119136 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.119059    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" containerName="main"
Jul 03 14:54:30.119233 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.119160    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d7ca1c-ab31-49c5-b0c8-b03a0b7f557f" containerName="main"
Jul 03 14:54:30.122106 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.122089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.124819 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.124785    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29ndn\"/\"kube-root-ca.crt\""
Jul 03 14:54:30.124962 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.124867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-29ndn\"/\"default-dockercfg-cz7zd\""
Jul 03 14:54:30.125750 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.125734    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29ndn\"/\"openshift-service-ca.crt\""
Jul 03 14:54:30.141415 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.141386    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"]
Jul 03 14:54:30.178536 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.178496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbt5x\" (UniqueName: \"kubernetes.io/projected/8298c472-f833-41df-8916-0184d9359e20-kube-api-access-gbt5x\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.178735 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.178542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-podres\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.178735 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.178631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-proc\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.178735 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.178719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-sys\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.178877 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.178746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-lib-modules\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279594 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-sys\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279594 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-lib-modules\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbt5x\" (UniqueName: \"kubernetes.io/projected/8298c472-f833-41df-8916-0184d9359e20-kube-api-access-gbt5x\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-podres\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279725    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-sys\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-proc\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-proc\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279827    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-lib-modules\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.279875 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.279833    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8298c472-f833-41df-8916-0184d9359e20-podres\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.289326 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.289296    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbt5x\" (UniqueName: \"kubernetes.io/projected/8298c472-f833-41df-8916-0184d9359e20-kube-api-access-gbt5x\") pod \"perf-node-gather-daemonset-76bmj\" (UID: \"8298c472-f833-41df-8916-0184d9359e20\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.402618 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.402541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-nxglm_5a1402d3-2c40-49d8-8796-db66400bb2c3/networking-console-plugin/0.log"
Jul 03 14:54:30.432461 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.432421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:30.566653 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:30.566626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"]
Jul 03 14:54:30.568537 ip-10-0-141-67 kubenswrapper[2563]: W0703 14:54:30.568510    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8298c472_f833_41df_8916_0184d9359e20.slice/crio-8a0a50fd5ae8792a32d5512cb0d4ed3ef377aad1d0d9523f9672ebaf85712b2e WatchSource:0}: Error finding container 8a0a50fd5ae8792a32d5512cb0d4ed3ef377aad1d0d9523f9672ebaf85712b2e: Status 404 returned error can't find the container with id 8a0a50fd5ae8792a32d5512cb0d4ed3ef377aad1d0d9523f9672ebaf85712b2e
Jul 03 14:54:31.083759 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:31.083727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj" event={"ID":"8298c472-f833-41df-8916-0184d9359e20","Type":"ContainerStarted","Data":"29caedf9ddf64397f2390fbef5b5faa8b052e3cd9d45c39e9fc4f006f9e690e7"}
Jul 03 14:54:31.083940 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:31.083782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj" event={"ID":"8298c472-f833-41df-8916-0184d9359e20","Type":"ContainerStarted","Data":"8a0a50fd5ae8792a32d5512cb0d4ed3ef377aad1d0d9523f9672ebaf85712b2e"}
Jul 03 14:54:31.083940 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:31.083896    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:31.102417 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:31.102363    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj" podStartSLOduration=1.102347001 podStartE2EDuration="1.102347001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:54:31.101155193 +0000 UTC m=+2568.349812293" watchObservedRunningTime="2026-07-03 14:54:31.102347001 +0000 UTC m=+2568.351004099"
Jul 03 14:54:33.419415 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:33.419387    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7chf4_3371d07b-f8ce-4e62-8157-6ae926e36e83/dns/0.log"
Jul 03 14:54:33.457025 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:33.456996    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7chf4_3371d07b-f8ce-4e62-8157-6ae926e36e83/kube-rbac-proxy/0.log"
Jul 03 14:54:33.692536 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:33.692455    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fb6nj_bc899a7d-5212-4384-a014-65fdb5cfe509/dns-node-resolver/0.log"
Jul 03 14:54:34.414311 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:34.414278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l447z_df0e63b0-433d-4ffd-b9ba-0f6b64967782/node-ca/0.log"
Jul 03 14:54:35.805628 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:35.805593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-645vp_6f366185-c986-4a08-918a-cc5a60e3f768/discovery/0.log"
Jul 03 14:54:35.836796 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:35.836767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-5ws4j_afb1e616-c348-43c2-8bfc-b686c4955161/kube-auth-proxy/0.log"
Jul 03 14:54:36.234790 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:36.234759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-949ddbdcf-6kjlb_889480dc-83a3-41bd-86de-387eba45dbfd/router/0.log"
Jul 03 14:54:37.028959 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.028930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98v7d_a9209bcf-fa3e-4e3d-99b3-751126378856/serve-healthcheck-canary/0.log"
Jul 03 14:54:37.098405 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.098379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-76bmj"
Jul 03 14:54:37.702927 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.702891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mcwfp_871b91f5-548a-47c5-baa4-97887cfc6cf3/insights-operator/0.log"
Jul 03 14:54:37.703257 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.703240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mcwfp_871b91f5-548a-47c5-baa4-97887cfc6cf3/insights-operator/1.log"
Jul 03 14:54:37.843516 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.843493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5flqp_e4442daa-09b4-4fe7-a0bd-bdbace0b3241/kube-rbac-proxy/0.log"
Jul 03 14:54:37.875603 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.875582    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5flqp_e4442daa-09b4-4fe7-a0bd-bdbace0b3241/exporter/0.log"
Jul 03 14:54:37.903527 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:37.903507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5flqp_e4442daa-09b4-4fe7-a0bd-bdbace0b3241/extractor/0.log"
Jul 03 14:54:40.890262 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:40.890208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-645vp_6f366185-c986-4a08-918a-cc5a60e3f768/discovery/0.log"
Jul 03 14:54:40.903941 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:40.903915    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-5ws4j_afb1e616-c348-43c2-8bfc-b686c4955161/kube-auth-proxy/0.log"
Jul 03 14:54:41.155489 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:41.155366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-949ddbdcf-6kjlb_889480dc-83a3-41bd-86de-387eba45dbfd/router/0.log"
Jul 03 14:54:41.167858 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:41.167826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ftv7j_d908e1a9-e9ce-42b6-b555-5bfdadedeb18/server/0.log"
Jul 03 14:54:41.323524 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:41.323500    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-46x47_11db2e69-a71b-4760-a71f-32bfe6820c29/manager/0.log"
Jul 03 14:54:41.350937 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:41.350906    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-46x47_11db2e69-a71b-4760-a71f-32bfe6820c29/copy-manifests/0.log"
Jul 03 14:54:42.437446 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:42.437415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-645vp_6f366185-c986-4a08-918a-cc5a60e3f768/discovery/0.log"
Jul 03 14:54:42.450973 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:42.450948    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-5ws4j_afb1e616-c348-43c2-8bfc-b686c4955161/kube-auth-proxy/0.log"
Jul 03 14:54:42.676001 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:42.675965    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-949ddbdcf-6kjlb_889480dc-83a3-41bd-86de-387eba45dbfd/router/0.log"
Jul 03 14:54:42.936129 ip-10-0-141-67 kubenswrapper[2563]: I0703 14:54:42.936093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77cf67f8d7-8zbzq_affefb83-55b5-4454-8d0d-0b73bd67af3d/manager/0.log"