Jul 22 09:17:24.293212 ip-10-0-142-141 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 09:17:24.668412 ip-10-0-142-141 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 09:17:24.668412 ip-10-0-142-141 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 09:17:24.668412 ip-10-0-142-141 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 09:17:24.668412 ip-10-0-142-141 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 09:17:24.668412 ip-10-0-142-141 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 09:17:24.669117 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.668480    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 09:17:24.675653 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675626    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 09:17:24.675653 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675647    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 09:17:24.675653 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675653    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 09:17:24.675653 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675658    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675662    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675666    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675669    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675672    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675675    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675678    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675680    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675683    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675686    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675689    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675691    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675694    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675697    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675699    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675703    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675705    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675708    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675710    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675713    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 09:17:24.675826 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675716    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675718    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675721    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675723    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675725    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675728    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675730    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675733    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675740    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675742    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675745    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675748    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675750    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675753    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675756    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675760    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675765    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675768    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675771    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675774    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 09:17:24.676332 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675776    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675779    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675782    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675784    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675787    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675789    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675792    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675795    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675798    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675802    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675805    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675809    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675812    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675815    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675817    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675820    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675822    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675825    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675827    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 09:17:24.676811 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675830    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675844    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675847    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675850    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675854    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675856    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675859    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675862    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675865    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675869    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675872    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675875    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675878    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675880    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675883    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675886    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675889    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675891    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675893    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675896    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 09:17:24.677351 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675899    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675908    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675911    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675914    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675916    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675919    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675921    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675924    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675926    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675929    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675932    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675934    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675937    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675939    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675943    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675945    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.675948    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676697    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676705    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 09:17:24.677825 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676712    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676716    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676719    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676722    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676725    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676728    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676731    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676733    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676737    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676740    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676743    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676745    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676748    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676750    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676753    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676756    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676759    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676762    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676764    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 09:17:24.678289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676767    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676769    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676772    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676775    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676778    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676781    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676784    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676787    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676789    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676792    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676794    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676797    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676800    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676803    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676806    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676808    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676811    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676814    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676817    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676819    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 09:17:24.678756 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676823    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676825    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676828    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676830    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676849    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676852    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676854    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676857    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676860    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676863    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676865    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676868    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676871    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676875    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676878    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676881    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676885    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676887    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676890    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676893    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 09:17:24.679287 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676896    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676898    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676901    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676903    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676906    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676909    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676911    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676914    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676917    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676920    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676923    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676925    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676928    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676930    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676934    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676937    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676939    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676941    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676944    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676946    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 09:17:24.679781 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676949    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676952    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676955    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676957    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676960    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676962    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676965    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676967    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676970    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676973    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676976    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676978    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676981    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676983    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676986    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676989    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676991    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.676994    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677435    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677440    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 09:17:24.680276 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677444    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677447    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677450    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677453    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677456    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677459    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677462    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677465    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677467    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677470    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677472    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677475    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677478    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677480    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677484    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677486    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677489    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677491    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677494    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677496    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 09:17:24.680794 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677499    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677502    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677504    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677507    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677509    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677512    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677514    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677517    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677520    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677522    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677525    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677527    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677530    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677533    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677535    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677537    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677540    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677542    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677545    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677547    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 09:17:24.681303 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677550    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677552    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677555    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677557    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677560    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677563    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677565    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677569    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677571    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677574    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677576    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677579    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677582    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677586    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677588    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677591    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677593    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677596    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677598    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 09:17:24.681792 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677601    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677604    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677606    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677609    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677612    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677614    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677617    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677619    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677621    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677624    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677627    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677629    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677631    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677634    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677636    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677638    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677641    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677643    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677646    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677648    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 09:17:24.682294 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677651    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677654    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677656    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677660    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677667    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677670    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677673    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677677    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677681    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677684    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677687    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677690    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677692    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677696    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677698    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677703    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677706    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.677709    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677779    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677786    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 09:17:24.682762 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677795    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677800    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677804    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677807    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677811    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677816    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677819    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677822    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677825    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677829    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677844    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677848    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677853    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677857    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677861    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677864    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677886    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677890    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677893    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677896    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677900    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677904    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677907    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 09:17:24.683270 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677910    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677914    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677917    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677919    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677922    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677925    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677928    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677932    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677935    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677938    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677941    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677944    2560 flags.go:64] FLAG: --enable-server="true"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677947    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677951    2560 flags.go:64] FLAG: --event-burst="100"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677954    2560 flags.go:64] FLAG: --event-qps="50"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677957    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677960    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677963    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677966    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677969    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677972    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677977    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677980    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677983    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677987    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 09:17:24.683818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677991    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677993    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677996    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.677999    2560 flags.go:64] FLAG: --feature-gates=""
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678003    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678006    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678009    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678012    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678015    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678018    2560 flags.go:64] FLAG: --help="false"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678021    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-142-141.ec2.internal"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678024    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678027    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678030    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678033    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678037    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678040    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678043    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678045    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678048    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678051    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678054    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678057    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678060    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 09:17:24.684919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678062    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678065    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678068    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678071    2560 flags.go:64] FLAG: --lock-file=""
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678075    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678079    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678082    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678087    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678091    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678094    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678097    2560 flags.go:64] FLAG: --logging-format="text"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678100    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678103    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678106    2560 flags.go:64] FLAG: --manifest-url=""
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678109    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678118    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678121    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678125    2560 flags.go:64] FLAG: --max-pods="110"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678128    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678132    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678134    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678137    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678140    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678143    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678146    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 09:17:24.685937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678153    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678156    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678159    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678162    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678165    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678170    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678172    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678175    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678178    2560 flags.go:64] FLAG: --port="10250"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678182    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678184    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a000bf5f1681567b"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678188    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678192    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678195    2560 flags.go:64] FLAG: --register-node="true"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678197    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678201    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678205    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678208    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678211    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678214    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678218    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678220    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678223    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678226    2560 flags.go:64] FLAG: --runonce="false"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678229    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 09:17:24.687064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678233    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678236    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678239    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678241    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678244    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678247    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678251    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678253    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678256    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678259    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678262    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678265    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678268    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678270    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678276    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678279    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678282    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678286    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678289    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678293    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678296    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678299    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678304    2560 flags.go:64] FLAG: --v="2"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678308    2560 flags.go:64] FLAG: --version="false"
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678313    2560 flags.go:64] FLAG: --vmodule=""
Jul 22 09:17:24.687974 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678317    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678320    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678446    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678451    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678454    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678458    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678460    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678463    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678466    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678468    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678471    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678474    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678477    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678479    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678482    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678485    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678487    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678490    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678492    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678495    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 09:17:24.688947 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678497    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678500    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678502    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678504    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678507    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678510    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678514    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678516    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678519    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678522    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678525    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678528    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678531    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678533    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678536    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678538    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678541    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678544    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678546    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678549    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 09:17:24.689757 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678551    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678554    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678556    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678558    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678561    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678563    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678566    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678568    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678571    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678573    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678576    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678579    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678581    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678584    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678586    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678589    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678591    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678594    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678598    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 09:17:24.690505 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678602    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678606    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678611    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678614    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678617    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678619    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678623    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678625    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678628    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678630    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678633    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678636    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678638    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678641    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678643    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678646    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678648    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678651    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678653    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678656    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 09:17:24.691044 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678659    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678661    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678664    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678666    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678669    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678672    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678674    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678677    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678679    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678682    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678684    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678688    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678691    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678694    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678697    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678700    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678703    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678705    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678708    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678711    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 09:17:24.691519 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678714    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.678718    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.678723    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.686114    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.686135    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.686162    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.686174    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686258    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686266    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686271    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686276    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686281    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686285    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686289    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686293    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 09:17:24.692050 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686297    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686301    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686306    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686312    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686318    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686323    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686328    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686333    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686338    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686342    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686347    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686352    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686356    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686361    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686366    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686371    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686376    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686381    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686385    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 09:17:24.692477 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686389    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686396    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686402    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686408    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686412    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686417    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686421    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686425    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686430    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686436    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686442    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686447    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686452    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686456    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686461    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686465    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686470    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686474    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686478    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 09:17:24.693032 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686482    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686486    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686491    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686495    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686500    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686505    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686509    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686514    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686518    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686522    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686526    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686532    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686536    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686540    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686544    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686548    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686553    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686557    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686561    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686565    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 09:17:24.693494 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686569    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686573    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686578    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686582    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686587    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686592    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686596    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686600    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686604    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686608    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686612    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686616    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686620    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686625    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686629    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686633    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686637    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686642    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686646    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686650    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 09:17:24.694100 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686655    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686659    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686663    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686667    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686673    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686678    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686682    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686686    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686691    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686695    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686700    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686705    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686710    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.686719    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686953    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 09:17:24.694864 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686963    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686968    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686973    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686978    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686983    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686988    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686993    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.686997    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687002    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687007    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687013    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687020    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687024    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687028    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687033    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687037    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687042    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687046    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687051    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 09:17:24.695489 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687055    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687059    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687063    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687069    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687073    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687077    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687081    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687085    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687089    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687093    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687097    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687101    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687106    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687110    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687115    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687119    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687123    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687127    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687132    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687136    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 09:17:24.696361 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687140    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687144    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687151    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687156    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687161    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687166    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687170    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687175    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687179    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687184    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687189    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687193    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687197    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687202    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687206    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687211    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687224    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687228    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687235    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 09:17:24.697081 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687241    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687245    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687250    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687254    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687259    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687263    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687267    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687271    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687275    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687279    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687284    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687288    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687292    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687296    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687300    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687304    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687308    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687312    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687316    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687320    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 09:17:24.697617 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687325    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687329    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687333    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687337    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687342    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687346    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687350    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687354    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687358    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687362    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687375    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687380    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687384    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687388    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687392    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687396    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687400    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687404    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687408    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 09:17:24.698176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:24.687412    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.687421    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.687579    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.690330    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.692022    2560 server.go:1019] "Starting client certificate rotation"
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.692153    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.692194    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 09:17:24.698635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.695023    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 09:17:24.700017 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.699989    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 09:17:24.711198 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.711179    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 22 09:17:24.713161 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.713144    2560 log.go:25] "Validated CRI v1 image API"
Jul 22 09:17:24.714002 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.713984    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 09:17:24.717058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.717033    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b9ef4f7e-3668-4825-aed7-f009b6ecd123:/dev/nvme0n1p4 f548a8be-e493-46e5-ab3b-b7656fb01a25:/dev/nvme0n1p3]
Jul 22 09:17:24.717127 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.717057    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 09:17:24.720548 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.720531    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 09:17:24.723488 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.723376    2560 manager.go:216] Machine: {Timestamp:2026-07-22 09:17:24.722020334 +0000 UTC m=+0.316012490 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100632 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e863ab40fa06ae5406ab161926a47 SystemUUID:ec2e863a-b40f-a06a-e540-6ab161926a47 BootID:0bcdd647-703f-4215-bfca-cfc90ff607fe Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:48:2b:8c:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:48:2b:8c:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:c5:cf:e5:f3:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 09:17:24.723488 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.723480    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 09:17:24.723616 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.723557    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 09:17:24.726448 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.726424    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 09:17:24.726577 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.726451    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 09:17:24.727358 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.727348    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 09:17:24.727397 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.727361    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 09:17:24.727397 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.727368    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 09:17:24.728135 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.728125    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 09:17:24.729339 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.729330    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 09:17:24.732084 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732073    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 09:17:24.732224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732209    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 09:17:24.732261 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732248    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 09:17:24.732261 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732257    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 09:17:24.732331 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732269    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 09:17:24.732331 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732278    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 22 09:17:24.732331 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732293    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 09:17:24.732673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732657    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 09:17:24.732718 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.732679    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 09:17:24.734765 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.734744    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 09:17:24.737035 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.737022    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 09:17:24.737088 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.737052    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 09:17:24.738650 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738637    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 09:17:24.738650 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738653    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738660    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738665    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738674    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738680    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738688    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738693    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738699    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738704    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738712    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 09:17:24.738758 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.738718    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 09:17:24.739484 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.739470    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 09:17:24.739523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.739487    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 09:17:24.742813 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.742799    2560 server.go:1268] "Started kubelet"
Jul 22 09:17:24.742973 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.742931    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 09:17:24.743062 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.742958    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 09:17:24.743062 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.743057    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 09:17:24.743305 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.743263    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 09:17:24.746748 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.746716    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 09:17:24.747066 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.747043    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 09:17:24.747132 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.747082    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 09:17:24.747146 ip-10-0-142-141 systemd[1]: Started Kubernetes Kubelet.
Jul 22 09:17:24.749814 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.749583    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 09:17:24.752388 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.752372    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 09:17:24.755217 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.754208    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18c491f78c532af4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-22 09:17:24.742769396 +0000 UTC m=+0.336761531,LastTimestamp:2026-07-22 09:17:24.742769396 +0000 UTC m=+0.336761531,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 22 09:17:24.758080 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758066    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 09:17:24.758163 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758085    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 09:17:24.758207 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.758164    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:24.758704 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758621    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 09:17:24.758704 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758647    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 09:17:24.758704 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758624    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 09:17:24.758875 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758729    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 09:17:24.758875 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.758738    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 09:17:24.759031 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759015    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 09:17:24.759081 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759034    2560 factory.go:55] Registering systemd factory
Jul 22 09:17:24.759081 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759044    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 22 09:17:24.759247 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759234    2560 factory.go:153] Registering CRI-O factory
Jul 22 09:17:24.759293 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759249    2560 factory.go:223] Registration of the crio container factory successfully
Jul 22 09:17:24.759293 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759273    2560 factory.go:103] Registering Raw factory
Jul 22 09:17:24.759293 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.759286    2560 manager.go:1196] Started watching for new ooms in manager
Jul 22 09:17:24.760324 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.760309    2560 manager.go:349] Starting recovery of all containers
Jul 22 09:17:24.767530 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.767503    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 09:17:24.767820 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.767780    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 09:17:24.770458 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.770443    2560 manager.go:354] Recovery completed
Jul 22 09:17:24.775696 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.775605    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:24.777391 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.777364    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:24.777471 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.777407    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:24.777471 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.777423    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:24.778013 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.777992    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 09:17:24.778013 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.778014    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 09:17:24.778111 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.778002    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:24.778111 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.778034    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 09:17:24.778755 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.778741    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:24.778813 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.778785    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:24.778813 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.778797    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:24.779310 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.779298    2560 policy_none.go:49] "None policy: Start"
Jul 22 09:17:24.779310 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.779315    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 09:17:24.779419 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.779328    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 09:17:24.779419 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.779262    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18c491f78e63710d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-22 09:17:24.777390349 +0000 UTC m=+0.371382493,LastTimestamp:2026-07-22 09:17:24.777390349 +0000 UTC m=+0.371382493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 22 09:17:24.780326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.780314    2560 policy_none.go:47] "Start"
Jul 22 09:17:24.787468 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.787411    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18c491f78e63d27f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-22 09:17:24.777415295 +0000 UTC m=+0.371407433,LastTimestamp:2026-07-22 09:17:24.777415295 +0000 UTC m=+0.371407433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 22 09:17:24.790180 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.790160    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8swp"
Jul 22 09:17:24.791144 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.791068    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18c491f78e6404b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-141.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-22 09:17:24.777428148 +0000 UTC m=+0.371420287,LastTimestamp:2026-07-22 09:17:24.777428148 +0000 UTC m=+0.371420287,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 22 09:17:24.797477 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.797460    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8swp"
Jul 22 09:17:24.799891 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.799794    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-141.ec2.internal.18c491f78e63710d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18c491f78e63710d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-22 09:17:24.777390349 +0000 UTC m=+0.371382493,LastTimestamp:2026-07-22 09:17:24.778754983 +0000 UTC m=+0.372747118,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 22 09:17:24.801914 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.801818    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-141.ec2.internal.18c491f78e63d27f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18c491f78e63d27f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-22 09:17:24.777415295 +0000 UTC m=+0.371407433,LastTimestamp:2026-07-22 09:17:24.77879103 +0000 UTC m=+0.372783164,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 22 09:17:24.805415 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805402    2560 manager.go:337] "Starting Device Plugin manager"
Jul 22 09:17:24.805485 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.805430    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 09:17:24.805485 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805439    2560 server.go:87] "Starting device plugin registration server"
Jul 22 09:17:24.805737 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805722    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 09:17:24.805807 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805738    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 09:17:24.805873 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805851    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 09:17:24.805927 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805917    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 09:17:24.805927 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.805925    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 09:17:24.806653 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.806634    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 09:17:24.806795 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.806774    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:24.900669 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.900507    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 09:17:24.901868 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.901851    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 09:17:24.901951 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.901892    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 09:17:24.901951 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.901915    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 09:17:24.902037 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.901953    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 09:17:24.904770 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.904745    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 09:17:24.906602 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.906580    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:24.907382 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.907364    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:24.907465 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.907396    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:24.907465 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.907408    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:24.907465 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.907429    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-141.ec2.internal"
Jul 22 09:17:24.914442 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:24.914427    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-141.ec2.internal"
Jul 22 09:17:24.914516 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.914447    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-141.ec2.internal\": node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:24.955996 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:24.955932    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.002818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.002773    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"]
Jul 22 09:17:25.002966 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.002869    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:25.004513 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.004494    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:25.004611 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.004526    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:25.004611 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.004537    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:25.005988 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.005977    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:25.006107 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006093    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.006149 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006123    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:25.006676 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006656    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:25.006763 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006685    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:25.006763 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006695    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:25.006763 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006656    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:25.006881 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006773    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:25.006881 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.006788    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:25.007950 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.007935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.008002 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.007962    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 09:17:25.008615 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.008600    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 09:17:25.008669 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.008626    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 09:17:25.008669 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.008641    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 22 09:17:25.024412 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.024386    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-141.ec2.internal\" not found" node="ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.028241 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.028225    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-141.ec2.internal\" not found" node="ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.056382 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.056351    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.060180 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.060163    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7619b3ae7368cc99b40e4b39f377a201-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"7619b3ae7368cc99b40e4b39f377a201\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.060235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.060193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7619b3ae7368cc99b40e4b39f377a201-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"7619b3ae7368cc99b40e4b39f377a201\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.060235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.060225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9051b14160ff1bc1e70b7082345b9d33-config\") pod \"kube-apiserver-proxy-ip-10-0-142-141.ec2.internal\" (UID: \"9051b14160ff1bc1e70b7082345b9d33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.156771 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.156735    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.161113 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.161084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7619b3ae7368cc99b40e4b39f377a201-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"7619b3ae7368cc99b40e4b39f377a201\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.161179 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.161122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7619b3ae7368cc99b40e4b39f377a201-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"7619b3ae7368cc99b40e4b39f377a201\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.161179 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.161150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9051b14160ff1bc1e70b7082345b9d33-config\") pod \"kube-apiserver-proxy-ip-10-0-142-141.ec2.internal\" (UID: \"9051b14160ff1bc1e70b7082345b9d33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.161243 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.161204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9051b14160ff1bc1e70b7082345b9d33-config\") pod \"kube-apiserver-proxy-ip-10-0-142-141.ec2.internal\" (UID: \"9051b14160ff1bc1e70b7082345b9d33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.161243 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.161209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7619b3ae7368cc99b40e4b39f377a201-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"7619b3ae7368cc99b40e4b39f377a201\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.161243 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.161208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7619b3ae7368cc99b40e4b39f377a201-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"7619b3ae7368cc99b40e4b39f377a201\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.257609 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.257547    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.328073 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.328045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.332194 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.332051    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.357907 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.357881    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.458373 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.458329    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.558624 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.558594    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 22 09:17:25.655233 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.655199    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 09:17:25.658346 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.658322    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.666971 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.666952    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 09:17:25.668715 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.668701    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 22 09:17:25.682763 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.682738    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 09:17:25.690990 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.690967    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 09:17:25.691149 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.691127    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 09:17:25.691235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.691147    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 09:17:25.732515 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.732486    2560 apiserver.go:52] "Watching apiserver"
Jul 22 09:17:25.749665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.749637    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 09:17:25.750049 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.750026    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4p5ct","kube-system/konnectivity-agent-vghc5","openshift-dns/node-resolver-vsg8g","openshift-image-registry/node-ca-xc9cj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal","openshift-multus/multus-additional-cni-plugins-4hj96","openshift-network-diagnostics/network-check-target-cg4gs","openshift-ovn-kubernetes/ovnkube-node-sv9vm","kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n","openshift-cluster-node-tuning-operator/tuned-grbwn","openshift-multus/multus-r9lcb","openshift-multus/network-metrics-daemon-l26m8","openshift-network-operator/iptables-alerter-blq2l"]
Jul 22 09:17:25.752059 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.752022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:25.752193 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.752145    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:25.754131 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.754107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.755354 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.755331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.756286 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.756264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.756486 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.756467    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f8nvw\""
Jul 22 09:17:25.756541 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.756501    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.756693 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.756671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.757610 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.757586    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.757923 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.757898    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x867g\""
Jul 22 09:17:25.758266 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.758235    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 09:17:25.758266 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.758263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.758408 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.758369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.759076 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.759049    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.759296 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.759280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.759638 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.759599    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.759742 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.759672    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 09:17:25.759742 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.759701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4sh8g\""
Jul 22 09:17:25.760557 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.760527    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.760647 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.760620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfkrf\""
Jul 22 09:17:25.761200 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.761180    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.761287 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.761228    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.761356 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.761332    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 09:17:25.761632 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.761610    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 09:17:25.761826 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.761813    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 09:17:25.762089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.762052    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.762089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.762055    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b9jtv\""
Jul 22 09:17:25.762224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.762185    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.762224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.762211    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:25.762329 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.762272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 09:17:25.762329 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.762274    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:25.763348 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763329    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.763348 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763348    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 09:17:25.763658 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.763902 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysconfig\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764000 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysctl-d\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764000 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4d4\" (UniqueName: \"kubernetes.io/projected/a7e01367-743a-4de8-9f3c-49e4f8a19916-kube-api-access-qn4d4\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.764000 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.763992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-os-release\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764100 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764100 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysctl-conf\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764100 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d309f709-3d72-48d0-9e97-848503615420-etc-tuned\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764100 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d45cc663-ff38-4f9c-b108-a4df2906f1f0-host\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.764100 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764262 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-modprobe-d\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764262 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-lib-modules\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764262 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhs8x\" (UniqueName: \"kubernetes.io/projected/d309f709-3d72-48d0-9e97-848503615420-kube-api-access-lhs8x\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764262 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e01367-743a-4de8-9f3c-49e4f8a19916-tmp-dir\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.764262 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-host\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cnibin\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764274    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764305    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764387    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-run\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764506 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-var-lib-kubelet\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5mxcj\""
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6ls\" (UniqueName: \"kubernetes.io/projected/d45cc663-ff38-4f9c-b108-a4df2906f1f0-kube-api-access-jf6ls\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20234055-e427-40d8-bc99-afdc5d8e8d5e-host-slash\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-sys\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d309f709-3d72-48d0-9e97-848503615420-tmp\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7e01367-743a-4de8-9f3c-49e4f8a19916-hosts-file\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d45cc663-ff38-4f9c-b108-a4df2906f1f0-serviceca\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20234055-e427-40d8-bc99-afdc5d8e8d5e-iptables-alerter-script\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjwsr\" (UniqueName: \"kubernetes.io/projected/20234055-e427-40d8-bc99-afdc5d8e8d5e-kube-api-access-xjwsr\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-system-cni-dir\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.764869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbldh\" (UniqueName: \"kubernetes.io/projected/7751ed5b-d899-4aad-8134-9c2b4f2799aa-kube-api-access-fbldh\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.765362 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-kubernetes\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.765362 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.764944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-systemd\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.765362 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.765297    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.766059 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.766042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 09:17:25.766451 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.766434    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 09:17:25.766451 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.766444    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j8kjf\""
Jul 22 09:17:25.766962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.766945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.767048 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.767014    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:25.767812 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.767792    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 09:17:25.768347 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.768181    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 09:17:25.768347 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.768226    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9rvmm\""
Jul 22 09:17:25.768347 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.768305    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 09:17:25.769155 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.769112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.771219 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.771201    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sh5rp\""
Jul 22 09:17:25.771363 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.771346    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 09:17:25.771525 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.771512    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 09:17:25.797069 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.796974    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2nwn"
Jul 22 09:17:25.801483 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.801438    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 09:12:25 +0000 UTC" deadline="2028-03-30 15:43:52.878545306 +0000 UTC"
Jul 22 09:17:25.801483 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.801479    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14814h26m27.077069201s"
Jul 22 09:17:25.806262 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.806246    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2nwn"
Jul 22 09:17:25.828911 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:25.828882    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7619b3ae7368cc99b40e4b39f377a201.slice/crio-bc93d228b10f2ddb3248b4fa861d7312704603b95b6a9ee210838b0668cdc870 WatchSource:0}: Error finding container bc93d228b10f2ddb3248b4fa861d7312704603b95b6a9ee210838b0668cdc870: Status 404 returned error can't find the container with id bc93d228b10f2ddb3248b4fa861d7312704603b95b6a9ee210838b0668cdc870
Jul 22 09:17:25.834379 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.834357    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 09:17:25.859979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.859960    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 09:17:25.865220 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cnibin\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.865310 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:25.865310 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-etc-selinux\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.865423 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-kubelet\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.865423 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cnibin\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.865523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-cni-bin\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.865523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-run\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-var-lib-kubelet\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6ls\" (UniqueName: \"kubernetes.io/projected/d45cc663-ff38-4f9c-b108-a4df2906f1f0-kube-api-access-jf6ls\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.865662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wb6l\" (UniqueName: \"kubernetes.io/projected/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-kube-api-access-5wb6l\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:25.865662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d45cc663-ff38-4f9c-b108-a4df2906f1f0-serviceca\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.865662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjwsr\" (UniqueName: \"kubernetes.io/projected/20234055-e427-40d8-bc99-afdc5d8e8d5e-kube-api-access-xjwsr\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.865662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-system-cni-dir\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbldh\" (UniqueName: \"kubernetes.io/projected/7751ed5b-d899-4aad-8134-9c2b4f2799aa-kube-api-access-fbldh\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-var-lib-kubelet\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-var-lib-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-system-cni-dir\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovnkube-script-lib\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-run\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-kubernetes\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-systemd\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/650050ff-f9f6-4c60-a177-dab5d00e8a3b-kubelet-config\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-kubernetes\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-os-release\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-systemd\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-conf-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.865935 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-etc-kubernetes\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-ovn\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.865988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovn-node-metrics-cert\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysconfig\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4d4\" (UniqueName: \"kubernetes.io/projected/a7e01367-743a-4de8-9f3c-49e4f8a19916-kube-api-access-qn4d4\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysconfig\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-netns\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-systemd-units\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d45cc663-ff38-4f9c-b108-a4df2906f1f0-serviceca\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9xm7\" (UniqueName: \"kubernetes.io/projected/8b22ff41-59d2-42fc-b58c-5fcee1180df1-kube-api-access-g9xm7\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysctl-conf\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d309f709-3d72-48d0-9e97-848503615420-etc-tuned\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63287e77-8966-4a82-af46-abba71eeb638-agent-certs\") pod \"konnectivity-agent-vghc5\" (UID: \"63287e77-8966-4a82-af46-abba71eeb638\") " pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysctl-conf\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-socket-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.866627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-registration-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-slash\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-modprobe-d\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-lib-modules\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63287e77-8966-4a82-af46-abba71eeb638-konnectivity-ca\") pod \"konnectivity-agent-vghc5\" (UID: \"63287e77-8966-4a82-af46-abba71eeb638\") " pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-socket-dir-parent\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866597    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-modprobe-d\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-cni-bin\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e01367-743a-4de8-9f3c-49e4f8a19916-tmp-dir\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-lib-modules\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-device-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/650050ff-f9f6-4c60-a177-dab5d00e8a3b-dbus\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-system-cni-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.867450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-host\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-host\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20234055-e427-40d8-bc99-afdc5d8e8d5e-host-slash\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.866997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20234055-e427-40d8-bc99-afdc5d8e8d5e-host-slash\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-sys-fs\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e01367-743a-4de8-9f3c-49e4f8a19916-tmp-dir\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-etc-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-sys\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d309f709-3d72-48d0-9e97-848503615420-tmp\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-sys\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7e01367-743a-4de8-9f3c-49e4f8a19916-hosts-file\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.868232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20234055-e427-40d8-bc99-afdc5d8e8d5e-iptables-alerter-script\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7751ed5b-d899-4aad-8134-9c2b4f2799aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhd9\" (UniqueName: \"kubernetes.io/projected/5baa3969-cecc-4f8f-871e-ef5e57266635-kube-api-access-lnhd9\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7e01367-743a-4de8-9f3c-49e4f8a19916-hosts-file\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4m5\" (UniqueName: \"kubernetes.io/projected/aa79c72c-6097-47a2-82e1-46e3389b2da7-kube-api-access-gq4m5\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-daemon-config\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-run-netns\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20234055-e427-40d8-bc99-afdc5d8e8d5e-iptables-alerter-script\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysctl-d\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-os-release\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-kubelet\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-hostroot\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d309f709-3d72-48d0-9e97-848503615420-etc-sysctl-d\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-systemd\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d45cc663-ff38-4f9c-b108-a4df2906f1f0-host\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5baa3969-cecc-4f8f-871e-ef5e57266635-cni-binary-copy\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.868874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-k8s-cni-cncf-io\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.867962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7751ed5b-d899-4aad-8134-9c2b4f2799aa-os-release\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-cni-multus\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d45cc663-ff38-4f9c-b108-a4df2906f1f0-host\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-multus-certs\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-node-log\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-log-socket\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-env-overrides\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhs8x\" (UniqueName: \"kubernetes.io/projected/d309f709-3d72-48d0-9e97-848503615420-kube-api-access-lhs8x\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-cni-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-cnibin\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-cni-netd\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.869572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.868409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovnkube-config\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.870793 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.870765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d309f709-3d72-48d0-9e97-848503615420-tmp\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.870793 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.870787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d309f709-3d72-48d0-9e97-848503615420-etc-tuned\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.877082 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.877051    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:25.877082 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.877084    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:25.877250 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.877097    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:25.877250 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.877169    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:26.377147682 +0000 UTC m=+1.971139832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:25.878447 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.878418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjwsr\" (UniqueName: \"kubernetes.io/projected/20234055-e427-40d8-bc99-afdc5d8e8d5e-kube-api-access-xjwsr\") pod \"iptables-alerter-blq2l\" (UID: \"20234055-e427-40d8-bc99-afdc5d8e8d5e\") " pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:25.878720 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.878702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbldh\" (UniqueName: \"kubernetes.io/projected/7751ed5b-d899-4aad-8134-9c2b4f2799aa-kube-api-access-fbldh\") pod \"multus-additional-cni-plugins-4hj96\" (UID: \"7751ed5b-d899-4aad-8134-9c2b4f2799aa\") " pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:25.878800 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.878743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhs8x\" (UniqueName: \"kubernetes.io/projected/d309f709-3d72-48d0-9e97-848503615420-kube-api-access-lhs8x\") pod \"tuned-grbwn\" (UID: \"d309f709-3d72-48d0-9e97-848503615420\") " pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:25.879240 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.879222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4d4\" (UniqueName: \"kubernetes.io/projected/a7e01367-743a-4de8-9f3c-49e4f8a19916-kube-api-access-qn4d4\") pod \"node-resolver-vsg8g\" (UID: \"a7e01367-743a-4de8-9f3c-49e4f8a19916\") " pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:25.879499 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.879481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6ls\" (UniqueName: \"kubernetes.io/projected/d45cc663-ff38-4f9c-b108-a4df2906f1f0-kube-api-access-jf6ls\") pod \"node-ca-xc9cj\" (UID: \"d45cc663-ff38-4f9c-b108-a4df2906f1f0\") " pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:25.906589 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.906515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"7619b3ae7368cc99b40e4b39f377a201","Type":"ContainerStarted","Data":"bc93d228b10f2ddb3248b4fa861d7312704603b95b6a9ee210838b0668cdc870"}
Jul 22 09:17:25.909212 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.909192    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 09:17:25.968683 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-daemon-config\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.968683 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-run-netns\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.968879 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.968879 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-run-netns\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.968879 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-kubelet\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-hostroot\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-kubelet\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-systemd\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-hostroot\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5baa3969-cecc-4f8f-871e-ef5e57266635-cni-binary-copy\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.968988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-systemd\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-k8s-cni-cncf-io\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-cni-multus\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-multus-certs\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-node-log\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-cni-multus\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-k8s-cni-cncf-io\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-log-socket\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-node-log\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-log-socket\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-multus-certs\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-env-overrides\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-cni-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-daemon-config\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-cnibin\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-cni-netd\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovnkube-config\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-cni-netd\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-cnibin\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.969494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-etc-selinux\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5baa3969-cecc-4f8f-871e-ef5e57266635-cni-binary-copy\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-kubelet\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-cni-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-cni-bin\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wb6l\" (UniqueName: \"kubernetes.io/projected/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-kube-api-access-5wb6l\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-kubelet\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-var-lib-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-etc-selinux\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-cni-bin\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovnkube-script-lib\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/650050ff-f9f6-4c60-a177-dab5d00e8a3b-kubelet-config\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-os-release\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/650050ff-f9f6-4c60-a177-dab5d00e8a3b-kubelet-config\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-var-lib-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-conf-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-conf-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-etc-kubernetes\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.970424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-os-release\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-ovn\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-env-overrides\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-etc-kubernetes\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-ovn\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovn-node-metrics-cert\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-netns\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovnkube-config\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-systemd-units\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-run-netns\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9xm7\" (UniqueName: \"kubernetes.io/projected/8b22ff41-59d2-42fc-b58c-5fcee1180df1-kube-api-access-g9xm7\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-systemd-units\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63287e77-8966-4a82-af46-abba71eeb638-agent-certs\") pod \"konnectivity-agent-vghc5\" (UID: \"63287e77-8966-4a82-af46-abba71eeb638\") " pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-socket-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.969987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-registration-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-slash\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovnkube-script-lib\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-slash\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-registration-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63287e77-8966-4a82-af46-abba71eeb638-konnectivity-ca\") pod \"konnectivity-agent-vghc5\" (UID: \"63287e77-8966-4a82-af46-abba71eeb638\") " pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-socket-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-socket-dir-parent\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-cni-bin\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-multus-socket-dir-parent\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.970251    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-device-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-host-var-lib-cni-bin\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/650050ff-f9f6-4c60-a177-dab5d00e8a3b-dbus\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-run-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-system-cni-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-device-dir\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.970340    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:17:26.470312577 +0000 UTC m=+2.064304703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/650050ff-f9f6-4c60-a177-dab5d00e8a3b-dbus\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:25.971665 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5baa3969-cecc-4f8f-871e-ef5e57266635-system-cni-dir\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-sys-fs\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa79c72c-6097-47a2-82e1-46e3389b2da7-sys-fs\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.970528    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:25.970577    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:17:26.470559742 +0000 UTC m=+2.064551869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-etc-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhd9\" (UniqueName: \"kubernetes.io/projected/5baa3969-cecc-4f8f-871e-ef5e57266635-kube-api-access-lnhd9\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63287e77-8966-4a82-af46-abba71eeb638-konnectivity-ca\") pod \"konnectivity-agent-vghc5\" (UID: \"63287e77-8966-4a82-af46-abba71eeb638\") " pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4m5\" (UniqueName: \"kubernetes.io/projected/aa79c72c-6097-47a2-82e1-46e3389b2da7-kube-api-access-gq4m5\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.972252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.970672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b22ff41-59d2-42fc-b58c-5fcee1180df1-etc-openvswitch\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.972601 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.972259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b22ff41-59d2-42fc-b58c-5fcee1180df1-ovn-node-metrics-cert\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.972601 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.972384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63287e77-8966-4a82-af46-abba71eeb638-agent-certs\") pod \"konnectivity-agent-vghc5\" (UID: \"63287e77-8966-4a82-af46-abba71eeb638\") " pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:25.980290 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.980264    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4m5\" (UniqueName: \"kubernetes.io/projected/aa79c72c-6097-47a2-82e1-46e3389b2da7-kube-api-access-gq4m5\") pod \"aws-ebs-csi-driver-node-4565n\" (UID: \"aa79c72c-6097-47a2-82e1-46e3389b2da7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:25.980401 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.980383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9xm7\" (UniqueName: \"kubernetes.io/projected/8b22ff41-59d2-42fc-b58c-5fcee1180df1-kube-api-access-g9xm7\") pod \"ovnkube-node-sv9vm\" (UID: \"8b22ff41-59d2-42fc-b58c-5fcee1180df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:25.980573 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.980556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhd9\" (UniqueName: \"kubernetes.io/projected/5baa3969-cecc-4f8f-871e-ef5e57266635-kube-api-access-lnhd9\") pod \"multus-r9lcb\" (UID: \"5baa3969-cecc-4f8f-871e-ef5e57266635\") " pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:25.980722 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:25.980707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wb6l\" (UniqueName: \"kubernetes.io/projected/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-kube-api-access-5wb6l\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:26.082403 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.082313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-grbwn"
Jul 22 09:17:26.091099 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.091074    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd309f709_3d72_48d0_9e97_848503615420.slice/crio-e71cd030e24b0198c5d210142f3f055ec29b5453dde8e37a4d8d8b2106aaaa9f WatchSource:0}: Error finding container e71cd030e24b0198c5d210142f3f055ec29b5453dde8e37a4d8d8b2106aaaa9f: Status 404 returned error can't find the container with id e71cd030e24b0198c5d210142f3f055ec29b5453dde8e37a4d8d8b2106aaaa9f
Jul 22 09:17:26.110724 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.110703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vsg8g"
Jul 22 09:17:26.118869 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.118828    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e01367_743a_4de8_9f3c_49e4f8a19916.slice/crio-b24d17bf498f1127c96a90ed46d85b2b3e4ef6d0bfb83320d0a54a144fb1eefb WatchSource:0}: Error finding container b24d17bf498f1127c96a90ed46d85b2b3e4ef6d0bfb83320d0a54a144fb1eefb: Status 404 returned error can't find the container with id b24d17bf498f1127c96a90ed46d85b2b3e4ef6d0bfb83320d0a54a144fb1eefb
Jul 22 09:17:26.136260 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.136236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xc9cj"
Jul 22 09:17:26.141301 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.141279    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-blq2l"
Jul 22 09:17:26.144101 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.144079    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45cc663_ff38_4f9c_b108_a4df2906f1f0.slice/crio-85851e71fa9f7f5ff9ae9cd253381cd2466bcddeebaa6a0fbd729de7eb27bed6 WatchSource:0}: Error finding container 85851e71fa9f7f5ff9ae9cd253381cd2466bcddeebaa6a0fbd729de7eb27bed6: Status 404 returned error can't find the container with id 85851e71fa9f7f5ff9ae9cd253381cd2466bcddeebaa6a0fbd729de7eb27bed6
Jul 22 09:17:26.148046 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.147987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4hj96"
Jul 22 09:17:26.148597 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.148573    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20234055_e427_40d8_bc99_afdc5d8e8d5e.slice/crio-d2f9e125413be33792c0a50cd359763cacbd2c343e71875a7c8e122e6943f794 WatchSource:0}: Error finding container d2f9e125413be33792c0a50cd359763cacbd2c343e71875a7c8e122e6943f794: Status 404 returned error can't find the container with id d2f9e125413be33792c0a50cd359763cacbd2c343e71875a7c8e122e6943f794
Jul 22 09:17:26.150447 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.150432    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 09:17:26.154508 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.154489    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:26.157575 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.157547    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7751ed5b_d899_4aad_8134_9c2b4f2799aa.slice/crio-fe69b98662babe96c7dc04bded1a2b9609ce79955b6da4ec1880405ac8cc4eea WatchSource:0}: Error finding container fe69b98662babe96c7dc04bded1a2b9609ce79955b6da4ec1880405ac8cc4eea: Status 404 returned error can't find the container with id fe69b98662babe96c7dc04bded1a2b9609ce79955b6da4ec1880405ac8cc4eea
Jul 22 09:17:26.159551 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.159329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:26.163650 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.163627    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b22ff41_59d2_42fc_b58c_5fcee1180df1.slice/crio-64869ac66b6ce9691899574d026f9989646b7dbf3458acd6d27b3f5b097933a0 WatchSource:0}: Error finding container 64869ac66b6ce9691899574d026f9989646b7dbf3458acd6d27b3f5b097933a0: Status 404 returned error can't find the container with id 64869ac66b6ce9691899574d026f9989646b7dbf3458acd6d27b3f5b097933a0
Jul 22 09:17:26.164575 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.164557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n"
Jul 22 09:17:26.168672 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.168644    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63287e77_8966_4a82_af46_abba71eeb638.slice/crio-22f37bbae623d7dd5485425d815c2e491de6fce2fbb41a6667a3914a790c945c WatchSource:0}: Error finding container 22f37bbae623d7dd5485425d815c2e491de6fce2fbb41a6667a3914a790c945c: Status 404 returned error can't find the container with id 22f37bbae623d7dd5485425d815c2e491de6fce2fbb41a6667a3914a790c945c
Jul 22 09:17:26.170807 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.170785    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r9lcb"
Jul 22 09:17:26.174736 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.174698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa79c72c_6097_47a2_82e1_46e3389b2da7.slice/crio-64171b97fbcdcb8af2b6616edf7ae7eb9847252af3bc5f7db3105e960690e1f7 WatchSource:0}: Error finding container 64171b97fbcdcb8af2b6616edf7ae7eb9847252af3bc5f7db3105e960690e1f7: Status 404 returned error can't find the container with id 64171b97fbcdcb8af2b6616edf7ae7eb9847252af3bc5f7db3105e960690e1f7
Jul 22 09:17:26.182165 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:26.182124    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5baa3969_cecc_4f8f_871e_ef5e57266635.slice/crio-e60d6356d9f7a7fbe936f19b3fbb429fc376e51118364098668eede4c8f74b6e WatchSource:0}: Error finding container e60d6356d9f7a7fbe936f19b3fbb429fc376e51118364098668eede4c8f74b6e: Status 404 returned error can't find the container with id e60d6356d9f7a7fbe936f19b3fbb429fc376e51118364098668eede4c8f74b6e
Jul 22 09:17:26.473257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.473175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:26.473257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.473227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.473267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473325    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473400    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:17:27.473379952 +0000 UTC m=+3.067372081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473406    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473424    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473439    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473451    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:26.473466 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473459    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:17:27.473443699 +0000 UTC m=+3.067435840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:26.473785 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:26.473512    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:27.473477652 +0000 UTC m=+3.067469776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:26.747099 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.747016    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 09:17:26.808896 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.808817    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 09:12:26 +0000 UTC" deadline="2028-01-22 17:43:13.129030808 +0000 UTC"
Jul 22 09:17:26.808896 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.808895    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13184h25m46.320140379s"
Jul 22 09:17:26.910345 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.910302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vsg8g" event={"ID":"a7e01367-743a-4de8-9f3c-49e4f8a19916","Type":"ContainerStarted","Data":"b24d17bf498f1127c96a90ed46d85b2b3e4ef6d0bfb83320d0a54a144fb1eefb"}
Jul 22 09:17:26.913578 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.913544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-grbwn" event={"ID":"d309f709-3d72-48d0-9e97-848503615420","Type":"ContainerStarted","Data":"e71cd030e24b0198c5d210142f3f055ec29b5453dde8e37a4d8d8b2106aaaa9f"}
Jul 22 09:17:26.915556 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.915524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r9lcb" event={"ID":"5baa3969-cecc-4f8f-871e-ef5e57266635","Type":"ContainerStarted","Data":"e60d6356d9f7a7fbe936f19b3fbb429fc376e51118364098668eede4c8f74b6e"}
Jul 22 09:17:26.917876 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.917846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n" event={"ID":"aa79c72c-6097-47a2-82e1-46e3389b2da7","Type":"ContainerStarted","Data":"64171b97fbcdcb8af2b6616edf7ae7eb9847252af3bc5f7db3105e960690e1f7"}
Jul 22 09:17:26.919795 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.919770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vghc5" event={"ID":"63287e77-8966-4a82-af46-abba71eeb638","Type":"ContainerStarted","Data":"22f37bbae623d7dd5485425d815c2e491de6fce2fbb41a6667a3914a790c945c"}
Jul 22 09:17:26.922078 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.922053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"64869ac66b6ce9691899574d026f9989646b7dbf3458acd6d27b3f5b097933a0"}
Jul 22 09:17:26.924185 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.924158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerStarted","Data":"fe69b98662babe96c7dc04bded1a2b9609ce79955b6da4ec1880405ac8cc4eea"}
Jul 22 09:17:26.927413 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.927389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-blq2l" event={"ID":"20234055-e427-40d8-bc99-afdc5d8e8d5e","Type":"ContainerStarted","Data":"d2f9e125413be33792c0a50cd359763cacbd2c343e71875a7c8e122e6943f794"}
Jul 22 09:17:26.929542 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:26.929517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xc9cj" event={"ID":"d45cc663-ff38-4f9c-b108-a4df2906f1f0","Type":"ContainerStarted","Data":"85851e71fa9f7f5ff9ae9cd253381cd2466bcddeebaa6a0fbd729de7eb27bed6"}
Jul 22 09:17:27.429630 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.429598    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 09:17:27.483755 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.483712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:27.483979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.483801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:27.483979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.483841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:27.484105 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484026    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:27.484161 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484123    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:17:29.484078157 +0000 UTC m=+5.078070298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:27.484256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484231    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:27.484256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484250    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:27.484366 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484263    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:27.484366 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484304    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:29.484291332 +0000 UTC m=+5.078283471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:27.484475 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484369    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:27.484475 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.484417    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:17:29.484405546 +0000 UTC m=+5.078397686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:27.810066 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.809894    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 09:12:26 +0000 UTC" deadline="2028-04-26 09:33:15.346505044 +0000 UTC"
Jul 22 09:17:27.810066 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.809937    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15456h15m47.536575023s"
Jul 22 09:17:27.903126 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.903090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:27.903290 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.903239    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:27.903355 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.903331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:27.903440 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.903415    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:27.903516 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:27.903497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:27.903609 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:27.903586    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:27.953872 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:17:27.953841    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9051b14160ff1bc1e70b7082345b9d33.slice/crio-601182be765deb73c550ba77f4a6e0f2137851c70ef4b0c613afb62c55d7c00a WatchSource:0}: Error finding container 601182be765deb73c550ba77f4a6e0f2137851c70ef4b0c613afb62c55d7c00a: Status 404 returned error can't find the container with id 601182be765deb73c550ba77f4a6e0f2137851c70ef4b0c613afb62c55d7c00a
Jul 22 09:17:28.940470 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:28.940375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal" event={"ID":"9051b14160ff1bc1e70b7082345b9d33","Type":"ContainerStarted","Data":"601182be765deb73c550ba77f4a6e0f2137851c70ef4b0c613afb62c55d7c00a"}
Jul 22 09:17:28.946728 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:28.946692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"7619b3ae7368cc99b40e4b39f377a201","Type":"ContainerStarted","Data":"4ff81c6b05d0c661a28e59400294d0c2cfaeafd624f03d5c8338a24ba7891925"}
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:29.502025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:29.502107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:29.502143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502301    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502368    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:17:33.502346084 +0000 UTC m=+9.096338217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502824    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502849    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502863    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502928    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:33.502896504 +0000 UTC m=+9.096888639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.502995    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:29.503496 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.503033    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:17:33.503020955 +0000 UTC m=+9.097013079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:29.902756 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:29.902631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:29.902955 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.902791    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:29.903268 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:29.903244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:29.903379 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.903349    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:29.903444 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:29.903404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:29.903517 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:29.903497    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:31.903651 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:31.903037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:31.903651 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:31.903173    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:31.903651 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:31.903362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:31.903651 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:31.903459    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:31.903651 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:31.903530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:31.903651 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:31.903618    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:31.959346 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:31.959305    2560 generic.go:356] "Generic (PLEG): container finished" podID="7619b3ae7368cc99b40e4b39f377a201" containerID="4ff81c6b05d0c661a28e59400294d0c2cfaeafd624f03d5c8338a24ba7891925" exitCode=0
Jul 22 09:17:31.959507 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:31.959357    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"7619b3ae7368cc99b40e4b39f377a201","Type":"ContainerDied","Data":"4ff81c6b05d0c661a28e59400294d0c2cfaeafd624f03d5c8338a24ba7891925"}
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:33.539393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:33.539447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:33.539493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539555    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539588    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539610    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:33.539616 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539627    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:33.540341 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539635    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:17:41.539611617 +0000 UTC m=+17.133603754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:33.540341 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539639    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:33.540341 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539656    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:17:41.539646017 +0000 UTC m=+17.133638143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:33.540341 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.539690    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:41.539675036 +0000 UTC m=+17.133667161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:33.903214 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:33.902664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:33.903214 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:33.902664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:33.903214 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.902795    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:33.903214 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:33.902864    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:33.903214 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.902967    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:33.903214 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:33.903059    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:35.902156 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:35.902117    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:35.902156 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:35.902153    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:35.902714 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:35.902117    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:35.902714 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:35.902247    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:35.902714 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:35.902306    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:35.902714 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:35.902386    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:37.902922 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:37.902887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:37.903384 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:37.902887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:37.903384 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:37.903035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:37.903384 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:37.903134    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:37.903384 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:37.902907    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:37.903384 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:37.903216    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:39.902156 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:39.902095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:39.902156 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:39.902134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:39.902654 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:39.902228    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:39.902654 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:39.902332    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:39.902654 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:39.902409    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:39.906173 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:39.902792    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:41.601757 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:41.601718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:41.601769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:41.601827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.601903    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.601953    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.601972    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:17:57.601956573 +0000 UTC m=+33.195948693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.601962    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.602016    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:17:57.60199714 +0000 UTC m=+33.195989276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.602025    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.602041    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:41.602256 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.602086    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:57.602075351 +0000 UTC m=+33.196067486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:41.902345 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:41.902308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:41.902523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:41.902310    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:41.902523 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.902434    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:41.902523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:41.902450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:41.902668 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.902528    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:41.902668 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:41.902614    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:43.902341 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:43.902301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:43.902756 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:43.902320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:43.902756 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:43.902454    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:43.902756 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:43.902320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:43.902756 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:43.902518    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:43.902756 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:43.902579    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:45.902335 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:45.902285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:45.902760 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:45.902335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:45.902760 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:45.902352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:45.902760 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:45.902479    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:45.902760 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:45.902570    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:45.902760 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:45.902673    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:46.991995 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.991781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"7619b3ae7368cc99b40e4b39f377a201","Type":"ContainerStarted","Data":"5eeae5d5c13673760831a4660388f616a56c5871b67bbae8fcc2e815606fdd72"}
Jul 22 09:17:46.993376 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.993344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vghc5" event={"ID":"63287e77-8966-4a82-af46-abba71eeb638","Type":"ContainerStarted","Data":"545276bcc345a15b02812e4c5963191662558ae22134473ce0b02cd10644433a"}
Jul 22 09:17:46.996345 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.996325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"86d4c3a5be32326bac7bcedf6295c298f488b24f85faf23d5736c514cd14474a"}
Jul 22 09:17:46.996433 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.996395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"de0a62ec64749580fc4864bf68b4e7d3e868e43e5bf31aa9f6e77797d729af6d"}
Jul 22 09:17:46.996509 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.996450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"7a43efe6342ed57c546a620b33e2f0294347a241a97bbc8a31eb239360abe316"}
Jul 22 09:17:46.996578 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.996512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"f44c89a4351e8c466a1201104cc4f3bb4035f4e06c221fedef4a939b92ef58b9"}
Jul 22 09:17:46.996578 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.996563    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"46af1e9a55b19b7c4dd3b26cafbeae563ddc3e1ea991e85dd174112487d13317"}
Jul 22 09:17:46.996662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.996596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"9fcbfc4d740521eaa9a12ce2ad05ef9440b71e473315b28b3eaf6d1215ff0be3"}
Jul 22 09:17:46.997903 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.997870    2560 generic.go:356] "Generic (PLEG): container finished" podID="7751ed5b-d899-4aad-8134-9c2b4f2799aa" containerID="627e18ed3b9a1b21d3e1196541b23ef14f9be255c7d41d430a413dede1e70e26" exitCode=0
Jul 22 09:17:46.998004 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.997950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerDied","Data":"627e18ed3b9a1b21d3e1196541b23ef14f9be255c7d41d430a413dede1e70e26"}
Jul 22 09:17:46.999474 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:46.999454    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xc9cj" event={"ID":"d45cc663-ff38-4f9c-b108-a4df2906f1f0","Type":"ContainerStarted","Data":"bf8a638a1af4ac1ef5bbdcb8b9e872f1491ffa75658eed0f987ac6cf9d9b71bf"}
Jul 22 09:17:47.000898 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.000874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vsg8g" event={"ID":"a7e01367-743a-4de8-9f3c-49e4f8a19916","Type":"ContainerStarted","Data":"76029dbe2470ba567a4d74b8b1f1d5f9b9dd6be54a38b60f4c2b95ceb853758b"}
Jul 22 09:17:47.002350 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.002332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-grbwn" event={"ID":"d309f709-3d72-48d0-9e97-848503615420","Type":"ContainerStarted","Data":"9b7dc8baa2e3a3236805a806b6b0b5303d8839b346385b224bd6b561b2c3ceb7"}
Jul 22 09:17:47.003755 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.003736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r9lcb" event={"ID":"5baa3969-cecc-4f8f-871e-ef5e57266635","Type":"ContainerStarted","Data":"bce86682746d07b2dfc643544564b65743f16505ebb2eaeed0d1c55393226b54"}
Jul 22 09:17:47.005100 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.005082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n" event={"ID":"aa79c72c-6097-47a2-82e1-46e3389b2da7","Type":"ContainerStarted","Data":"af00b100d83b48d7fdc95327416e9d3d69cdab41412831672b8248805820b17a"}
Jul 22 09:17:47.006317 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.006299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal" event={"ID":"9051b14160ff1bc1e70b7082345b9d33","Type":"ContainerStarted","Data":"62b78cd6688dd3f17a7be93cf1d1e59cf142ed0813571af992aaaf7f1365ff3d"}
Jul 22 09:17:47.052125 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.052074    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" podStartSLOduration=21.052059284 podStartE2EDuration="21.052059284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.018050222 +0000 UTC m=+22.612042366" watchObservedRunningTime="2026-07-22 09:17:47.052059284 +0000 UTC m=+22.646051426"
Jul 22 09:17:47.094342 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.094287    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vghc5" podStartSLOduration=2.150868057 podStartE2EDuration="22.094271111s" totalImagesPullingTime="19.943403054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.075200266 +0000 UTC m=+22.669192413" watchObservedRunningTime="2026-07-22 09:17:47.094271111 +0000 UTC m=+22.688263254"
Jul 22 09:17:47.114339 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.114289    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal" podStartSLOduration=21.114271123 podStartE2EDuration="21.114271123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.095047303 +0000 UTC m=+22.689039446" watchObservedRunningTime="2026-07-22 09:17:47.114271123 +0000 UTC m=+22.708263271"
Jul 22 09:17:47.138144 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.138096    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xc9cj" podStartSLOduration=2.171004573 podStartE2EDuration="22.138076519s" totalImagesPullingTime="19.967071946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.114422942 +0000 UTC m=+22.708415077" watchObservedRunningTime="2026-07-22 09:17:47.138076519 +0000 UTC m=+22.732068663"
Jul 22 09:17:47.138531 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.138509    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r9lcb" podStartSLOduration=2.202875222 podStartE2EDuration="22.138503822s" totalImagesPullingTime="19.9356286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.138207144 +0000 UTC m=+22.732199318" watchObservedRunningTime="2026-07-22 09:17:47.138503822 +0000 UTC m=+22.732495964"
Jul 22 09:17:47.172355 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.172308    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-grbwn" podStartSLOduration=2.149182608 podStartE2EDuration="22.172295515s" totalImagesPullingTime="20.023112907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.171758195 +0000 UTC m=+22.765750338" watchObservedRunningTime="2026-07-22 09:17:47.172295515 +0000 UTC m=+22.766287657"
Jul 22 09:17:47.608463 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.608426    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 09:17:47.818339 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.818189    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T09:17:47.6084434Z","UUID":"4bb3f6ea-38d7-47e5-9228-a679bc37a091","Handler":null,"Name":"","Endpoint":""}
Jul 22 09:17:47.819849 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.819809    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 09:17:47.819986 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.819859    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 09:17:47.902442 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.902414    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:47.902715 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.902524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:47.902715 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:47.902538    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:47.902715 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:47.902558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:47.902715 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:47.902646    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:47.902908 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:47.902719    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:48.010784 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:48.010747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-blq2l" event={"ID":"20234055-e427-40d8-bc99-afdc5d8e8d5e","Type":"ContainerStarted","Data":"ad6ceaa053de96b31f0324ad07dec6e298ee548d2a9bbe1ae65ab5121d46b957"}
Jul 22 09:17:48.013050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:48.012992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n" event={"ID":"aa79c72c-6097-47a2-82e1-46e3389b2da7","Type":"ContainerStarted","Data":"77a3be126da575ce29a673921f97375c84d9e28e8b518ebee7daad2f424e61ba"}
Jul 22 09:17:48.033145 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:48.032706    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vsg8g" podStartSLOduration=3.03975591 podStartE2EDuration="23.032688475s" totalImagesPullingTime="19.992932565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:47.191944379 +0000 UTC m=+22.785936521" watchObservedRunningTime="2026-07-22 09:17:48.032688475 +0000 UTC m=+23.626680620"
Jul 22 09:17:49.017531 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.017494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n" event={"ID":"aa79c72c-6097-47a2-82e1-46e3389b2da7","Type":"ContainerStarted","Data":"c4bab17e7de996a1e0e7a4948b54050bec485f2404cba3c6df7adc7b601c9ab1"}
Jul 22 09:17:49.021161 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.021125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"afec9d0cc4ee79767547c2a30ebb6f09ca299eccd0ab700450258ab567e67881"}
Jul 22 09:17:49.044475 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.044402    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-blq2l" podStartSLOduration=4.078233947 podStartE2EDuration="24.044380845s" totalImagesPullingTime="19.966146898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:48.032792296 +0000 UTC m=+23.626784440" watchObservedRunningTime="2026-07-22 09:17:49.044380845 +0000 UTC m=+24.638372988"
Jul 22 09:17:49.379271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.379069    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:49.379658 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.379639    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:49.400927 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.400882    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4565n" podStartSLOduration=2.3441720090000002 podStartE2EDuration="24.400863361s" totalImagesPullingTime="22.056691352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:49.044692277 +0000 UTC m=+24.638684448" watchObservedRunningTime="2026-07-22 09:17:49.400863361 +0000 UTC m=+24.994855506"
Jul 22 09:17:49.902683 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.902650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:49.902922 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.902689    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:49.902922 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:49.902689    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:49.902922 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:49.902775    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:49.902922 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:49.902871    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:49.903074 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:49.902919    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:51.369572 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:51.369431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:51.370208 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:51.369663    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 09:17:51.370208 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:51.370158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vghc5"
Jul 22 09:17:51.902998 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:51.902966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:51.902998 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:51.902993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:51.903191 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:51.903079    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:51.903191 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:51.903099    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:51.903259 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:51.903190    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:51.903289 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:51.903252    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:52.031622 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.031589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" event={"ID":"8b22ff41-59d2-42fc-b58c-5fcee1180df1","Type":"ContainerStarted","Data":"b9a79577748e43369d1398c4d2a0cf200164ccf96ef722aa1898d80103de85b3"}
Jul 22 09:17:52.031997 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.031966    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:52.032119 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.032066    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:52.033295 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.033277    2560 generic.go:356] "Generic (PLEG): container finished" podID="7751ed5b-d899-4aad-8134-9c2b4f2799aa" containerID="07d7b1b1897b794cf4fb29f34750967fd4eb77ab82b30249b31ba65d69b1aba3" exitCode=0
Jul 22 09:17:52.033392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.033354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerDied","Data":"07d7b1b1897b794cf4fb29f34750967fd4eb77ab82b30249b31ba65d69b1aba3"}
Jul 22 09:17:52.047019 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.046979    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:52.073405 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:52.073363    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm" podStartSLOduration=7.119685729 podStartE2EDuration="27.07334595s" totalImagesPullingTime="19.953660221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:17:52.072617912 +0000 UTC m=+27.666610055" watchObservedRunningTime="2026-07-22 09:17:52.07334595 +0000 UTC m=+27.667338093"
Jul 22 09:17:53.035692 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.035664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:53.050518 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.050495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:17:53.849301 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.849272    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cg4gs"]
Jul 22 09:17:53.849484 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.849394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:53.849550 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:53.849498    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:53.853634 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.853612    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l26m8"]
Jul 22 09:17:53.853748 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.853698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:53.853787 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:53.853771    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:53.856620 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.856588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4p5ct"]
Jul 22 09:17:53.856706 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:53.856666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:53.856750 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:53.856725    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:54.039026 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:54.038994    2560 generic.go:356] "Generic (PLEG): container finished" podID="7751ed5b-d899-4aad-8134-9c2b4f2799aa" containerID="59e7b54e7eeccb8841412cad1a42ed32454db5e4541927e73276aea8f17b7d11" exitCode=0
Jul 22 09:17:54.039397 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:54.039048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerDied","Data":"59e7b54e7eeccb8841412cad1a42ed32454db5e4541927e73276aea8f17b7d11"}
Jul 22 09:17:55.902905 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:55.902681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:55.903495 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:55.902679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:55.903495 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:55.902993    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:55.903495 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:55.903084    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:55.903495 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:55.902713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:55.903495 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:55.903189    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:56.045775 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:56.045694    2560 generic.go:356] "Generic (PLEG): container finished" podID="7751ed5b-d899-4aad-8134-9c2b4f2799aa" containerID="91d851a023a41d9dbdd91741d483176c1ac2cf3ebc692fea24150274477a1376" exitCode=0
Jul 22 09:17:56.045775 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:56.045737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerDied","Data":"91d851a023a41d9dbdd91741d483176c1ac2cf3ebc692fea24150274477a1376"}
Jul 22 09:17:57.623754 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:57.623710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:57.623775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:57.623806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.623923    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.623943    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.623950    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.623969    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2pjsv for pod openshift-network-diagnostics/network-check-target-cg4gs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.624005    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:29.623986334 +0000 UTC m=+65.217978455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.624024    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv podName:9c5c9e11-3320-4731-9293-0014a4b88fa5 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:29.624014688 +0000 UTC m=+65.218006812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pjsv" (UniqueName: "kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv") pod "network-check-target-cg4gs" (UID: "9c5c9e11-3320-4731-9293-0014a4b88fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.623943    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:57.624361 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.624059    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret podName:650050ff-f9f6-4c60-a177-dab5d00e8a3b nodeName:}" failed. No retries permitted until 2026-07-22 09:18:29.624049877 +0000 UTC m=+65.218042002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret") pod "global-pull-secret-syncer-4p5ct" (UID: "650050ff-f9f6-4c60-a177-dab5d00e8a3b") : object "kube-system"/"original-pull-secret" not registered
Jul 22 09:17:57.902630 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:57.902551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:57.902773 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:57.902551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:57.902773 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.902663    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg4gs" podUID="9c5c9e11-3320-4731-9293-0014a4b88fa5"
Jul 22 09:17:57.902773 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:57.902563    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:57.902773 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.902739    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l26m8" podUID="a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e"
Jul 22 09:17:57.902993 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:57.902817    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4p5ct" podUID="650050ff-f9f6-4c60-a177-dab5d00e8a3b"
Jul 22 09:17:59.194647 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.194620    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeReady"
Jul 22 09:17:59.195085 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.194769    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 09:17:59.234279 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.234193    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-658f897b77-7974t"]
Jul 22 09:17:59.236777 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.236742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.239214 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.239192    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 09:17:59.239340 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.239283    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 09:17:59.239492 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.239470    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 09:17:59.240498 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.240476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dm8hb\""
Jul 22 09:17:59.245215 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.245192    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 09:17:59.250338 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.249025    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wdgvk"]
Jul 22 09:17:59.253003 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.252984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-658f897b77-7974t"]
Jul 22 09:17:59.253107 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.253089    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.253249 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.253227    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tq7b9"]
Jul 22 09:17:59.255228 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.255203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.255499 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.255470    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 09:17:59.255720 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.255701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 09:17:59.255903 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.255720    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2clq\""
Jul 22 09:17:59.257378 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.257360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 09:17:59.257509 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.257488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 09:17:59.257753 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.257735    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 09:17:59.257815 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.257791    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v4ns8\""
Jul 22 09:17:59.261311 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.261290    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdgvk"]
Jul 22 09:17:59.274798 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.274774    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tq7b9"]
Jul 22 09:17:59.335947 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.335917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-certificates\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.335947 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.335951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-trusted-ca\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.336189 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.335981    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/830f93ed-4dd1-446c-b1ac-84ae1a922645-cert\") pod \"ingress-canary-tq7b9\" (UID: \"830f93ed-4dd1-446c-b1ac-84ae1a922645\") " pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.336189 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-ca-trust-extracted\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.336189 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxw5l\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-kube-api-access-dxw5l\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.336189 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5t4f\" (UniqueName: \"kubernetes.io/projected/830f93ed-4dd1-446c-b1ac-84ae1a922645-kube-api-access-f5t4f\") pod \"ingress-canary-tq7b9\" (UID: \"830f93ed-4dd1-446c-b1ac-84ae1a922645\") " pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.336392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-image-registry-private-configuration\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.336392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.336392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-config-volume\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.336392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-tmp-dir\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.336392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-bound-sa-token\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.336594 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.336594 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4c4h\" (UniqueName: \"kubernetes.io/projected/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-kube-api-access-x4c4h\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.336594 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.336536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-installation-pull-secrets\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437495 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-certificates\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437495 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-trusted-ca\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437722 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/830f93ed-4dd1-446c-b1ac-84ae1a922645-cert\") pod \"ingress-canary-tq7b9\" (UID: \"830f93ed-4dd1-446c-b1ac-84ae1a922645\") " pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.437722 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-ca-trust-extracted\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437722 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxw5l\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-kube-api-access-dxw5l\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5t4f\" (UniqueName: \"kubernetes.io/projected/830f93ed-4dd1-446c-b1ac-84ae1a922645-kube-api-access-f5t4f\") pod \"ingress-canary-tq7b9\" (UID: \"830f93ed-4dd1-446c-b1ac-84ae1a922645\") " pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.437899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-image-registry-private-configuration\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.437899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-config-volume\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.437899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-tmp-dir\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.437899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-bound-sa-token\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.438138 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.438138 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.437979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4c4h\" (UniqueName: \"kubernetes.io/projected/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-kube-api-access-x4c4h\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.438138 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.438075    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:17:59.438138 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.438075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-ca-trust-extracted\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.438138 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.438090    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:17:59.438138 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.438138    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:17:59.938122241 +0000 UTC m=+35.532114378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:17:59.438475 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.438292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-certificates\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.438475 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.438338    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:17:59.438475 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.438360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-installation-pull-secrets\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.438475 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.438405    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:17:59.938387797 +0000 UTC m=+35.532379919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:17:59.438637 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.438499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-trusted-ca\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.438684 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.438649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-config-volume\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.438684 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.438654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-tmp-dir\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.442729 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.442704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-installation-pull-secrets\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.442866 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.442729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/830f93ed-4dd1-446c-b1ac-84ae1a922645-cert\") pod \"ingress-canary-tq7b9\" (UID: \"830f93ed-4dd1-446c-b1ac-84ae1a922645\") " pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.442866 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.442704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-image-registry-private-configuration\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.447063 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.447007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4c4h\" (UniqueName: \"kubernetes.io/projected/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-kube-api-access-x4c4h\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.447173 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.447111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-bound-sa-token\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.447449 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.447433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxw5l\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-kube-api-access-dxw5l\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.447663 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.447643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5t4f\" (UniqueName: \"kubernetes.io/projected/830f93ed-4dd1-446c-b1ac-84ae1a922645-kube-api-access-f5t4f\") pod \"ingress-canary-tq7b9\" (UID: \"830f93ed-4dd1-446c-b1ac-84ae1a922645\") " pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.570895 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.570860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tq7b9"
Jul 22 09:17:59.903187 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.903149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:17:59.903376 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.903259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:17:59.903439 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.903414    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:17:59.906134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.906108    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 09:17:59.906263 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.906138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6sgn5\""
Jul 22 09:17:59.906263 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.906140    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 09:17:59.907117 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.907100    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 09:17:59.907245 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.907165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 09:17:59.907313 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.907296    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8b4k6\""
Jul 22 09:17:59.943688 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.943654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:17:59.943804 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:17:59.943714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:17:59.943887 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.943822    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:17:59.943938 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.943897    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:18:00.943882085 +0000 UTC m=+36.537874210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:17:59.943938 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.943821    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:17:59.943938 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.943923    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:17:59.944066 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:17:59.943955    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:00.94394452 +0000 UTC m=+36.537936642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:18:00.098445 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:00.098293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tq7b9"]
Jul 22 09:18:00.101651 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:00.101624    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830f93ed_4dd1_446c_b1ac_84ae1a922645.slice/crio-a93b50613d7e24aef58c5a87556af3ca1b687f0323419f4b270efccaffc20485 WatchSource:0}: Error finding container a93b50613d7e24aef58c5a87556af3ca1b687f0323419f4b270efccaffc20485: Status 404 returned error can't find the container with id a93b50613d7e24aef58c5a87556af3ca1b687f0323419f4b270efccaffc20485
Jul 22 09:18:00.953010 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:00.952951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:18:00.953713 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:00.953027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:18:00.953713 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:00.953105    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:18:00.953713 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:00.953123    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:18:00.953713 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:00.953163    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:18:00.953713 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:00.953176    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:02.953161512 +0000 UTC m=+38.547153633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:18:00.953713 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:00.953210    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:18:02.953197852 +0000 UTC m=+38.547189978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:18:01.060921 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:01.060881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tq7b9" event={"ID":"830f93ed-4dd1-446c-b1ac-84ae1a922645","Type":"ContainerStarted","Data":"a93b50613d7e24aef58c5a87556af3ca1b687f0323419f4b270efccaffc20485"}
Jul 22 09:18:01.064142 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:01.064114    2560 generic.go:356] "Generic (PLEG): container finished" podID="7751ed5b-d899-4aad-8134-9c2b4f2799aa" containerID="8622016c4544f545b8a2292b871403b71c8874110ab1ec66a3f4505c5206a51b" exitCode=0
Jul 22 09:18:01.064280 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:01.064163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerDied","Data":"8622016c4544f545b8a2292b871403b71c8874110ab1ec66a3f4505c5206a51b"}
Jul 22 09:18:02.069777 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:02.069737    2560 generic.go:356] "Generic (PLEG): container finished" podID="7751ed5b-d899-4aad-8134-9c2b4f2799aa" containerID="cd590ce10fea1176fd8c3f264309af70d24bc0e006bcf70e524828790dc91f6b" exitCode=0
Jul 22 09:18:02.070265 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:02.069788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerDied","Data":"cd590ce10fea1176fd8c3f264309af70d24bc0e006bcf70e524828790dc91f6b"}
Jul 22 09:18:02.969914 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:02.969669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:18:02.969914 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:02.969888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:18:02.970127 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:02.969821    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:18:02.970127 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:02.969951    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:18:02.970127 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:02.970016    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:06.969995232 +0000 UTC m=+42.563987370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:18:02.970127 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:02.970016    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:18:02.970127 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:02.970056    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:18:06.970045884 +0000 UTC m=+42.564038028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:18:03.074848 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.074804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hj96" event={"ID":"7751ed5b-d899-4aad-8134-9c2b4f2799aa","Type":"ContainerStarted","Data":"bfa636b496ae818817a54689859136cc781ecc266236a0ae03393ca939e86f66"}
Jul 22 09:18:03.125447 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.122805    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4hj96" podStartSLOduration=7.792324756 podStartE2EDuration="38.122783353s" totalImagesPullingTime="30.330458597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:03.120731262 +0000 UTC m=+38.714723450" watchObservedRunningTime="2026-07-22 09:18:03.122783353 +0000 UTC m=+38.716775498"
Jul 22 09:18:03.238399 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.238317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:03.340032 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.339990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:03.405879 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.405829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:03.490296 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.490204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:03.545760 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.545728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:03.689826 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.689789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:03.790198 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:03.790123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log" limit=1024
Jul 22 09:18:04.078497 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:04.078403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tq7b9" event={"ID":"830f93ed-4dd1-446c-b1ac-84ae1a922645","Type":"ContainerStarted","Data":"1f58aaf4f9f0438aea20c4682a0bc2baa470f2ffa8729dddc71d3b87058e5a50"}
Jul 22 09:18:04.096755 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:04.096704    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tq7b9" podStartSLOduration=2.12861139 podStartE2EDuration="5.096688142s" totalImagesPullingTime="2.968076752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:04.095272307 +0000 UTC m=+39.689264442" watchObservedRunningTime="2026-07-22 09:18:04.096688142 +0000 UTC m=+39.690680284"
Jul 22 09:18:06.995329 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:06.995290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:18:06.995704 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:06.995338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:18:06.995704 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:06.995442    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:18:06.995704 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:06.995462    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:18:06.995704 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:06.995471    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:18:06.995704 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:06.995515    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:14.995501351 +0000 UTC m=+50.589493475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:18:06.995704 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:06.995529    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:18:14.995523502 +0000 UTC m=+50.589515623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:18:15.050030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:15.050000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:18:15.050463 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:15.050043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:18:15.050463 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:15.050151    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:18:15.050463 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:15.050159    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:18:15.050463 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:15.050175    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:18:15.050463 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:15.050208    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:18:31.050196536 +0000 UTC m=+66.644188657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:18:15.050463 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:15.050221    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:31.050215337 +0000 UTC m=+66.644207457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:18:17.907468 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.907437    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"]
Jul 22 09:18:17.927547 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.927513    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"]
Jul 22 09:18:17.928308 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.928274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"
Jul 22 09:18:17.930975 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.930953    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:18:17.931062 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.930963    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 22 09:18:17.931855 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.931824    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-brtqf\""
Jul 22 09:18:17.946430 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.946406    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"]
Jul 22 09:18:17.946507 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.946435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"]
Jul 22 09:18:17.946507 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.946491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:17.949030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.949012    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 09:18:17.949137 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.949034    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 09:18:17.949137 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.949064    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7z9rl\""
Jul 22 09:18:17.949508 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.949492    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:18:17.949626 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:17.949611    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.007387 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.007363    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"]
Jul 22 09:18:18.024419 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.024400    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"]
Jul 22 09:18:18.024529 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.024514    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"
Jul 22 09:18:18.026937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.026909    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lvtp7\""
Jul 22 09:18:18.036425 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.036407    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-cc969ffc4-l8wp8"]
Jul 22 09:18:18.036590 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.036561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.039070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.039046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.039171 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.039046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:18:18.039171 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.039095    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 09:18:18.039171 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.039114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 09:18:18.039331 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.039293    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6rrjs\""
Jul 22 09:18:18.058512 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.058491    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7r88r"]
Jul 22 09:18:18.058598 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.058585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.060867 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.060826    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 09:18:18.060985 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.060829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 09:18:18.061076 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.060858    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 09:18:18.061076 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.060993    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rqhm6\""
Jul 22 09:18:18.061076 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.060984    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 09:18:18.061224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.061102    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 09:18:18.061260 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.061246    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.066428 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.066411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb6ec58-b55e-44fc-b256-101d8421f3ae-serving-cert\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.066510 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.066436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmm2\" (UniqueName: \"kubernetes.io/projected/3eb6ec58-b55e-44fc-b256-101d8421f3ae-kube-api-access-ljmm2\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.066510 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.066460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3eb6ec58-b55e-44fc-b256-101d8421f3ae-config\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.066510 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.066506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxmp\" (UniqueName: \"kubernetes.io/projected/1409545b-1e29-4fe4-876c-3ac155805d90-kube-api-access-2kxmp\") pod \"volume-data-source-validator-78cf4c6f6-5c4mv\" (UID: \"1409545b-1e29-4fe4-876c-3ac155805d90\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"
Jul 22 09:18:18.082450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.082429    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"]
Jul 22 09:18:18.082554 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.082541    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.085661 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.085631    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 09:18:18.085750 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.085708    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 09:18:18.085750 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.085740    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.086214 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.086197    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qb82f\""
Jul 22 09:18:18.086317 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.086230    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 09:18:18.092263 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.092237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 09:18:18.104559 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.104542    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"]
Jul 22 09:18:18.104664 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.104568    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"]
Jul 22 09:18:18.104664 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.104586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"]
Jul 22 09:18:18.104664 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.104604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7r88r"]
Jul 22 09:18:18.104801 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.104671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.104801 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.104705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cc969ffc4-l8wp8"]
Jul 22 09:18:18.107339 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.107322    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 09:18:18.107402 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.107338    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rbdqz\""
Jul 22 09:18:18.108585 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.108566    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 22 09:18:18.108680 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.108609    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 22 09:18:18.108680 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.108622    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.113323 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.113307    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"]
Jul 22 09:18:18.136838 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.136821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.141002 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.140984    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 22 09:18:18.141625 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.141607    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.141910 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.141894    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:18:18.142118 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.142094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8jwp\""
Jul 22 09:18:18.145992 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.145975    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"]
Jul 22 09:18:18.146673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.146657    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6xp9p"]
Jul 22 09:18:18.160746 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.160702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.164470 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.164433    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 09:18:18.164470 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.164453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 09:18:18.165429 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.165411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 09:18:18.166854 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.166822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmm2\" (UniqueName: \"kubernetes.io/projected/3eb6ec58-b55e-44fc-b256-101d8421f3ae-kube-api-access-ljmm2\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.166949 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.166866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3eb6ec58-b55e-44fc-b256-101d8421f3ae-config\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.166949 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.166894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-stats-auth\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.166949 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.166910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxmp\" (UniqueName: \"kubernetes.io/projected/1409545b-1e29-4fe4-876c-3ac155805d90-kube-api-access-2kxmp\") pod \"volume-data-source-validator-78cf4c6f6-5c4mv\" (UID: \"1409545b-1e29-4fe4-876c-3ac155805d90\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"
Jul 22 09:18:18.167104 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.166954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-default-certificate\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.167104 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.167206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50b861eb-db72-43e2-a1d0-fe4f858dafa3-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.167206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50b861eb-db72-43e2-a1d0-fe4f858dafa3-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.167206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vvg\" (UniqueName: \"kubernetes.io/projected/3690fa03-ab95-4dcf-834f-8ae4ff56531a-kube-api-access-b7vvg\") pod \"network-check-source-7bc5b6bf85-c6vsv\" (UID: \"3690fa03-ab95-4dcf-834f-8ae4ff56531a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"
Jul 22 09:18:18.167347 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb6ec58-b55e-44fc-b256-101d8421f3ae-serving-cert\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.167347 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.167491 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh92r\" (UniqueName: \"kubernetes.io/projected/50b861eb-db72-43e2-a1d0-fe4f858dafa3-kube-api-access-lh92r\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.167491 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3eb6ec58-b55e-44fc-b256-101d8421f3ae-config\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.167491 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.167397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx8c7\" (UniqueName: \"kubernetes.io/projected/fe1d7805-b978-45fc-b2b0-b43c5477ff14-kube-api-access-qx8c7\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.170651 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.170632    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 09:18:18.170749 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.170682    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k2fls\""
Jul 22 09:18:18.171672 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.171646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb6ec58-b55e-44fc-b256-101d8421f3ae-serving-cert\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.172937 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.172922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 09:18:18.183331 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.183313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6xp9p"]
Jul 22 09:18:18.185363 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.185339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmm2\" (UniqueName: \"kubernetes.io/projected/3eb6ec58-b55e-44fc-b256-101d8421f3ae-kube-api-access-ljmm2\") pod \"service-ca-operator-5bcbc94c78-zw5hn\" (UID: \"3eb6ec58-b55e-44fc-b256-101d8421f3ae\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.185702 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.185685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxmp\" (UniqueName: \"kubernetes.io/projected/1409545b-1e29-4fe4-876c-3ac155805d90-kube-api-access-2kxmp\") pod \"volume-data-source-validator-78cf4c6f6-5c4mv\" (UID: \"1409545b-1e29-4fe4-876c-3ac155805d90\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"
Jul 22 09:18:18.237608 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.237583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"
Jul 22 09:18:18.254724 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.254703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"
Jul 22 09:18:18.268693 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.268799 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f46ab7c-43a8-4e94-a860-198824b5873c-serving-cert\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.268799 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh92r\" (UniqueName: \"kubernetes.io/projected/50b861eb-db72-43e2-a1d0-fe4f858dafa3-kube-api-access-lh92r\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.268799 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-tmp\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.268987 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx8c7\" (UniqueName: \"kubernetes.io/projected/fe1d7805-b978-45fc-b2b0-b43c5477ff14-kube-api-access-qx8c7\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.268987 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.268987 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xchk\" (UniqueName: \"kubernetes.io/projected/5f46ab7c-43a8-4e94-a860-198824b5873c-kube-api-access-4xchk\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.269130 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.268999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-stats-auth\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.269130 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.269023    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:18.76900202 +0000 UTC m=+54.362994145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : configmap references non-existent config key: service-ca.crt
Jul 22 09:18:18.269130 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f46ab7c-43a8-4e94-a860-198824b5873c-trusted-ca\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.269130 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq6ph\" (UniqueName: \"kubernetes.io/projected/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-kube-api-access-vq6ph\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e40312be-71ff-4b92-924f-b09c0cf425b7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f46ab7c-43a8-4e94-a860-198824b5873c-config\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxhn\" (UniqueName: \"kubernetes.io/projected/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-kube-api-access-pzxhn\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zkg\" (UniqueName: \"kubernetes.io/projected/e40312be-71ff-4b92-924f-b09c0cf425b7-kube-api-access-b2zkg\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-default-certificate\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.269326 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.269396    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-service-ca-bundle\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.269436    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:18.769425217 +0000 UTC m=+54.363417341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : secret "router-metrics-certs-default" not found
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50b861eb-db72-43e2-a1d0-fe4f858dafa3-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-serving-cert\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50b861eb-db72-43e2-a1d0-fe4f858dafa3-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vvg\" (UniqueName: \"kubernetes.io/projected/3690fa03-ab95-4dcf-834f-8ae4ff56531a-kube-api-access-b7vvg\") pod \"network-check-source-7bc5b6bf85-c6vsv\" (UID: \"3690fa03-ab95-4dcf-834f-8ae4ff56531a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"
Jul 22 09:18:18.269673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.269559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-snapshots\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.270192 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.270147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50b861eb-db72-43e2-a1d0-fe4f858dafa3-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.271943 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.271920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50b861eb-db72-43e2-a1d0-fe4f858dafa3-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.272060 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.272039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-stats-auth\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.272132 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.272117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-default-certificate\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.279508 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.279488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx8c7\" (UniqueName: \"kubernetes.io/projected/fe1d7805-b978-45fc-b2b0-b43c5477ff14-kube-api-access-qx8c7\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.279746 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.279729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh92r\" (UniqueName: \"kubernetes.io/projected/50b861eb-db72-43e2-a1d0-fe4f858dafa3-kube-api-access-lh92r\") pod \"kube-storage-version-migrator-operator-7658d9b749-7rd74\" (UID: \"50b861eb-db72-43e2-a1d0-fe4f858dafa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.279932 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.279913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vvg\" (UniqueName: \"kubernetes.io/projected/3690fa03-ab95-4dcf-834f-8ae4ff56531a-kube-api-access-b7vvg\") pod \"network-check-source-7bc5b6bf85-c6vsv\" (UID: \"3690fa03-ab95-4dcf-834f-8ae4ff56531a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"
Jul 22 09:18:18.333358 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.333206    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"
Jul 22 09:18:18.345149 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.345122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.370472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f46ab7c-43a8-4e94-a860-198824b5873c-serving-cert\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.370537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-tmp\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.370982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-tmp\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xchk\" (UniqueName: \"kubernetes.io/projected/5f46ab7c-43a8-4e94-a860-198824b5873c-kube-api-access-4xchk\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f46ab7c-43a8-4e94-a860-198824b5873c-trusted-ca\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq6ph\" (UniqueName: \"kubernetes.io/projected/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-kube-api-access-vq6ph\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.371271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e40312be-71ff-4b92-924f-b09c0cf425b7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f46ab7c-43a8-4e94-a860-198824b5873c-config\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxhn\" (UniqueName: \"kubernetes.io/projected/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-kube-api-access-pzxhn\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zkg\" (UniqueName: \"kubernetes.io/projected/e40312be-71ff-4b92-924f-b09c0cf425b7-kube-api-access-b2zkg\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.371510    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.371561    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls podName:e40312be-71ff-4b92-924f-b09c0cf425b7 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:18.871544641 +0000 UTC m=+54.465536766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hvkd6" (UID: "e40312be-71ff-4b92-924f-b09c0cf425b7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-service-ca-bundle\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.371718    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.371763    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls podName:6a7b2b8e-6148-4e36-97e2-30719d0eb8ea nodeName:}" failed. No retries permitted until 2026-07-22 09:18:18.871749195 +0000 UTC m=+54.465741332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqqtz" (UID: "6a7b2b8e-6148-4e36-97e2-30719d0eb8ea") : secret "samples-operator-tls" not found
Jul 22 09:18:18.371783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-serving-cert\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.372351 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.371813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-snapshots\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.372351 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.372158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f46ab7c-43a8-4e94-a860-198824b5873c-config\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.372473 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.372378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-service-ca-bundle\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.372473 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.372455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-snapshots\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.372733 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.372707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f46ab7c-43a8-4e94-a860-198824b5873c-trusted-ca\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.373004 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.372824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.373004 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.372864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e40312be-71ff-4b92-924f-b09c0cf425b7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.373675 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.373654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f46ab7c-43a8-4e94-a860-198824b5873c-serving-cert\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.374632 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.374609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-serving-cert\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.382977 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.382954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zkg\" (UniqueName: \"kubernetes.io/projected/e40312be-71ff-4b92-924f-b09c0cf425b7-kube-api-access-b2zkg\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.383803 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.383777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq6ph\" (UniqueName: \"kubernetes.io/projected/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-kube-api-access-vq6ph\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.384077 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.384055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xchk\" (UniqueName: \"kubernetes.io/projected/5f46ab7c-43a8-4e94-a860-198824b5873c-kube-api-access-4xchk\") pod \"console-operator-565b7b569d-6xp9p\" (UID: \"5f46ab7c-43a8-4e94-a860-198824b5873c\") " pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.384470 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.384440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxhn\" (UniqueName: \"kubernetes.io/projected/6ad6bdb6-50e4-441a-aa6f-164b1a9a9288-kube-api-access-pzxhn\") pod \"insights-operator-555d9d7885-7r88r\" (UID: \"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288\") " pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.388957 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:18.388822    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1409545b_1e29_4fe4_876c_3ac155805d90.slice/crio-54e28bf3c936bd681e1e936be1704343e56a4f997123ae2cf30078c4da527bc1 WatchSource:0}: Error finding container 54e28bf3c936bd681e1e936be1704343e56a4f997123ae2cf30078c4da527bc1: Status 404 returned error can't find the container with id 54e28bf3c936bd681e1e936be1704343e56a4f997123ae2cf30078c4da527bc1
Jul 22 09:18:18.390144 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.390126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv"]
Jul 22 09:18:18.390955 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.390936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-7r88r"
Jul 22 09:18:18.405159 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.405137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn"]
Jul 22 09:18:18.407459 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:18.407401    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb6ec58_b55e_44fc_b256_101d8421f3ae.slice/crio-5e1699613c85d26b820da2256837768610f16ef0465a053257f7f374b859a3e0 WatchSource:0}: Error finding container 5e1699613c85d26b820da2256837768610f16ef0465a053257f7f374b859a3e0: Status 404 returned error can't find the container with id 5e1699613c85d26b820da2256837768610f16ef0465a053257f7f374b859a3e0
Jul 22 09:18:18.469195 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.469125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:18.515733 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.515699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv"]
Jul 22 09:18:18.519624 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:18.519582    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3690fa03_ab95_4dcf_834f_8ae4ff56531a.slice/crio-6cb72a7e1d4f8f285e0db265715dfd601bad45fa5e1983d423b34a8db17e2ae7 WatchSource:0}: Error finding container 6cb72a7e1d4f8f285e0db265715dfd601bad45fa5e1983d423b34a8db17e2ae7: Status 404 returned error can't find the container with id 6cb72a7e1d4f8f285e0db265715dfd601bad45fa5e1983d423b34a8db17e2ae7
Jul 22 09:18:18.547271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.547240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74"]
Jul 22 09:18:18.551023 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:18.550971    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b861eb_db72_43e2_a1d0_fe4f858dafa3.slice/crio-fba3dfabf71be9c86188bb3f24917aa846e13acded878b422fb3c15ca7fcea74 WatchSource:0}: Error finding container fba3dfabf71be9c86188bb3f24917aa846e13acded878b422fb3c15ca7fcea74: Status 404 returned error can't find the container with id fba3dfabf71be9c86188bb3f24917aa846e13acded878b422fb3c15ca7fcea74
Jul 22 09:18:18.585442 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.585412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7r88r"]
Jul 22 09:18:18.588413 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:18.588386    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad6bdb6_50e4_441a_aa6f_164b1a9a9288.slice/crio-f78bde296d8dcc649ac59c36f5fb3bc34ca07bee2f30d8cd2b05a43edc282388 WatchSource:0}: Error finding container f78bde296d8dcc649ac59c36f5fb3bc34ca07bee2f30d8cd2b05a43edc282388: Status 404 returned error can't find the container with id f78bde296d8dcc649ac59c36f5fb3bc34ca07bee2f30d8cd2b05a43edc282388
Jul 22 09:18:18.628514 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.628487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6xp9p"]
Jul 22 09:18:18.631373 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:18.631348    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f46ab7c_43a8_4e94_a860_198824b5873c.slice/crio-3bca7c89b76cf196974be020ac719d8c54c62dd893652262adb8b16b01a581b1 WatchSource:0}: Error finding container 3bca7c89b76cf196974be020ac719d8c54c62dd893652262adb8b16b01a581b1: Status 404 returned error can't find the container with id 3bca7c89b76cf196974be020ac719d8c54c62dd893652262adb8b16b01a581b1
Jul 22 09:18:18.776017 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.775934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.776017 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.776000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:18.776188 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.776086    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 09:18:18.776188 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.776134    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:19.776120683 +0000 UTC m=+55.370112804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : configmap references non-existent config key: service-ca.crt
Jul 22 09:18:18.776188 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.776148    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:19.776142577 +0000 UTC m=+55.370134697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : secret "router-metrics-certs-default" not found
Jul 22 09:18:18.876751 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.876719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:18.876958 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:18.876761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:18.876958 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.876909    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:18.876958 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.876945    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 09:18:18.877139 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.876993    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls podName:e40312be-71ff-4b92-924f-b09c0cf425b7 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:19.876969635 +0000 UTC m=+55.470961776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hvkd6" (UID: "e40312be-71ff-4b92-924f-b09c0cf425b7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:18.877139 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:18.877015    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls podName:6a7b2b8e-6148-4e36-97e2-30719d0eb8ea nodeName:}" failed. No retries permitted until 2026-07-22 09:18:19.877004339 +0000 UTC m=+55.470996465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqqtz" (UID: "6a7b2b8e-6148-4e36-97e2-30719d0eb8ea") : secret "samples-operator-tls" not found
Jul 22 09:18:19.115894 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.115804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" event={"ID":"5f46ab7c-43a8-4e94-a860-198824b5873c","Type":"ContainerStarted","Data":"3bca7c89b76cf196974be020ac719d8c54c62dd893652262adb8b16b01a581b1"}
Jul 22 09:18:19.117237 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.117200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv" event={"ID":"1409545b-1e29-4fe4-876c-3ac155805d90","Type":"ContainerStarted","Data":"54e28bf3c936bd681e1e936be1704343e56a4f997123ae2cf30078c4da527bc1"}
Jul 22 09:18:19.118392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.118365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7r88r" event={"ID":"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288","Type":"ContainerStarted","Data":"f78bde296d8dcc649ac59c36f5fb3bc34ca07bee2f30d8cd2b05a43edc282388"}
Jul 22 09:18:19.120180 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.120153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv" event={"ID":"3690fa03-ab95-4dcf-834f-8ae4ff56531a","Type":"ContainerStarted","Data":"6cb72a7e1d4f8f285e0db265715dfd601bad45fa5e1983d423b34a8db17e2ae7"}
Jul 22 09:18:19.121381 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.121358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn" event={"ID":"3eb6ec58-b55e-44fc-b256-101d8421f3ae","Type":"ContainerStarted","Data":"5e1699613c85d26b820da2256837768610f16ef0465a053257f7f374b859a3e0"}
Jul 22 09:18:19.122555 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.122513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74" event={"ID":"50b861eb-db72-43e2-a1d0-fe4f858dafa3","Type":"ContainerStarted","Data":"fba3dfabf71be9c86188bb3f24917aa846e13acded878b422fb3c15ca7fcea74"}
Jul 22 09:18:19.786107 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.786067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:19.786286 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.786163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:19.786286 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.786267    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 09:18:19.786420 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.786318    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:21.786298571 +0000 UTC m=+57.380290695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : configmap references non-existent config key: service-ca.crt
Jul 22 09:18:19.786420 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.786342    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:21.786330103 +0000 UTC m=+57.380322229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : secret "router-metrics-certs-default" not found
Jul 22 09:18:19.886912 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.886875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:19.887105 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:19.887080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:19.887247 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.887230    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:19.887329 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.887301    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls podName:e40312be-71ff-4b92-924f-b09c0cf425b7 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:21.887280342 +0000 UTC m=+57.481272478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hvkd6" (UID: "e40312be-71ff-4b92-924f-b09c0cf425b7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:19.887730 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.887711    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 09:18:19.887827 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:19.887771    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls podName:6a7b2b8e-6148-4e36-97e2-30719d0eb8ea nodeName:}" failed. No retries permitted until 2026-07-22 09:18:21.887753395 +0000 UTC m=+57.481745539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqqtz" (UID: "6a7b2b8e-6148-4e36-97e2-30719d0eb8ea") : secret "samples-operator-tls" not found
Jul 22 09:18:20.128775 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:20.128739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv" event={"ID":"1409545b-1e29-4fe4-876c-3ac155805d90","Type":"ContainerStarted","Data":"832d2ed01d45f877c179d8e8b61ca1a08efc05fb5c03c4caf10dc0f6e5c2e78c"}
Jul 22 09:18:20.146812 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:20.146189    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5c4mv" podStartSLOduration=1.521315379 podStartE2EDuration="3.146166962s" totalImagesPullingTime="1.624851583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:20.145333053 +0000 UTC m=+55.739325212" watchObservedRunningTime="2026-07-22 09:18:20.146166962 +0000 UTC m=+55.740159108"
Jul 22 09:18:21.801505 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:21.801463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:21.802057 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:21.801563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:21.802057 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.801627    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 09:18:21.802057 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.801704    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:25.801686178 +0000 UTC m=+61.395678304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : configmap references non-existent config key: service-ca.crt
Jul 22 09:18:21.802057 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.801726    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:25.8017169 +0000 UTC m=+61.395709026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : secret "router-metrics-certs-default" not found
Jul 22 09:18:21.902451 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:21.902416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:21.902643 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:21.902477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:21.902643 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.902594    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 09:18:21.902754 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.902673    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls podName:6a7b2b8e-6148-4e36-97e2-30719d0eb8ea nodeName:}" failed. No retries permitted until 2026-07-22 09:18:25.902653154 +0000 UTC m=+61.496645288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqqtz" (UID: "6a7b2b8e-6148-4e36-97e2-30719d0eb8ea") : secret "samples-operator-tls" not found
Jul 22 09:18:21.902754 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.902592    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:21.902876 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:21.902755    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls podName:e40312be-71ff-4b92-924f-b09c0cf425b7 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:25.902737719 +0000 UTC m=+61.496729842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hvkd6" (UID: "e40312be-71ff-4b92-924f-b09c0cf425b7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:23.142366 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.142319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7r88r" event={"ID":"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288","Type":"ContainerStarted","Data":"3550db1781ab7200b2f33bb756e02f2f09001ded53d0541e2d349ee662f2ddb6"}
Jul 22 09:18:23.144948 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.144917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn" event={"ID":"3eb6ec58-b55e-44fc-b256-101d8421f3ae","Type":"ContainerStarted","Data":"b30a62354e19baa7a3d70b66520c33cc2615f6a17f0e091f05300664d3b41d22"}
Jul 22 09:18:23.147235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.147186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74" event={"ID":"50b861eb-db72-43e2-a1d0-fe4f858dafa3","Type":"ContainerStarted","Data":"1a9e423977b7a65766ea5383337ad0069a164318f4943652b1833df703738b88"}
Jul 22 09:18:23.149232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.149209    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/0.log"
Jul 22 09:18:23.149345 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.149250    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f46ab7c-43a8-4e94-a860-198824b5873c" containerID="e1f52c3855e302b798d1393ffb6fd2fb9ddfa8d5e9d1c2180337672afa59c365" exitCode=255
Jul 22 09:18:23.149345 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.149284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" event={"ID":"5f46ab7c-43a8-4e94-a860-198824b5873c","Type":"ContainerDied","Data":"e1f52c3855e302b798d1393ffb6fd2fb9ddfa8d5e9d1c2180337672afa59c365"}
Jul 22 09:18:23.149653 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.149624    2560 scope.go:117] "RemoveContainer" containerID="e1f52c3855e302b798d1393ffb6fd2fb9ddfa8d5e9d1c2180337672afa59c365"
Jul 22 09:18:23.162593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.162551    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-7r88r" podStartSLOduration=2.55447801 podStartE2EDuration="6.162539109s" totalImagesPullingTime="3.608061099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:23.161150686 +0000 UTC m=+58.755142829" watchObservedRunningTime="2026-07-22 09:18:23.162539109 +0000 UTC m=+58.756531252"
Jul 22 09:18:23.187941 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.187847    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn" podStartSLOduration=2.402327008 podStartE2EDuration="6.187818835s" totalImagesPullingTime="3.785491827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:23.186571052 +0000 UTC m=+58.780563192" watchObservedRunningTime="2026-07-22 09:18:23.187818835 +0000 UTC m=+58.781810995"
Jul 22 09:18:23.234313 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:23.234262    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74" podStartSLOduration=2.593279894 podStartE2EDuration="6.234243265s" totalImagesPullingTime="3.640963371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:23.211808273 +0000 UTC m=+58.805800419" watchObservedRunningTime="2026-07-22 09:18:23.234243265 +0000 UTC m=+58.828235417"
Jul 22 09:18:24.155669 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.155638    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:18:24.156310 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.156281    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/0.log"
Jul 22 09:18:24.156434 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.156327    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f46ab7c-43a8-4e94-a860-198824b5873c" containerID="0633efa87cbaac1f69d5780dbd4b78000c2be3af867415c3d674d1bb1542ede7" exitCode=255
Jul 22 09:18:24.156558 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.156419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" event={"ID":"5f46ab7c-43a8-4e94-a860-198824b5873c","Type":"ContainerDied","Data":"0633efa87cbaac1f69d5780dbd4b78000c2be3af867415c3d674d1bb1542ede7"}
Jul 22 09:18:24.156558 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.156502    2560 scope.go:117] "RemoveContainer" containerID="e1f52c3855e302b798d1393ffb6fd2fb9ddfa8d5e9d1c2180337672afa59c365"
Jul 22 09:18:24.156867 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.156827    2560 scope.go:117] "RemoveContainer" containerID="0633efa87cbaac1f69d5780dbd4b78000c2be3af867415c3d674d1bb1542ede7"
Jul 22 09:18:24.157069 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:24.157043    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6xp9p_openshift-console-operator(5f46ab7c-43a8-4e94-a860-198824b5873c)\"" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" podUID="5f46ab7c-43a8-4e94-a860-198824b5873c"
Jul 22 09:18:24.984970 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.984936    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l8tdj"]
Jul 22 09:18:24.996376 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.996352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:24.999489 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.999456    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8tdj"]
Jul 22 09:18:24.999921 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.999896    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7wntr\""
Jul 22 09:18:25.000018 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:24.999945    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 09:18:25.000208 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.000187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 09:18:25.032660 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.032634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2dade4e-bb24-42b9-9dbd-a491661db59e-data-volume\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.032779 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.032759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrgwv\" (UniqueName: \"kubernetes.io/projected/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-api-access-vrgwv\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.032847 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.032816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2dade4e-bb24-42b9-9dbd-a491661db59e-crio-socket\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.032956 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.032937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.033010 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.032996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.057459 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.057439    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv9vm"
Jul 22 09:18:25.133745 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.133684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.133874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.133745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.133874 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.133783    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:25.133874 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.133824    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:25.633810873 +0000 UTC m=+61.227802995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:25.133874 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.133862    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 09:18:25.134089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.133914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2dade4e-bb24-42b9-9dbd-a491661db59e-data-volume\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.134089 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.133998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:25.633971465 +0000 UTC m=+61.227963598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : configmap "kube-rbac-proxy" not found
Jul 22 09:18:25.134089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.134074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrgwv\" (UniqueName: \"kubernetes.io/projected/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-api-access-vrgwv\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.134236 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.134108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2dade4e-bb24-42b9-9dbd-a491661db59e-crio-socket\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.134236 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.134189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2dade4e-bb24-42b9-9dbd-a491661db59e-crio-socket\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.134334 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.134230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2dade4e-bb24-42b9-9dbd-a491661db59e-data-volume\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.142522 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.142501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrgwv\" (UniqueName: \"kubernetes.io/projected/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-api-access-vrgwv\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.161030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.161009    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:18:25.161335 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.161318    2560 scope.go:117] "RemoveContainer" containerID="0633efa87cbaac1f69d5780dbd4b78000c2be3af867415c3d674d1bb1542ede7"
Jul 22 09:18:25.161486 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.161468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6xp9p_openshift-console-operator(5f46ab7c-43a8-4e94-a860-198824b5873c)\"" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" podUID="5f46ab7c-43a8-4e94-a860-198824b5873c"
Jul 22 09:18:25.638339 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.638303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.638511 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.638362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:25.638511 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.638455    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:25.638631 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.638531    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:26.638512173 +0000 UTC m=+62.232504313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:25.638631 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.638463    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 09:18:25.638631 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.638621    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:26.638604076 +0000 UTC m=+62.232596200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : configmap "kube-rbac-proxy" not found
Jul 22 09:18:25.809391 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.809357    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mvcpk"]
Jul 22 09:18:25.812291 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.812273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.814910 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.814882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 09:18:25.814910 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.814905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 09:18:25.815067 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.814954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m42pk\""
Jul 22 09:18:25.815067 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.814905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 09:18:25.815278 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.815262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 09:18:25.821275 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.821255    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mvcpk"]
Jul 22 09:18:25.839575 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.839552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:25.839696 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.839587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c28a0b3a-f289-4437-b139-78fcff57bfa6-signing-key\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.839696 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.839669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c28a0b3a-f289-4437-b139-78fcff57bfa6-signing-cabundle\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.839820 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.839794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t54b\" (UniqueName: \"kubernetes.io/projected/c28a0b3a-f289-4437-b139-78fcff57bfa6-kube-api-access-5t54b\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.839910 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.839868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:25.839959 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.839949    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 09:18:25.840011 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.840002    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:33.839985734 +0000 UTC m=+69.433977872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : secret "router-metrics-certs-default" not found
Jul 22 09:18:25.840078 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.840030    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:33.840014496 +0000 UTC m=+69.434006621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : configmap references non-existent config key: service-ca.crt
Jul 22 09:18:25.940757 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.940688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t54b\" (UniqueName: \"kubernetes.io/projected/c28a0b3a-f289-4437-b139-78fcff57bfa6-kube-api-access-5t54b\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.940757 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.940724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:25.940757 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.940750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:25.941030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.940792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c28a0b3a-f289-4437-b139-78fcff57bfa6-signing-key\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.941030 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.940867    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:25.941030 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.940924    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls podName:e40312be-71ff-4b92-924f-b09c0cf425b7 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:33.940910612 +0000 UTC m=+69.534902733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hvkd6" (UID: "e40312be-71ff-4b92-924f-b09c0cf425b7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:25.941030 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.940937    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 09:18:25.941030 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:25.940999    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls podName:6a7b2b8e-6148-4e36-97e2-30719d0eb8ea nodeName:}" failed. No retries permitted until 2026-07-22 09:18:33.940980563 +0000 UTC m=+69.534972689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqqtz" (UID: "6a7b2b8e-6148-4e36-97e2-30719d0eb8ea") : secret "samples-operator-tls" not found
Jul 22 09:18:25.941030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.940873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c28a0b3a-f289-4437-b139-78fcff57bfa6-signing-cabundle\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.941627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.941604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c28a0b3a-f289-4437-b139-78fcff57bfa6-signing-cabundle\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.943271 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.943251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c28a0b3a-f289-4437-b139-78fcff57bfa6-signing-key\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:25.958582 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:25.958557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t54b\" (UniqueName: \"kubernetes.io/projected/c28a0b3a-f289-4437-b139-78fcff57bfa6-kube-api-access-5t54b\") pod \"service-ca-58598695f7-mvcpk\" (UID: \"c28a0b3a-f289-4437-b139-78fcff57bfa6\") " pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:26.121557 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.121521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mvcpk"
Jul 22 09:18:26.167021 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.166989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv" event={"ID":"3690fa03-ab95-4dcf-834f-8ae4ff56531a","Type":"ContainerStarted","Data":"423f06969f4856ed4cc3a92cde7af0fa22265f65536a375c6eac17022fe4724b"}
Jul 22 09:18:26.187153 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.187065    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c6vsv" podStartSLOduration=2.531381066 podStartE2EDuration="9.187044791s" totalImagesPullingTime="6.655663725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:26.18581085 +0000 UTC m=+61.779803006" watchObservedRunningTime="2026-07-22 09:18:26.187044791 +0000 UTC m=+61.781036935"
Jul 22 09:18:26.253765 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.253735    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mvcpk"]
Jul 22 09:18:26.256431 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:26.256408    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28a0b3a_f289_4437_b139_78fcff57bfa6.slice/crio-66704cf0f6d517272a61ac98a725eb7c6757131ddd21814d713ae4e6449c9d2f WatchSource:0}: Error finding container 66704cf0f6d517272a61ac98a725eb7c6757131ddd21814d713ae4e6449c9d2f: Status 404 returned error can't find the container with id 66704cf0f6d517272a61ac98a725eb7c6757131ddd21814d713ae4e6449c9d2f
Jul 22 09:18:26.369206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.369185    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vsg8g_a7e01367-743a-4de8-9f3c-49e4f8a19916/dns-node-resolver/0.log"
Jul 22 09:18:26.648252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.648224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:26.648404 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:26.648270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:26.648404 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:26.648371    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:26.648505 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:26.648433    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:28.648416071 +0000 UTC m=+64.242408192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:26.648505 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:26.648478    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 09:18:26.648588 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:26.648524    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:28.648509747 +0000 UTC m=+64.242501890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : configmap "kube-rbac-proxy" not found
Jul 22 09:18:27.171894 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:27.171857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mvcpk" event={"ID":"c28a0b3a-f289-4437-b139-78fcff57bfa6","Type":"ContainerStarted","Data":"61eb5ee1f5c0255143d7fa8a6a8cac63bf6653e05c35c6904c59a6f6d5df7415"}
Jul 22 09:18:27.172252 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:27.171909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mvcpk" event={"ID":"c28a0b3a-f289-4437-b139-78fcff57bfa6","Type":"ContainerStarted","Data":"66704cf0f6d517272a61ac98a725eb7c6757131ddd21814d713ae4e6449c9d2f"}
Jul 22 09:18:27.369092 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:27.369069    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xc9cj_d45cc663-ff38-4f9c-b108-a4df2906f1f0/node-ca/0.log"
Jul 22 09:18:27.771959 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:27.771927    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tq7b9_830f93ed-4dd1-446c-b1ac-84ae1a922645/serve-healthcheck-canary/0.log"
Jul 22 09:18:28.470156 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:28.470122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:28.470573 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:28.470222    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:28.470637 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:28.470604    2560 scope.go:117] "RemoveContainer" containerID="0633efa87cbaac1f69d5780dbd4b78000c2be3af867415c3d674d1bb1542ede7"
Jul 22 09:18:28.470791 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:28.470768    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6xp9p_openshift-console-operator(5f46ab7c-43a8-4e94-a860-198824b5873c)\"" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" podUID="5f46ab7c-43a8-4e94-a860-198824b5873c"
Jul 22 09:18:28.670404 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:28.670374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:28.670579 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:28.670435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:28.670796 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:28.670639    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 09:18:28.670796 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:28.670694    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:32.670676456 +0000 UTC m=+68.264668584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : configmap "kube-rbac-proxy" not found
Jul 22 09:18:28.670796 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:28.670720    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:28.670796 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:28.670777    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:32.670760561 +0000 UTC m=+68.264752687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:29.678717 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.678682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:18:29.679140 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.678731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:18:29.679140 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.678876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:18:29.681081 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.681062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjsv\" (UniqueName: \"kubernetes.io/projected/9c5c9e11-3320-4731-9293-0014a4b88fa5-kube-api-access-2pjsv\") pod \"network-check-target-cg4gs\" (UID: \"9c5c9e11-3320-4731-9293-0014a4b88fa5\") " pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:18:29.681577 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.681559    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 09:18:29.681577 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.681568    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 09:18:29.689392 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:29.689375    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 09:18:29.689475 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:29.689430    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs podName:a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e nodeName:}" failed. No retries permitted until 2026-07-22 09:19:33.689414019 +0000 UTC m=+129.283406145 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs") pod "network-metrics-daemon-l26m8" (UID: "a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e") : secret "metrics-daemon-secret" not found
Jul 22 09:18:29.691218 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.691196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/650050ff-f9f6-4c60-a177-dab5d00e8a3b-original-pull-secret\") pod \"global-pull-secret-syncer-4p5ct\" (UID: \"650050ff-f9f6-4c60-a177-dab5d00e8a3b\") " pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:18:29.919266 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.919238    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8b4k6\""
Jul 22 09:18:29.925056 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.925039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:18:29.928549 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:29.928529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4p5ct"
Jul 22 09:18:30.073977 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.073924    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-mvcpk" podStartSLOduration=5.073906297 podStartE2EDuration="5.073906297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:27.192678859 +0000 UTC m=+62.786671002" watchObservedRunningTime="2026-07-22 09:18:30.073906297 +0000 UTC m=+65.667898471"
Jul 22 09:18:30.074346 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.074331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cg4gs"]
Jul 22 09:18:30.077139 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:30.077111    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5c9e11_3320_4731_9293_0014a4b88fa5.slice/crio-fc3185071cac64991b2d3f8f8c7e251c80b73b7a65c5eac433b4c26b22d5f4a0 WatchSource:0}: Error finding container fc3185071cac64991b2d3f8f8c7e251c80b73b7a65c5eac433b4c26b22d5f4a0: Status 404 returned error can't find the container with id fc3185071cac64991b2d3f8f8c7e251c80b73b7a65c5eac433b4c26b22d5f4a0
Jul 22 09:18:30.098206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.098183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4p5ct"]
Jul 22 09:18:30.114760 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:30.114737    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650050ff_f9f6_4c60_a177_dab5d00e8a3b.slice/crio-82d7a9bb757f75486f070af7c6349d414c5105fce354e3c0816653b393a2f825 WatchSource:0}: Error finding container 82d7a9bb757f75486f070af7c6349d414c5105fce354e3c0816653b393a2f825: Status 404 returned error can't find the container with id 82d7a9bb757f75486f070af7c6349d414c5105fce354e3c0816653b393a2f825
Jul 22 09:18:30.182423 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.182358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cg4gs" event={"ID":"9c5c9e11-3320-4731-9293-0014a4b88fa5","Type":"ContainerStarted","Data":"88b9c009469792436b0c3733a161bc986e0d46f7cd0bb260f7f7ba4e7f997422"}
Jul 22 09:18:30.182423 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.182418    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:18:30.182578 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.182441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cg4gs" event={"ID":"9c5c9e11-3320-4731-9293-0014a4b88fa5","Type":"ContainerStarted","Data":"fc3185071cac64991b2d3f8f8c7e251c80b73b7a65c5eac433b4c26b22d5f4a0"}
Jul 22 09:18:30.183484 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.183463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4p5ct" event={"ID":"650050ff-f9f6-4c60-a177-dab5d00e8a3b","Type":"ContainerStarted","Data":"82d7a9bb757f75486f070af7c6349d414c5105fce354e3c0816653b393a2f825"}
Jul 22 09:18:30.208919 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:30.208878    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cg4gs" podStartSLOduration=65.208867003 podStartE2EDuration="1m5.208867003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:30.208721137 +0000 UTC m=+65.802713281" watchObservedRunningTime="2026-07-22 09:18:30.208867003 +0000 UTC m=+65.802859145"
Jul 22 09:18:31.092632 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:31.092600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:18:31.093097 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:31.092642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:18:31.093097 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:31.092743    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 09:18:31.093097 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:31.092747    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 09:18:31.093097 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:31.092762    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-658f897b77-7974t: secret "image-registry-tls" not found
Jul 22 09:18:31.093097 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:31.092800    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls podName:4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee nodeName:}" failed. No retries permitted until 2026-07-22 09:19:03.092782326 +0000 UTC m=+98.686774465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls") pod "dns-default-wdgvk" (UID: "4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee") : secret "dns-default-metrics-tls" not found
Jul 22 09:18:31.093097 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:31.092883    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls podName:56623b2a-1131-4191-a1e8-5bfb8cbdd0a5 nodeName:}" failed. No retries permitted until 2026-07-22 09:19:03.092859157 +0000 UTC m=+98.686851292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls") pod "image-registry-658f897b77-7974t" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5") : secret "image-registry-tls" not found
Jul 22 09:18:32.708235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:32.708189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:32.708688 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:32.708245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:32.708688 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:32.708326    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:32.708688 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:32.708379    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 09:18:32.708688 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:32.708393    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:40.708373873 +0000 UTC m=+76.302365998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : secret "insights-runtime-extractor-tls" not found
Jul 22 09:18:32.708688 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:32.708470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm podName:c2dade4e-bb24-42b9-9dbd-a491661db59e nodeName:}" failed. No retries permitted until 2026-07-22 09:18:40.708439734 +0000 UTC m=+76.302431858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8tdj" (UID: "c2dade4e-bb24-42b9-9dbd-a491661db59e") : configmap "kube-rbac-proxy" not found
Jul 22 09:18:33.919847 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:33.919794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:33.920298 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:33.919927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:33.920298 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:33.920079    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle podName:fe1d7805-b978-45fc-b2b0-b43c5477ff14 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:49.920058911 +0000 UTC m=+85.514051037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle") pod "router-default-cc969ffc4-l8wp8" (UID: "fe1d7805-b978-45fc-b2b0-b43c5477ff14") : configmap references non-existent config key: service-ca.crt
Jul 22 09:18:33.922503 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:33.922474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe1d7805-b978-45fc-b2b0-b43c5477ff14-metrics-certs\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:34.021033 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:34.020998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:34.021198 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:34.021052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:34.021198 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:34.021180    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:34.021304 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:18:34.021259    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls podName:e40312be-71ff-4b92-924f-b09c0cf425b7 nodeName:}" failed. No retries permitted until 2026-07-22 09:18:50.021238165 +0000 UTC m=+85.615230307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hvkd6" (UID: "e40312be-71ff-4b92-924f-b09c0cf425b7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 09:18:34.023604 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:34.023581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7b2b8e-6148-4e36-97e2-30719d0eb8ea-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqqtz\" (UID: \"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:34.047895 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:34.047871    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8jwp\""
Jul 22 09:18:34.055151 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:34.055130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"
Jul 22 09:18:34.791978 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:34.791949    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz"]
Jul 22 09:18:35.204142 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:35.204106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz" event={"ID":"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea","Type":"ContainerStarted","Data":"0cfebeea9b15448d8f0d5d6dd9125fc196e09c324f5152116f994b8bfcf67bc8"}
Jul 22 09:18:35.205570 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:35.205545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4p5ct" event={"ID":"650050ff-f9f6-4c60-a177-dab5d00e8a3b","Type":"ContainerStarted","Data":"ed22cec999920038e4a1f058e29653f179016addc4fb86c0dc8b9a9fcc528ab5"}
Jul 22 09:18:35.222546 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:35.222506    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4p5ct" podStartSLOduration=65.642422942 podStartE2EDuration="1m10.222491721s" totalImagesPullingTime="4.580068779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:35.221222832 +0000 UTC m=+70.815214974" watchObservedRunningTime="2026-07-22 09:18:35.222491721 +0000 UTC m=+70.816483863"
Jul 22 09:18:37.213468 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:37.213438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz" event={"ID":"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea","Type":"ContainerStarted","Data":"2c86eb5c35089aadb727c45984eabb45a6b11c6f74a7b8fd568bc0371a64804c"}
Jul 22 09:18:37.214022 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:37.213487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz" event={"ID":"6a7b2b8e-6148-4e36-97e2-30719d0eb8ea","Type":"ContainerStarted","Data":"76182da44d0d6735f4054a29ae39048b04961eb9fdd38ca79023c840f5107670"}
Jul 22 09:18:37.233786 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:37.233733    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqqtz" podStartSLOduration=17.359724431 podStartE2EDuration="19.233713133s" totalImagesPullingTime="1.873988702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:37.232241706 +0000 UTC m=+72.826233850" watchObservedRunningTime="2026-07-22 09:18:37.233713133 +0000 UTC m=+72.827705278"
Jul 22 09:18:40.774030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:40.773992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:40.774030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:40.774035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:40.774476 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:40.774460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2dade4e-bb24-42b9-9dbd-a491661db59e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:40.776220 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:40.776196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2dade4e-bb24-42b9-9dbd-a491661db59e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8tdj\" (UID: \"c2dade4e-bb24-42b9-9dbd-a491661db59e\") " pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:40.909249 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:40.909223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8tdj"
Jul 22 09:18:41.037167 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:41.037105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8tdj"]
Jul 22 09:18:41.039921 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:41.039896    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2dade4e_bb24_42b9_9dbd_a491661db59e.slice/crio-d962aac8ccd542b5e40dde2d7f1d6378c395636b19a1a0de1db80521a6c528d8 WatchSource:0}: Error finding container d962aac8ccd542b5e40dde2d7f1d6378c395636b19a1a0de1db80521a6c528d8: Status 404 returned error can't find the container with id d962aac8ccd542b5e40dde2d7f1d6378c395636b19a1a0de1db80521a6c528d8
Jul 22 09:18:41.226474 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:41.226445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8tdj" event={"ID":"c2dade4e-bb24-42b9-9dbd-a491661db59e","Type":"ContainerStarted","Data":"d962aac8ccd542b5e40dde2d7f1d6378c395636b19a1a0de1db80521a6c528d8"}
Jul 22 09:18:42.903094 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:42.903063    2560 scope.go:117] "RemoveContainer" containerID="0633efa87cbaac1f69d5780dbd4b78000c2be3af867415c3d674d1bb1542ede7"
Jul 22 09:18:43.244396 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:43.244308    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:18:43.244396 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:43.244381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" event={"ID":"5f46ab7c-43a8-4e94-a860-198824b5873c","Type":"ContainerStarted","Data":"54f0187d8f51ef27fdfa656618585aa6c884c55df2c6845132e1196074fc48e4"}
Jul 22 09:18:43.244750 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:43.244683    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:43.265709 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:43.265653    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p" podStartSLOduration=21.698049214 podStartE2EDuration="25.265635536s" totalImagesPullingTime="3.567586322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:43.264015842 +0000 UTC m=+78.858007984" watchObservedRunningTime="2026-07-22 09:18:43.265635536 +0000 UTC m=+78.859627680"
Jul 22 09:18:43.791213 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:43.791179    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-6xp9p"
Jul 22 09:18:45.845014 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.844970    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"]
Jul 22 09:18:45.848132 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.848108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:45.852127 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.852101    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 09:18:45.852946 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.852884    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 09:18:45.853084 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.853002    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 09:18:45.853158 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.853090    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 09:18:45.853158 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.853132    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 09:18:45.853264 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.853246    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 09:18:45.853314 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.853290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 09:18:45.866219 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.866166    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"]
Jul 22 09:18:45.920284 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.920251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:45.920431 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.920313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-ca\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:45.920431 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.920333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:45.920431 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.920352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1082413f-11a5-4282-8e8a-64dc4957f74e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:45.920431 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.920429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntc2w\" (UniqueName: \"kubernetes.io/projected/1082413f-11a5-4282-8e8a-64dc4957f74e-kube-api-access-ntc2w\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:45.920599 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:45.920451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-hub\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.021811 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.021785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.021979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.021849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-ca\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.021979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.021874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.021979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.021892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1082413f-11a5-4282-8e8a-64dc4957f74e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.022154 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.022105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntc2w\" (UniqueName: \"kubernetes.io/projected/1082413f-11a5-4282-8e8a-64dc4957f74e-kube-api-access-ntc2w\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.022212 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.022157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-hub\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.022609 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.022578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1082413f-11a5-4282-8e8a-64dc4957f74e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.024456 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.024434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-ca\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.024577 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.024455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-hub\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.024674 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.024658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.024730 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.024709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1082413f-11a5-4282-8e8a-64dc4957f74e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.030705 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.030675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntc2w\" (UniqueName: \"kubernetes.io/projected/1082413f-11a5-4282-8e8a-64dc4957f74e-kube-api-access-ntc2w\") pod \"cluster-proxy-proxy-agent-d88bccdd9-sxkgm\" (UID: \"1082413f-11a5-4282-8e8a-64dc4957f74e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.169071 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.169040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"
Jul 22 09:18:46.262492 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.262456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8tdj" event={"ID":"c2dade4e-bb24-42b9-9dbd-a491661db59e","Type":"ContainerStarted","Data":"509a7f494aca56e573a1f6fde1879ecad4a20327f6ba0b209f7b6f43ee7b8cce"}
Jul 22 09:18:46.336383 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:46.336348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm"]
Jul 22 09:18:46.339755 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:46.339660    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1082413f_11a5_4282_8e8a_64dc4957f74e.slice/crio-0814b265e0fa3336336fdf6101a2377eb4fb1dd75414c10f5ac6a0dde057ea33 WatchSource:0}: Error finding container 0814b265e0fa3336336fdf6101a2377eb4fb1dd75414c10f5ac6a0dde057ea33: Status 404 returned error can't find the container with id 0814b265e0fa3336336fdf6101a2377eb4fb1dd75414c10f5ac6a0dde057ea33
Jul 22 09:18:47.269309 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:47.268855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm" event={"ID":"1082413f-11a5-4282-8e8a-64dc4957f74e","Type":"ContainerStarted","Data":"0814b265e0fa3336336fdf6101a2377eb4fb1dd75414c10f5ac6a0dde057ea33"}
Jul 22 09:18:49.959233 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:49.959193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:49.959870 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:49.959850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1d7805-b978-45fc-b2b0-b43c5477ff14-service-ca-bundle\") pod \"router-default-cc969ffc4-l8wp8\" (UID: \"fe1d7805-b978-45fc-b2b0-b43c5477ff14\") " pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:50.060661 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:50.060620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:50.063530 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:50.063473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40312be-71ff-4b92-924f-b09c0cf425b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hvkd6\" (UID: \"e40312be-71ff-4b92-924f-b09c0cf425b7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:50.169616 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:50.169584    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rqhm6\""
Jul 22 09:18:50.176945 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:50.176927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:50.216290 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:50.216231    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rbdqz\""
Jul 22 09:18:50.223718 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:50.223696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"
Jul 22 09:18:51.554998 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:51.554970    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6"]
Jul 22 09:18:51.557850 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:51.557815    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40312be_71ff_4b92_924f_b09c0cf425b7.slice/crio-efce36d9ad2bd32a0321cfe35ee7d5cf6877e06829ead6d2dc14001c92558180 WatchSource:0}: Error finding container efce36d9ad2bd32a0321cfe35ee7d5cf6877e06829ead6d2dc14001c92558180: Status 404 returned error can't find the container with id efce36d9ad2bd32a0321cfe35ee7d5cf6877e06829ead6d2dc14001c92558180
Jul 22 09:18:51.576705 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:51.576685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cc969ffc4-l8wp8"]
Jul 22 09:18:51.580246 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:18:51.580202    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1d7805_b978_45fc_b2b0_b43c5477ff14.slice/crio-7dc07a2d1b76380d650d427f5c1638a4b68dc2e47e423e778d05202a0fa5232d WatchSource:0}: Error finding container 7dc07a2d1b76380d650d427f5c1638a4b68dc2e47e423e778d05202a0fa5232d: Status 404 returned error can't find the container with id 7dc07a2d1b76380d650d427f5c1638a4b68dc2e47e423e778d05202a0fa5232d
Jul 22 09:18:52.291740 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.291640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6" event={"ID":"e40312be-71ff-4b92-924f-b09c0cf425b7","Type":"ContainerStarted","Data":"efce36d9ad2bd32a0321cfe35ee7d5cf6877e06829ead6d2dc14001c92558180"}
Jul 22 09:18:52.293783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.293750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8tdj" event={"ID":"c2dade4e-bb24-42b9-9dbd-a491661db59e","Type":"ContainerStarted","Data":"061417926f8f79bc9112bf7b3331611dbcfaa73ca6f1a701e9c44f65c86778ac"}
Jul 22 09:18:52.295987 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.295606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cc969ffc4-l8wp8" event={"ID":"fe1d7805-b978-45fc-b2b0-b43c5477ff14","Type":"ContainerStarted","Data":"382ce8adb7a8a7e35d68b4044e3b5a932d8cc09d098891c5fff6137921e68f44"}
Jul 22 09:18:52.295987 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.295654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cc969ffc4-l8wp8" event={"ID":"fe1d7805-b978-45fc-b2b0-b43c5477ff14","Type":"ContainerStarted","Data":"7dc07a2d1b76380d650d427f5c1638a4b68dc2e47e423e778d05202a0fa5232d"}
Jul 22 09:18:52.298316 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.298288    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm" event={"ID":"1082413f-11a5-4282-8e8a-64dc4957f74e","Type":"ContainerStarted","Data":"ad1a0aad21c2da333c9c87ba327279a1409c97af92a84425e14a01388f084949"}
Jul 22 09:18:52.298433 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.298325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm" event={"ID":"1082413f-11a5-4282-8e8a-64dc4957f74e","Type":"ContainerStarted","Data":"b021ca05074f758829f6924d31cea70aed4198151f4c09859a66ab41ba536757"}
Jul 22 09:18:52.298433 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.298338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm" event={"ID":"1082413f-11a5-4282-8e8a-64dc4957f74e","Type":"ContainerStarted","Data":"2ee0ea01d38317677095fb07ce364ceec1391d6e6e1d33f1cae1487ca1e72d74"}
Jul 22 09:18:52.320405 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.320350    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-cc969ffc4-l8wp8" podStartSLOduration=35.320332047 podStartE2EDuration="35.320332047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:52.318388937 +0000 UTC m=+87.912381083" watchObservedRunningTime="2026-07-22 09:18:52.320332047 +0000 UTC m=+87.914324192"
Jul 22 09:18:52.340059 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:52.340006    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d88bccdd9-sxkgm" podStartSLOduration=2.2637108169999998 podStartE2EDuration="7.339985975s" totalImagesPullingTime="5.076275158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:52.338947561 +0000 UTC m=+87.932939704" watchObservedRunningTime="2026-07-22 09:18:52.339985975 +0000 UTC m=+87.933978123"
Jul 22 09:18:53.177546 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:53.177508    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:53.180613 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:53.180591    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:53.301965 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:53.301939    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:53.303045 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:53.303024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-cc969ffc4-l8wp8"
Jul 22 09:18:55.311921 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:55.311811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8tdj" event={"ID":"c2dade4e-bb24-42b9-9dbd-a491661db59e","Type":"ContainerStarted","Data":"bd13cbacf54a74bbad86784566abe38b547f28119502431307c55e2109992170"}
Jul 22 09:18:55.313687 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:55.313653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6" event={"ID":"e40312be-71ff-4b92-924f-b09c0cf425b7","Type":"ContainerStarted","Data":"60b070840e6fd649da335a51042b2441ebbf9f8821ee1047f7514e49a0603567"}
Jul 22 09:18:55.332410 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:55.332371    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l8tdj" podStartSLOduration=17.490886085 podStartE2EDuration="31.332357085s" totalImagesPullingTime="13.841471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 09:18:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:55.331423878 +0000 UTC m=+90.925416043" watchObservedRunningTime="2026-07-22 09:18:55.332357085 +0000 UTC m=+90.926349218"
Jul 22 09:18:55.357341 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:18:55.357298    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hvkd6" podStartSLOduration=34.915882674 podStartE2EDuration="38.357287354s" totalImagesPullingTime="3.44140468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:18:55.356047874 +0000 UTC m=+90.950040017" watchObservedRunningTime="2026-07-22 09:18:55.357287354 +0000 UTC m=+90.951279496"
Jul 22 09:19:01.190594 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:01.190559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cg4gs"
Jul 22 09:19:02.946643 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.946606    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wt4q5"]
Jul 22 09:19:02.949968 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.949947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:02.952639 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.952616    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 09:19:02.952745 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.952616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jgbts\""
Jul 22 09:19:02.952810 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.952625    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 09:19:02.952810 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.952652    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 09:19:02.952810 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:02.952667    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 09:19:03.070987 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.070960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-wtmp\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071133 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-root\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071133 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-metrics-client-ca\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071133 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071133 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-tls\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071309 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-textfile\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071309 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071400 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllg2\" (UniqueName: \"kubernetes.io/projected/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-kube-api-access-pllg2\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.071452 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.071397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-sys\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.172697 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-metrics-client-ca\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.172828 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.172828 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-tls\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.172828 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-textfile\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.172828 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllg2\" (UniqueName: \"kubernetes.io/projected/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-kube-api-access-pllg2\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:03.173058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:19:03.173058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-sys\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.172985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-wtmp\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-root\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173336 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-root\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173336 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-sys\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173687 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-wtmp\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173687 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-metrics-client-ca\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173687 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.173687 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.173518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-textfile\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.175648 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.175627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-tls\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.175975 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.175956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee-metrics-tls\") pod \"dns-default-wdgvk\" (UID: \"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee\") " pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:19:03.176078 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.176058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.176827 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.176805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"image-registry-658f897b77-7974t\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") " pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:03.180369 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.180349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllg2\" (UniqueName: \"kubernetes.io/projected/cbb7ecfc-069c-45a6-bc57-c88eca2d75f9-kube-api-access-pllg2\") pod \"node-exporter-wt4q5\" (UID: \"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9\") " pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.260698 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.260649    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wt4q5"
Jul 22 09:19:03.272926 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:19:03.272901    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb7ecfc_069c_45a6_bc57_c88eca2d75f9.slice/crio-7eaa9d2d146d2270dc34fe7b2315ddeaecc9d3020250ba2aa6cdae081685ac0a WatchSource:0}: Error finding container 7eaa9d2d146d2270dc34fe7b2315ddeaecc9d3020250ba2aa6cdae081685ac0a: Status 404 returned error can't find the container with id 7eaa9d2d146d2270dc34fe7b2315ddeaecc9d3020250ba2aa6cdae081685ac0a
Jul 22 09:19:03.341157 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.341125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wt4q5" event={"ID":"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9","Type":"ContainerStarted","Data":"7eaa9d2d146d2270dc34fe7b2315ddeaecc9d3020250ba2aa6cdae081685ac0a"}
Jul 22 09:19:03.450776 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.450752    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dm8hb\""
Jul 22 09:19:03.458751 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.458733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:03.466564 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.466543    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2clq\""
Jul 22 09:19:03.474381 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.474360    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:19:03.622635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.622606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-658f897b77-7974t"]
Jul 22 09:19:03.626183 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:19:03.626156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56623b2a_1131_4191_a1e8_5bfb8cbdd0a5.slice/crio-59455ed25b5c0b7c78ed711196a9cd0ce7ec8b95cf225882846344ad3ab3efb0 WatchSource:0}: Error finding container 59455ed25b5c0b7c78ed711196a9cd0ce7ec8b95cf225882846344ad3ab3efb0: Status 404 returned error can't find the container with id 59455ed25b5c0b7c78ed711196a9cd0ce7ec8b95cf225882846344ad3ab3efb0
Jul 22 09:19:03.639938 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:03.639915    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdgvk"]
Jul 22 09:19:03.643538 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:19:03.643509    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4333e6d8_fb5b_4fd7_9b65_8ff34bf155ee.slice/crio-0e886d334a335d3bfb754175c830ad8546cc5885299036218f3424885c689d53 WatchSource:0}: Error finding container 0e886d334a335d3bfb754175c830ad8546cc5885299036218f3424885c689d53: Status 404 returned error can't find the container with id 0e886d334a335d3bfb754175c830ad8546cc5885299036218f3424885c689d53
Jul 22 09:19:04.347752 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:04.347719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-658f897b77-7974t" event={"ID":"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5","Type":"ContainerStarted","Data":"3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b"}
Jul 22 09:19:04.348109 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:04.347773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-658f897b77-7974t" event={"ID":"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5","Type":"ContainerStarted","Data":"59455ed25b5c0b7c78ed711196a9cd0ce7ec8b95cf225882846344ad3ab3efb0"}
Jul 22 09:19:04.348109 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:04.347800    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:04.349005 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:04.348981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdgvk" event={"ID":"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee","Type":"ContainerStarted","Data":"0e886d334a335d3bfb754175c830ad8546cc5885299036218f3424885c689d53"}
Jul 22 09:19:05.353703 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:05.353664    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbb7ecfc-069c-45a6-bc57-c88eca2d75f9" containerID="c4ca04adc990b7bbe53f6ca0c1def12443fe0fba34747aad3da784856894bcfb" exitCode=0
Jul 22 09:19:05.354111 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:05.353747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wt4q5" event={"ID":"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9","Type":"ContainerDied","Data":"c4ca04adc990b7bbe53f6ca0c1def12443fe0fba34747aad3da784856894bcfb"}
Jul 22 09:19:05.374330 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:05.374293    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-658f897b77-7974t" podStartSLOduration=100.374273784 podStartE2EDuration="1m40.374273784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:19:04.372891956 +0000 UTC m=+99.966884125" watchObservedRunningTime="2026-07-22 09:19:05.374273784 +0000 UTC m=+100.968265927"
Jul 22 09:19:06.359467 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:06.359431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wt4q5" event={"ID":"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9","Type":"ContainerStarted","Data":"02273aff838fd288cad94786ddc9afddef203e94b184ed6c446f467d49e65cf5"}
Jul 22 09:19:06.359962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:06.359483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wt4q5" event={"ID":"cbb7ecfc-069c-45a6-bc57-c88eca2d75f9","Type":"ContainerStarted","Data":"45f69aeef65ceda677b2c272b049400e000621bf4f3ac36e06017cfcee4c26dd"}
Jul 22 09:19:06.382430 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:06.382372    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wt4q5" podStartSLOduration=3.2796152689999998 podStartE2EDuration="4.382353948s" totalImagesPullingTime="1.03462048s" totalInitContainerRuntime="68.118199ms" isStatefulPod=true podCreationTimestamp="2026-07-22 09:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:19:06.380323499 +0000 UTC m=+101.974315642" watchObservedRunningTime="2026-07-22 09:19:06.382353948 +0000 UTC m=+101.976346093"
Jul 22 09:19:08.368761 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:08.368675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdgvk" event={"ID":"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee","Type":"ContainerStarted","Data":"0d1645188a987a9572c2f0338584fcc9e27249800274620e82f58b0be1c17102"}
Jul 22 09:19:08.369126 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:08.368772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdgvk" event={"ID":"4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee","Type":"ContainerStarted","Data":"e412127d4b1042c9cce78883f83d8fcc9b6674c0238c3a51b20dfbc1db3a4ea1"}
Jul 22 09:19:08.369126 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:08.368815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:19:08.387917 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:08.387866    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wdgvk" podStartSLOduration=65.082574964 podStartE2EDuration="1m9.387851856s" totalImagesPullingTime="4.305276892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:19:08.386717831 +0000 UTC m=+103.980709974" watchObservedRunningTime="2026-07-22 09:19:08.387851856 +0000 UTC m=+103.981843999"
Jul 22 09:19:09.687358 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:09.687324    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-658f897b77-7974t"]
Jul 22 09:19:18.374971 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:18.374943    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wdgvk"
Jul 22 09:19:19.693573 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:19.693542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:33.711857 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:33.711800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:19:33.714096 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:33.714074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e-metrics-certs\") pod \"network-metrics-daemon-l26m8\" (UID: \"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e\") " pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:19:33.824473 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:33.824445    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6sgn5\""
Jul 22 09:19:33.831733 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:33.831712    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l26m8"
Jul 22 09:19:33.992717 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:33.992637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l26m8"]
Jul 22 09:19:33.996139 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:19:33.996112    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fc41ff_3862_4b3e_b5af_843d4c3e2d3e.slice/crio-39f4adad18679f6e7b292959be3a179d67cf24a338121f6cc0e8578d6bf0665e WatchSource:0}: Error finding container 39f4adad18679f6e7b292959be3a179d67cf24a338121f6cc0e8578d6bf0665e: Status 404 returned error can't find the container with id 39f4adad18679f6e7b292959be3a179d67cf24a338121f6cc0e8578d6bf0665e
Jul 22 09:19:34.466132 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:34.466098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l26m8" event={"ID":"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e","Type":"ContainerStarted","Data":"39f4adad18679f6e7b292959be3a179d67cf24a338121f6cc0e8578d6bf0665e"}
Jul 22 09:19:34.707465 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:34.707428    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-658f897b77-7974t" podUID="56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" containerName="registry" containerID="cri-o://3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b" gracePeriod=30
Jul 22 09:19:35.123844 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.123810    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:35.224742 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.224712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-ca-trust-extracted\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.224742 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.224743    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxw5l\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-kube-api-access-dxw5l\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.224962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.224790    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.224962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.224810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-installation-pull-secrets\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.224962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.224856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-trusted-ca\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.224962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.224881    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-certificates\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.225344 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.225318    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-bound-sa-token\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.225444 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.225426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-image-registry-private-configuration\") pod \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\" (UID: \"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5\") "
Jul 22 09:19:35.225510 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.225315    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 09:19:35.225564 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.225329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 09:19:35.225705 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.225683    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-trusted-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.225863 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.225737    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-certificates\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.227553 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.227527    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:19:35.227661 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.227638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:19:35.227725 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.227638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:19:35.227765 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.227725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-kube-api-access-dxw5l" (OuterVolumeSpecName: "kube-api-access-dxw5l") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "kube-api-access-dxw5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:19:35.227894 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.227877    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:19:35.232792 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.232751    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" (UID: "56623b2a-1131-4191-a1e8-5bfb8cbdd0a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 09:19:35.326444 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.326416    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-ca-trust-extracted\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.326444 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.326439    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxw5l\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-kube-api-access-dxw5l\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.326444 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.326449    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-registry-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.326611 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.326458    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-installation-pull-secrets\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.326611 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.326466    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-bound-sa-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.326611 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.326476    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5-image-registry-private-configuration\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:19:35.471068 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.471027    2560 generic.go:356] "Generic (PLEG): container finished" podID="56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" containerID="3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b" exitCode=0
Jul 22 09:19:35.471257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.471077    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-658f897b77-7974t"
Jul 22 09:19:35.471257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.471116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-658f897b77-7974t" event={"ID":"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5","Type":"ContainerDied","Data":"3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b"}
Jul 22 09:19:35.471257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.471206    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-658f897b77-7974t" event={"ID":"56623b2a-1131-4191-a1e8-5bfb8cbdd0a5","Type":"ContainerDied","Data":"59455ed25b5c0b7c78ed711196a9cd0ce7ec8b95cf225882846344ad3ab3efb0"}
Jul 22 09:19:35.471257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.471240    2560 scope.go:117] "RemoveContainer" containerID="3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b"
Jul 22 09:19:35.473206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.473178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l26m8" event={"ID":"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e","Type":"ContainerStarted","Data":"7dfc2913f304069a6ce8068e3bd266ed2a3368f3a595e0659f07a66d0b39c993"}
Jul 22 09:19:35.473318 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.473232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l26m8" event={"ID":"a8fc41ff-3862-4b3e-b5af-843d4c3e2d3e","Type":"ContainerStarted","Data":"d5ec6fedf0b514937f59fbf30a4e3368c72bd5aa45f81f705617825a975b78b4"}
Jul 22 09:19:35.481393 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.481372    2560 scope.go:117] "RemoveContainer" containerID="3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b"
Jul 22 09:19:35.482006 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:19:35.481983    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b\": container with ID starting with 3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b not found: ID does not exist" containerID="3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b"
Jul 22 09:19:35.482089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.482013    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b"} err="failed to get container status \"3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b\": rpc error: code = NotFound desc = could not find container \"3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b\": container with ID starting with 3c441972d2363809406659764bb50b97e362b8a7dd00a7851f367f43b13ad70b not found: ID does not exist"
Jul 22 09:19:35.497692 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.497621    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l26m8" podStartSLOduration=129.490186468 podStartE2EDuration="2m10.497608532s" totalImagesPullingTime="1.007422064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:19:35.49679041 +0000 UTC m=+131.090782565" watchObservedRunningTime="2026-07-22 09:19:35.497608532 +0000 UTC m=+131.091600675"
Jul 22 09:19:35.512421 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.512396    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-658f897b77-7974t"]
Jul 22 09:19:35.519598 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:35.519579    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-658f897b77-7974t"]
Jul 22 09:19:36.908171 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:36.908132    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" path="/var/lib/kubelet/pods/56623b2a-1131-4191-a1e8-5bfb8cbdd0a5/volumes"
Jul 22 09:19:43.506089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:43.506054    2560 generic.go:356] "Generic (PLEG): container finished" podID="50b861eb-db72-43e2-a1d0-fe4f858dafa3" containerID="1a9e423977b7a65766ea5383337ad0069a164318f4943652b1833df703738b88" exitCode=0
Jul 22 09:19:43.506533 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:43.506109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74" event={"ID":"50b861eb-db72-43e2-a1d0-fe4f858dafa3","Type":"ContainerDied","Data":"1a9e423977b7a65766ea5383337ad0069a164318f4943652b1833df703738b88"}
Jul 22 09:19:43.506533 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:43.506473    2560 scope.go:117] "RemoveContainer" containerID="1a9e423977b7a65766ea5383337ad0069a164318f4943652b1833df703738b88"
Jul 22 09:19:44.511907 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:44.511873    2560 generic.go:356] "Generic (PLEG): container finished" podID="6ad6bdb6-50e4-441a-aa6f-164b1a9a9288" containerID="3550db1781ab7200b2f33bb756e02f2f09001ded53d0541e2d349ee662f2ddb6" exitCode=0
Jul 22 09:19:44.512381 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:44.511953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7r88r" event={"ID":"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288","Type":"ContainerDied","Data":"3550db1781ab7200b2f33bb756e02f2f09001ded53d0541e2d349ee662f2ddb6"}
Jul 22 09:19:44.512381 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:44.512345    2560 scope.go:117] "RemoveContainer" containerID="3550db1781ab7200b2f33bb756e02f2f09001ded53d0541e2d349ee662f2ddb6"
Jul 22 09:19:44.513878 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:44.513856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7rd74" event={"ID":"50b861eb-db72-43e2-a1d0-fe4f858dafa3","Type":"ContainerStarted","Data":"025bb85a3455d74440457dd0e09fc082a89b1765561ab2b13491f828c642f6a4"}
Jul 22 09:19:45.519788 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:45.519755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7r88r" event={"ID":"6ad6bdb6-50e4-441a-aa6f-164b1a9a9288","Type":"ContainerStarted","Data":"ad8a617280937d992b4473f0b3d0a4c073aacfd2697813cd1e20da22d49f6a2d"}
Jul 22 09:19:53.551046 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:53.551012    2560 generic.go:356] "Generic (PLEG): container finished" podID="3eb6ec58-b55e-44fc-b256-101d8421f3ae" containerID="b30a62354e19baa7a3d70b66520c33cc2615f6a17f0e091f05300664d3b41d22" exitCode=0
Jul 22 09:19:53.551423 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:53.551093    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn" event={"ID":"3eb6ec58-b55e-44fc-b256-101d8421f3ae","Type":"ContainerDied","Data":"b30a62354e19baa7a3d70b66520c33cc2615f6a17f0e091f05300664d3b41d22"}
Jul 22 09:19:53.551463 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:53.551431    2560 scope.go:117] "RemoveContainer" containerID="b30a62354e19baa7a3d70b66520c33cc2615f6a17f0e091f05300664d3b41d22"
Jul 22 09:19:54.556163 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:19:54.556131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-zw5hn" event={"ID":"3eb6ec58-b55e-44fc-b256-101d8421f3ae","Type":"ContainerStarted","Data":"a0a54a762a791a6572d12deed60dbecf5fdf8eb2499f7ac18c6b0149178682f4"}
Jul 22 09:22:24.760307 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:22:24.760274    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:22:24.772067 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:22:24.772046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:22:24.773576 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:22:24.773560    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 09:23:32.757070 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.756996    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"]
Jul 22 09:23:32.757486 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.757264    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" containerName="registry"
Jul 22 09:23:32.757486 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.757274    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" containerName="registry"
Jul 22 09:23:32.757486 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.757329    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56623b2a-1131-4191-a1e8-5bfb8cbdd0a5" containerName="registry"
Jul 22 09:23:32.759980 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.759964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.762519 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.762498    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 09:23:32.762726 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.762707    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fx9bz\""
Jul 22 09:23:32.762726 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.762717    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 09:23:32.762906 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.762725    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 09:23:32.763004 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.762990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 09:23:32.773403 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.773382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"]
Jul 22 09:23:32.861416 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.861385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30021c60-c08b-497a-952f-91a9e229e670-manifests\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.861416 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.861419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30021c60-c08b-497a-952f-91a9e229e670-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.861613 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.861444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30021c60-c08b-497a-952f-91a9e229e670-tmp\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.861613 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.861529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30021c60-c08b-497a-952f-91a9e229e670-webhook-cert\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.861613 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.861556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxrm6\" (UniqueName: \"kubernetes.io/projected/30021c60-c08b-497a-952f-91a9e229e670-kube-api-access-zxrm6\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.962676 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.962646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30021c60-c08b-497a-952f-91a9e229e670-manifests\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.962874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.962683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30021c60-c08b-497a-952f-91a9e229e670-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.962874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.962711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30021c60-c08b-497a-952f-91a9e229e670-tmp\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.962874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.962758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30021c60-c08b-497a-952f-91a9e229e670-webhook-cert\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.962874 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.962778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxrm6\" (UniqueName: \"kubernetes.io/projected/30021c60-c08b-497a-952f-91a9e229e670-kube-api-access-zxrm6\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.963103 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.963076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30021c60-c08b-497a-952f-91a9e229e670-manifests\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.965041 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.965016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30021c60-c08b-497a-952f-91a9e229e670-tmp\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.965255 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.965236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30021c60-c08b-497a-952f-91a9e229e670-webhook-cert\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.965297 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.965234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30021c60-c08b-497a-952f-91a9e229e670-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:32.971200 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:32.971179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxrm6\" (UniqueName: \"kubernetes.io/projected/30021c60-c08b-497a-952f-91a9e229e670-kube-api-access-zxrm6\") pod \"opendatahub-operator-controller-manager-67797c6b-q88lf\" (UID: \"30021c60-c08b-497a-952f-91a9e229e670\") " pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:33.070329 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:33.070266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:33.208360 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:33.208330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"]
Jul 22 09:23:33.211960 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:23:33.211935    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30021c60_c08b_497a_952f_91a9e229e670.slice/crio-5aa54d4ef06f7e19e36b3d4e9b36671d153576f8996d7b42dd9345326fb90690 WatchSource:0}: Error finding container 5aa54d4ef06f7e19e36b3d4e9b36671d153576f8996d7b42dd9345326fb90690: Status 404 returned error can't find the container with id 5aa54d4ef06f7e19e36b3d4e9b36671d153576f8996d7b42dd9345326fb90690
Jul 22 09:23:33.213752 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:33.213736    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 09:23:33.353899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:33.353806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf" event={"ID":"30021c60-c08b-497a-952f-91a9e229e670","Type":"ContainerStarted","Data":"5aa54d4ef06f7e19e36b3d4e9b36671d153576f8996d7b42dd9345326fb90690"}
Jul 22 09:23:36.369220 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:36.369181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf" event={"ID":"30021c60-c08b-497a-952f-91a9e229e670","Type":"ContainerStarted","Data":"b9fed02d36d0433092b6579276bcad67030d5e1d33ac22889a8a8d7d5d6f26da"}
Jul 22 09:23:37.374308 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:37.374271    2560 generic.go:356] "Generic (PLEG): container finished" podID="30021c60-c08b-497a-952f-91a9e229e670" containerID="b9fed02d36d0433092b6579276bcad67030d5e1d33ac22889a8a8d7d5d6f26da" exitCode=0
Jul 22 09:23:37.374588 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:37.374333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf" event={"ID":"30021c60-c08b-497a-952f-91a9e229e670","Type":"ContainerDied","Data":"b9fed02d36d0433092b6579276bcad67030d5e1d33ac22889a8a8d7d5d6f26da"}
Jul 22 09:23:38.380124 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:38.380086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf" event={"ID":"30021c60-c08b-497a-952f-91a9e229e670","Type":"ContainerStarted","Data":"53dae78c50210ae5bf30c0e82eaeb58f61beb093f72533d905356d963410f267"}
Jul 22 09:23:38.380616 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:38.380247    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:38.405023 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:38.404978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf" podStartSLOduration=1.989200808 podStartE2EDuration="6.404953633s" totalImagesPullingTime="3.3873104s" totalInitContainerRuntime="1.028442425s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:23:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:23:38.404523416 +0000 UTC m=+373.998515596" watchObservedRunningTime="2026-07-22 09:23:38.404953633 +0000 UTC m=+373.998945777"
Jul 22 09:23:49.385984 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:49.385950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67797c6b-q88lf"
Jul 22 09:23:51.927498 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:51.927466    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"]
Jul 22 09:23:51.939468 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:51.939436    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:51.943774 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:51.943749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 09:23:51.943774 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:51.943766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 09:23:51.949571 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:51.949549    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"]
Jul 22 09:23:52.107191 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.107148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3a12cd-85b1-4062-918c-c366f5d9c972-tls-certs\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.107191 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.107195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de3a12cd-85b1-4062-918c-c366f5d9c972-tmp\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.107434 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.107218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpxpd\" (UniqueName: \"kubernetes.io/projected/de3a12cd-85b1-4062-918c-c366f5d9c972-kube-api-access-jpxpd\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.207705 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.207622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3a12cd-85b1-4062-918c-c366f5d9c972-tls-certs\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.207705 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.207670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de3a12cd-85b1-4062-918c-c366f5d9c972-tmp\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.207705 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.207695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpxpd\" (UniqueName: \"kubernetes.io/projected/de3a12cd-85b1-4062-918c-c366f5d9c972-kube-api-access-jpxpd\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.207958 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:23:52.207803    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 22 09:23:52.207958 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:23:52.207911    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3a12cd-85b1-4062-918c-c366f5d9c972-tls-certs podName:de3a12cd-85b1-4062-918c-c366f5d9c972 nodeName:}" failed. No retries permitted until 2026-07-22 09:23:52.707887327 +0000 UTC m=+388.301879453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de3a12cd-85b1-4062-918c-c366f5d9c972-tls-certs") pod "kube-auth-proxy-68755c4d9c-ctpzh" (UID: "de3a12cd-85b1-4062-918c-c366f5d9c972") : secret "kube-auth-proxy-tls" not found
Jul 22 09:23:52.209955 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.209930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de3a12cd-85b1-4062-918c-c366f5d9c972-tmp\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.229412 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.229372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpxpd\" (UniqueName: \"kubernetes.io/projected/de3a12cd-85b1-4062-918c-c366f5d9c972-kube-api-access-jpxpd\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.283477 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.283447    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pgnbj"]
Jul 22 09:23:52.285873 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.285857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:52.288643 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.288621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 09:23:52.288765 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.288626    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xmb9g\""
Jul 22 09:23:52.302745 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.302707    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pgnbj"]
Jul 22 09:23:52.409088 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.409054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c82ad94-e361-4cfc-9321-fd3960948dd2-cert\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:52.409408 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.409379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ftk\" (UniqueName: \"kubernetes.io/projected/2c82ad94-e361-4cfc-9321-fd3960948dd2-kube-api-access-f4ftk\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:52.510786 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.510707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c82ad94-e361-4cfc-9321-fd3960948dd2-cert\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:52.510786 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.510778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ftk\" (UniqueName: \"kubernetes.io/projected/2c82ad94-e361-4cfc-9321-fd3960948dd2-kube-api-access-f4ftk\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:52.510989 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:23:52.510887    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 09:23:52.510989 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:23:52.510963    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c82ad94-e361-4cfc-9321-fd3960948dd2-cert podName:2c82ad94-e361-4cfc-9321-fd3960948dd2 nodeName:}" failed. No retries permitted until 2026-07-22 09:23:53.010943873 +0000 UTC m=+388.604936006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2c82ad94-e361-4cfc-9321-fd3960948dd2-cert") pod "odh-model-controller-7998c67dc4-pgnbj" (UID: "2c82ad94-e361-4cfc-9321-fd3960948dd2") : secret "odh-model-controller-webhook-cert" not found
Jul 22 09:23:52.521013 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.520980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ftk\" (UniqueName: \"kubernetes.io/projected/2c82ad94-e361-4cfc-9321-fd3960948dd2-kube-api-access-f4ftk\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:52.712533 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.712490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3a12cd-85b1-4062-918c-c366f5d9c972-tls-certs\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.715172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.715144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3a12cd-85b1-4062-918c-c366f5d9c972-tls-certs\") pod \"kube-auth-proxy-68755c4d9c-ctpzh\" (UID: \"de3a12cd-85b1-4062-918c-c366f5d9c972\") " pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.849890 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.849787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"
Jul 22 09:23:52.990157 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:52.990066    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh"]
Jul 22 09:23:52.993064 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:23:52.993039    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3a12cd_85b1_4062_918c_c366f5d9c972.slice/crio-652ff66c954f4107ce4d442f8a8644324e2d9cebfd56ae54c30ee8023b825fb4 WatchSource:0}: Error finding container 652ff66c954f4107ce4d442f8a8644324e2d9cebfd56ae54c30ee8023b825fb4: Status 404 returned error can't find the container with id 652ff66c954f4107ce4d442f8a8644324e2d9cebfd56ae54c30ee8023b825fb4
Jul 22 09:23:53.014566 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.014544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c82ad94-e361-4cfc-9321-fd3960948dd2-cert\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:53.017030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.017005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c82ad94-e361-4cfc-9321-fd3960948dd2-cert\") pod \"odh-model-controller-7998c67dc4-pgnbj\" (UID: \"2c82ad94-e361-4cfc-9321-fd3960948dd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:53.198026 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.197989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:53.356669 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.356633    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tjxzw"]
Jul 22 09:23:53.359690 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.359666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.362424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.362401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pgnbj"]
Jul 22 09:23:53.364148 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.364133    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 09:23:53.366131 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:23:53.366109    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c82ad94_e361_4cfc_9321_fd3960948dd2.slice/crio-c4d41f3179372ae35e3b4cae09d7635c2409e0997c5355c0751846bdffc506ee WatchSource:0}: Error finding container c4d41f3179372ae35e3b4cae09d7635c2409e0997c5355c0751846bdffc506ee: Status 404 returned error can't find the container with id c4d41f3179372ae35e3b4cae09d7635c2409e0997c5355c0751846bdffc506ee
Jul 22 09:23:53.381808 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.381787    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tjxzw"]
Jul 22 09:23:53.393292 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.393265    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"]
Jul 22 09:23:53.395469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.395452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.398118 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.398097    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 09:23:53.398335 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.398318    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sn5lp\""
Jul 22 09:23:53.398394 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.398373    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 09:23:53.398580 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.398567    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 09:23:53.402824 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.402807    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 09:23:53.423292 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.423260    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"]
Jul 22 09:23:53.445131 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.445097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh" event={"ID":"de3a12cd-85b1-4062-918c-c366f5d9c972","Type":"ContainerStarted","Data":"652ff66c954f4107ce4d442f8a8644324e2d9cebfd56ae54c30ee8023b825fb4"}
Jul 22 09:23:53.446454 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.446429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj" event={"ID":"2c82ad94-e361-4cfc-9321-fd3960948dd2","Type":"ContainerStarted","Data":"c4d41f3179372ae35e3b4cae09d7635c2409e0997c5355c0751846bdffc506ee"}
Jul 22 09:23:53.520379 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wl5x\" (UniqueName: \"kubernetes.io/projected/57c7aec0-484b-4983-80e1-cb64e6c4bad3-kube-api-access-7wl5x\") pod \"model-serving-api-54d89bd5fc-tjxzw\" (UID: \"57c7aec0-484b-4983-80e1-cb64e6c4bad3\") " pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.520379 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c7aec0-484b-4983-80e1-cb64e6c4bad3-tls-certs\") pod \"model-serving-api-54d89bd5fc-tjxzw\" (UID: \"57c7aec0-484b-4983-80e1-cb64e6c4bad3\") " pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-cacerts\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-local-certs\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-token\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.520593 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.520556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mgvl\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-kube-api-access-6mgvl\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.621484 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-cacerts\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.621484 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-local-certs\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-token\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mgvl\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-kube-api-access-6mgvl\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.621808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wl5x\" (UniqueName: \"kubernetes.io/projected/57c7aec0-484b-4983-80e1-cb64e6c4bad3-kube-api-access-7wl5x\") pod \"model-serving-api-54d89bd5fc-tjxzw\" (UID: \"57c7aec0-484b-4983-80e1-cb64e6c4bad3\") " pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.622172 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.622014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c7aec0-484b-4983-80e1-cb64e6c4bad3-tls-certs\") pod \"model-serving-api-54d89bd5fc-tjxzw\" (UID: \"57c7aec0-484b-4983-80e1-cb64e6c4bad3\") " pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.622583 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.622232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.624321 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.624274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-cacerts\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.624528 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.624503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.624612 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.624557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.624650 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.624635    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-local-certs\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.624785 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.624762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c7aec0-484b-4983-80e1-cb64e6c4bad3-tls-certs\") pod \"model-serving-api-54d89bd5fc-tjxzw\" (UID: \"57c7aec0-484b-4983-80e1-cb64e6c4bad3\") " pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.630934 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.630914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wl5x\" (UniqueName: \"kubernetes.io/projected/57c7aec0-484b-4983-80e1-cb64e6c4bad3-kube-api-access-7wl5x\") pod \"model-serving-api-54d89bd5fc-tjxzw\" (UID: \"57c7aec0-484b-4983-80e1-cb64e6c4bad3\") " pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.631041 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.630929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mgvl\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-kube-api-access-6mgvl\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.631152 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.631135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-token\") pod \"istiod-openshift-gateway-7574459656-95zrs\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.677182 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.677154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:53.704571 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.704543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:53.842123 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.842040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tjxzw"]
Jul 22 09:23:53.844330 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:23:53.844298    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c7aec0_484b_4983_80e1_cb64e6c4bad3.slice/crio-4532148b8f2fe4132e8914621c6c5f720d400c49c9f11d2bd1d22a456e03dbcd WatchSource:0}: Error finding container 4532148b8f2fe4132e8914621c6c5f720d400c49c9f11d2bd1d22a456e03dbcd: Status 404 returned error can't find the container with id 4532148b8f2fe4132e8914621c6c5f720d400c49c9f11d2bd1d22a456e03dbcd
Jul 22 09:23:53.877450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:53.877351    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"]
Jul 22 09:23:53.879486 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:23:53.879460    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d2ddbf_dc9e_4979_b235_3bc260ece7dc.slice/crio-134f7528272879866ab033dad7f8bfce90b707fff3d432864e782e9b36cd3d07 WatchSource:0}: Error finding container 134f7528272879866ab033dad7f8bfce90b707fff3d432864e782e9b36cd3d07: Status 404 returned error can't find the container with id 134f7528272879866ab033dad7f8bfce90b707fff3d432864e782e9b36cd3d07
Jul 22 09:23:54.456634 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:54.456513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw" event={"ID":"57c7aec0-484b-4983-80e1-cb64e6c4bad3","Type":"ContainerStarted","Data":"4532148b8f2fe4132e8914621c6c5f720d400c49c9f11d2bd1d22a456e03dbcd"}
Jul 22 09:23:54.460185 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:54.460154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" event={"ID":"08d2ddbf-dc9e-4979-b235-3bc260ece7dc","Type":"ContainerStarted","Data":"134f7528272879866ab033dad7f8bfce90b707fff3d432864e782e9b36cd3d07"}
Jul 22 09:23:58.709366 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:58.709322    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 09:23:58.709638 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:58.709408    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 09:23:59.486568 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.486522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj" event={"ID":"2c82ad94-e361-4cfc-9321-fd3960948dd2","Type":"ContainerStarted","Data":"afc0da29113d40d1a6b927a460ed9d4f321d5b7e500a3637a191d845b0579370"}
Jul 22 09:23:59.486740 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.486624    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:23:59.488171 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.488143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh" event={"ID":"de3a12cd-85b1-4062-918c-c366f5d9c972","Type":"ContainerStarted","Data":"57db42926db4d0fe57bbd2e8ee72899002479c7993392a2a5c30d230a647b7b7"}
Jul 22 09:23:59.489861 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.489820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw" event={"ID":"57c7aec0-484b-4983-80e1-cb64e6c4bad3","Type":"ContainerStarted","Data":"c290397cf1b8742cffc101c75a7ee7e9b86ab18a4e3a19bfb3e5189e6adbf606"}
Jul 22 09:23:59.490000 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.489980    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:23:59.491682 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.491647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" event={"ID":"08d2ddbf-dc9e-4979-b235-3bc260ece7dc","Type":"ContainerStarted","Data":"a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c"}
Jul 22 09:23:59.491779 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.491697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:23:59.493536 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.493497    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-95zrs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 09:23:59.493608 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.493562    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 09:23:59.508149 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.508100    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj" podStartSLOduration=2.120542108 podStartE2EDuration="7.508083968s" totalImagesPullingTime="5.38754186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:23:59.506632302 +0000 UTC m=+395.100624446" watchObservedRunningTime="2026-07-22 09:23:59.508083968 +0000 UTC m=+395.102076111"
Jul 22 09:23:59.528903 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.528862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" podStartSLOduration=1.701522982 podStartE2EDuration="6.528849713s" totalImagesPullingTime="4.827326731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:23:59.527770683 +0000 UTC m=+395.121762829" watchObservedRunningTime="2026-07-22 09:23:59.528849713 +0000 UTC m=+395.122841847"
Jul 22 09:23:59.548362 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.548328    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68755c4d9c-ctpzh" podStartSLOduration=2.840259562 podStartE2EDuration="8.548316046s" totalImagesPullingTime="5.708056484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:23:59.547041061 +0000 UTC m=+395.141033207" watchObservedRunningTime="2026-07-22 09:23:59.548316046 +0000 UTC m=+395.142308188"
Jul 22 09:23:59.566238 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:23:59.566192    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw" podStartSLOduration=1.7045362480000001 podStartE2EDuration="6.566181493s" totalImagesPullingTime="4.861645245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:23:59.565196156 +0000 UTC m=+395.159188320" watchObservedRunningTime="2026-07-22 09:23:59.566181493 +0000 UTC m=+395.160173635"
Jul 22 09:24:00.497596 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.497561    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-95zrs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 09:24:00.498079 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.497777    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 09:24:00.727962 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.727924    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"]
Jul 22 09:24:00.731603 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.731581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.734191 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.734168    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-br596\""
Jul 22 09:24:00.742830 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.742799    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"]
Jul 22 09:24:00.795980 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.795913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796087 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.795996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796087 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796087 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796087 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqv5f\" (UniqueName: \"kubernetes.io/projected/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-kube-api-access-dqv5f\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.796310 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.796233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897345 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqv5f\" (UniqueName: \"kubernetes.io/projected/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-kube-api-access-dqv5f\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897772 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897772 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897893 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897893 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897999 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.897999 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.897989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.898308 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.898287    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.899743 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.899722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.899815 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.899800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.906513 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.906490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:00.906965 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:00.906941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqv5f\" (UniqueName: \"kubernetes.io/projected/c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6-kube-api-access-dqv5f\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46ncxs\" (UID: \"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:01.041990 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:01.041960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:01.194330 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:01.194089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"]
Jul 22 09:24:01.198289 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:24:01.198251    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a3d121_9ffe_4eb7_8b98_9db4fbd2cfa6.slice/crio-9fcfc9d748cc8051afc79738a7c0a965e1a0401ec4fecf0d594d360e7ea556f6 WatchSource:0}: Error finding container 9fcfc9d748cc8051afc79738a7c0a965e1a0401ec4fecf0d594d360e7ea556f6: Status 404 returned error can't find the container with id 9fcfc9d748cc8051afc79738a7c0a965e1a0401ec4fecf0d594d360e7ea556f6
Jul 22 09:24:01.502274 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:01.502240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs" event={"ID":"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6","Type":"ContainerStarted","Data":"9fcfc9d748cc8051afc79738a7c0a965e1a0401ec4fecf0d594d360e7ea556f6"}
Jul 22 09:24:03.498750 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.498037    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:24:03.660738 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.660705    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"]
Jul 22 09:24:03.669518 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.669494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:03.672255 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.672179    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h2jzv\""
Jul 22 09:24:03.672378 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.672291    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 09:24:03.684178 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.683936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"]
Jul 22 09:24:03.685785 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.685765    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"]
Jul 22 09:24:03.689124 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.689103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:03.691639 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.691464    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 09:24:03.691639 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.691578    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ghkwm\""
Jul 22 09:24:03.702845 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.702723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"]
Jul 22 09:24:03.721268 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.721244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvprt\" (UniqueName: \"kubernetes.io/projected/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-kube-api-access-cvprt\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:03.721827 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.721802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be13115f-8f27-4516-abd3-7e926858c4a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:03.722029 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.722009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:03.722221 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.722128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlnjd\" (UniqueName: \"kubernetes.io/projected/be13115f-8f27-4516-abd3-7e926858c4a1-kube-api-access-dlnjd\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:03.823457 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.823372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvprt\" (UniqueName: \"kubernetes.io/projected/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-kube-api-access-cvprt\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:03.823702 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.823472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be13115f-8f27-4516-abd3-7e926858c4a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:03.823702 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.823523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:03.823702 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.823550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlnjd\" (UniqueName: \"kubernetes.io/projected/be13115f-8f27-4516-abd3-7e926858c4a1-kube-api-access-dlnjd\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:03.823702 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:24:03.823634    2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 22 09:24:03.823702 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:24:03.823697    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be13115f-8f27-4516-abd3-7e926858c4a1-cert podName:be13115f-8f27-4516-abd3-7e926858c4a1 nodeName:}" failed. No retries permitted until 2026-07-22 09:24:04.323676938 +0000 UTC m=+399.917669072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be13115f-8f27-4516-abd3-7e926858c4a1-cert") pod "kserve-controller-manager-d6f4b65b8-hs4qq" (UID: "be13115f-8f27-4516-abd3-7e926858c4a1") : secret "kserve-webhook-server-cert" not found
Jul 22 09:24:03.823991 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:24:03.823780    2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 22 09:24:03.823991 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:24:03.823868    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-cert podName:67ed7ab6-92a2-4a27-88e4-bffed11ae9cc nodeName:}" failed. No retries permitted until 2026-07-22 09:24:04.323829207 +0000 UTC m=+399.917821332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-cert") pod "llmisvc-controller-manager-777c6bd7d5-wm7xw" (UID: "67ed7ab6-92a2-4a27-88e4-bffed11ae9cc") : secret "llmisvc-webhook-server-cert" not found
Jul 22 09:24:03.836250 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.836225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlnjd\" (UniqueName: \"kubernetes.io/projected/be13115f-8f27-4516-abd3-7e926858c4a1-kube-api-access-dlnjd\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:03.836888 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:03.836863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvprt\" (UniqueName: \"kubernetes.io/projected/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-kube-api-access-cvprt\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:04.157124 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.157094    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 09:24:04.157193 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.157166    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 09:24:04.157227 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.157198    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 09:24:04.328600 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.328559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be13115f-8f27-4516-abd3-7e926858c4a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:04.328600 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.328608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:04.331044 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.331020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67ed7ab6-92a2-4a27-88e4-bffed11ae9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wm7xw\" (UID: \"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:04.331433 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.331409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be13115f-8f27-4516-abd3-7e926858c4a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-hs4qq\" (UID: \"be13115f-8f27-4516-abd3-7e926858c4a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:04.517926 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.517856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs" event={"ID":"c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6","Type":"ContainerStarted","Data":"33009e314e0371ca388445c3dc71192b188bf3c9adc3d3faf9e989e802b654cc"}
Jul 22 09:24:04.541225 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.541180    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs" podStartSLOduration=1.584659425 podStartE2EDuration="4.541164924s" totalImagesPullingTime="2.956505499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:24:04.540335073 +0000 UTC m=+400.134327217" watchObservedRunningTime="2026-07-22 09:24:04.541164924 +0000 UTC m=+400.135157065"
Jul 22 09:24:04.586433 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.586406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:04.606362 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.606340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:04.762438 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.762407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"]
Jul 22 09:24:04.765229 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:24:04.765189    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe13115f_8f27_4516_abd3_7e926858c4a1.slice/crio-505ffbdc7a44c7f31edb59c4d099305538b9da1b5c9444552edc118c3f3b05e2 WatchSource:0}: Error finding container 505ffbdc7a44c7f31edb59c4d099305538b9da1b5c9444552edc118c3f3b05e2: Status 404 returned error can't find the container with id 505ffbdc7a44c7f31edb59c4d099305538b9da1b5c9444552edc118c3f3b05e2
Jul 22 09:24:04.784622 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:04.784558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"]
Jul 22 09:24:04.786449 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:24:04.786427    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67ed7ab6_92a2_4a27_88e4_bffed11ae9cc.slice/crio-0c7a4e93c479cb42598925977738ebf9e091340b40a2a1e822ff9d2e33a870d7 WatchSource:0}: Error finding container 0c7a4e93c479cb42598925977738ebf9e091340b40a2a1e822ff9d2e33a870d7: Status 404 returned error can't find the container with id 0c7a4e93c479cb42598925977738ebf9e091340b40a2a1e822ff9d2e33a870d7
Jul 22 09:24:05.042319 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.042232    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:05.047005 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.046981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:05.526232 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.526193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw" event={"ID":"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc","Type":"ContainerStarted","Data":"0c7a4e93c479cb42598925977738ebf9e091340b40a2a1e822ff9d2e33a870d7"}
Jul 22 09:24:05.528116 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.528079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq" event={"ID":"be13115f-8f27-4516-abd3-7e926858c4a1","Type":"ContainerStarted","Data":"505ffbdc7a44c7f31edb59c4d099305538b9da1b5c9444552edc118c3f3b05e2"}
Jul 22 09:24:05.528360 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.528340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:05.529321 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.529301    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46ncxs"
Jul 22 09:24:05.952888 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.952855    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"]
Jul 22 09:24:05.953134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:05.953077    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerName="discovery" containerID="cri-o://a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c" gracePeriod=30
Jul 22 09:24:06.377314 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.377291    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:24:06.454061 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.453990    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-ca-configmap\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454209 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454078    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-dns-cert\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454209 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454121    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-kubeconfig\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454209 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-cacerts\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454209 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-token\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454429 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mgvl\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-kube-api-access-6mgvl\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454429 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454270    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-local-certs\") pod \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\" (UID: \"08d2ddbf-dc9e-4979-b235-3bc260ece7dc\") "
Jul 22 09:24:06.454534 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 09:24:06.454534 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.454521    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-ca-configmap\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.457139 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.456857    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-cacerts" (OuterVolumeSpecName: "cacerts") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:24:06.457139 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.456955    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:24:06.457358 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.457232    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:24:06.457673 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.457646    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-kube-api-access-6mgvl" (OuterVolumeSpecName: "kube-api-access-6mgvl") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "kube-api-access-6mgvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:24:06.457925 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.457904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:24:06.458653 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.458619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-local-certs" (OuterVolumeSpecName: "local-certs") pod "08d2ddbf-dc9e-4979-b235-3bc260ece7dc" (UID: "08d2ddbf-dc9e-4979-b235-3bc260ece7dc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 09:24:06.534364 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.534335    2560 generic.go:356] "Generic (PLEG): container finished" podID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerID="a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c" exitCode=0
Jul 22 09:24:06.534744 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.534390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"
Jul 22 09:24:06.534744 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.534422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" event={"ID":"08d2ddbf-dc9e-4979-b235-3bc260ece7dc","Type":"ContainerDied","Data":"a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c"}
Jul 22 09:24:06.534744 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.534485    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-95zrs" event={"ID":"08d2ddbf-dc9e-4979-b235-3bc260ece7dc","Type":"ContainerDied","Data":"134f7528272879866ab033dad7f8bfce90b707fff3d432864e782e9b36cd3d07"}
Jul 22 09:24:06.534744 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.534532    2560 scope.go:117] "RemoveContainer" containerID="a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c"
Jul 22 09:24:06.555394 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.555370    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-cacerts\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.555494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.555398    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.555494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.555415    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mgvl\" (UniqueName: \"kubernetes.io/projected/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-kube-api-access-6mgvl\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.555494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.555424    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-local-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.555494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.555433    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-csr-dns-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.555494 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.555441    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08d2ddbf-dc9e-4979-b235-3bc260ece7dc-istio-kubeconfig\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:06.560269 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.560244    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"]
Jul 22 09:24:06.565011 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.564980    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-95zrs"]
Jul 22 09:24:06.908474 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.908441    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" path="/var/lib/kubelet/pods/08d2ddbf-dc9e-4979-b235-3bc260ece7dc/volumes"
Jul 22 09:24:06.978574 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.978473    2560 scope.go:117] "RemoveContainer" containerID="a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c"
Jul 22 09:24:06.978869 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:24:06.978827    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c\": container with ID starting with a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c not found: ID does not exist" containerID="a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c"
Jul 22 09:24:06.978959 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:06.978878    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c"} err="failed to get container status \"a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c\": rpc error: code = NotFound desc = could not find container \"a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c\": container with ID starting with a104e046f619c260aa4ff2b68cf8b8e47ad61ad9014a78cffd4a9b9644d8246c not found: ID does not exist"
Jul 22 09:24:07.543003 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:07.542960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq" event={"ID":"be13115f-8f27-4516-abd3-7e926858c4a1","Type":"ContainerStarted","Data":"f0d5b8635036c6efef7f89874f8a151a92f347d35d16e4b8b0a831865ca56fa3"}
Jul 22 09:24:07.543535 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:07.543234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:07.583778 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:07.583718    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq" podStartSLOduration=2.326072493 podStartE2EDuration="4.58369808s" totalImagesPullingTime="2.257625587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:24:07.583200289 +0000 UTC m=+403.177192433" watchObservedRunningTime="2026-07-22 09:24:07.58369808 +0000 UTC m=+403.177690225"
Jul 22 09:24:08.549101 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:08.549063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw" event={"ID":"67ed7ab6-92a2-4a27-88e4-bffed11ae9cc","Type":"ContainerStarted","Data":"a4a50a84da5093ee2b6d399336fc4bc1a41ea1e61ff1a440d21cf69f70ab9a79"}
Jul 22 09:24:08.549464 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:08.549145    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:08.570650 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:08.570609    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw" podStartSLOduration=2.58878189 podStartE2EDuration="5.570594646s" totalImagesPullingTime="2.981812756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:24:08.569564238 +0000 UTC m=+404.163556383" watchObservedRunningTime="2026-07-22 09:24:08.570594646 +0000 UTC m=+404.164586788"
Jul 22 09:24:10.499005 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:10.498972    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pgnbj"
Jul 22 09:24:10.501083 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:10.501065    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tjxzw"
Jul 22 09:24:38.554208 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:38.554178    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hs4qq"
Jul 22 09:24:39.556004 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:39.555977    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wm7xw"
Jul 22 09:24:52.885718 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.885632    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2vp6"]
Jul 22 09:24:52.886193 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.886173    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerName="discovery"
Jul 22 09:24:52.886254 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.886197    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerName="discovery"
Jul 22 09:24:52.886329 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.886316    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d2ddbf-dc9e-4979-b235-3bc260ece7dc" containerName="discovery"
Jul 22 09:24:52.888379 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.888354    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:52.891306 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.891281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jjxdd\""
Jul 22 09:24:52.892212 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.892195    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 09:24:52.894549 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.894532    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 09:24:52.916519 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:52.916486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2vp6"]
Jul 22 09:24:53.002068 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.002042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4w8p\" (UniqueName: \"kubernetes.io/projected/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449-kube-api-access-w4w8p\") pod \"kuadrant-operator-catalog-w2vp6\" (UID: \"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449\") " pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:53.102980 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.102958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4w8p\" (UniqueName: \"kubernetes.io/projected/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449-kube-api-access-w4w8p\") pod \"kuadrant-operator-catalog-w2vp6\" (UID: \"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449\") " pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:53.111207 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.111179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4w8p\" (UniqueName: \"kubernetes.io/projected/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449-kube-api-access-w4w8p\") pod \"kuadrant-operator-catalog-w2vp6\" (UID: \"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449\") " pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:53.200212 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.200155    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:53.211091 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.211068    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2vp6"]
Jul 22 09:24:53.327639 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.327580    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2vp6"]
Jul 22 09:24:53.330432 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:24:53.330394    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7421dcca_5c15_4ebb_b4c1_9ef9ed2de449.slice/crio-7f94e0db54264dc975979dd75905e028a66bf5838a09826b8d7c032a185b94e6 WatchSource:0}: Error finding container 7f94e0db54264dc975979dd75905e028a66bf5838a09826b8d7c032a185b94e6: Status 404 returned error can't find the container with id 7f94e0db54264dc975979dd75905e028a66bf5838a09826b8d7c032a185b94e6
Jul 22 09:24:53.421011 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.420988    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9c2vc"]
Jul 22 09:24:53.423652 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.423637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:24:53.432774 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.432754    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9c2vc"]
Jul 22 09:24:53.507143 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.507093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj5pf\" (UniqueName: \"kubernetes.io/projected/7682d9e7-6f2c-405d-b02c-1e83b631ec13-kube-api-access-nj5pf\") pod \"kuadrant-operator-catalog-9c2vc\" (UID: \"7682d9e7-6f2c-405d-b02c-1e83b631ec13\") " pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:24:53.607960 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.607938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj5pf\" (UniqueName: \"kubernetes.io/projected/7682d9e7-6f2c-405d-b02c-1e83b631ec13-kube-api-access-nj5pf\") pod \"kuadrant-operator-catalog-9c2vc\" (UID: \"7682d9e7-6f2c-405d-b02c-1e83b631ec13\") " pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:24:53.616288 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.616262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj5pf\" (UniqueName: \"kubernetes.io/projected/7682d9e7-6f2c-405d-b02c-1e83b631ec13-kube-api-access-nj5pf\") pod \"kuadrant-operator-catalog-9c2vc\" (UID: \"7682d9e7-6f2c-405d-b02c-1e83b631ec13\") " pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:24:53.733123 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.733082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:24:53.763904 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.763823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6" event={"ID":"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449","Type":"ContainerStarted","Data":"7f94e0db54264dc975979dd75905e028a66bf5838a09826b8d7c032a185b94e6"}
Jul 22 09:24:53.862559 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:53.862533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9c2vc"]
Jul 22 09:24:53.864583 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:24:53.864557    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7682d9e7_6f2c_405d_b02c_1e83b631ec13.slice/crio-240178442b018491da01e153c229885ec7497ef2e51b6ae2a8d4585cb51a5a0a WatchSource:0}: Error finding container 240178442b018491da01e153c229885ec7497ef2e51b6ae2a8d4585cb51a5a0a: Status 404 returned error can't find the container with id 240178442b018491da01e153c229885ec7497ef2e51b6ae2a8d4585cb51a5a0a
Jul 22 09:24:54.768952 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:54.768919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc" event={"ID":"7682d9e7-6f2c-405d-b02c-1e83b631ec13","Type":"ContainerStarted","Data":"240178442b018491da01e153c229885ec7497ef2e51b6ae2a8d4585cb51a5a0a"}
Jul 22 09:24:55.774191 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:55.774153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc" event={"ID":"7682d9e7-6f2c-405d-b02c-1e83b631ec13","Type":"ContainerStarted","Data":"983436be84171f9e795b2ca46c3134ed82d33a6d3b2abdacddfd20dd9839dbfc"}
Jul 22 09:24:55.775424 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:55.775402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6" event={"ID":"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449","Type":"ContainerStarted","Data":"c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30"}
Jul 22 09:24:55.775523 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:55.775464    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6" podUID="7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" containerName="registry-server" containerID="cri-o://c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30" gracePeriod=2
Jul 22 09:24:55.796372 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:55.796331    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc" podStartSLOduration=1.303489082 podStartE2EDuration="2.796316923s" totalImagesPullingTime="1.492827841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:24:55.795076359 +0000 UTC m=+451.389068515" watchObservedRunningTime="2026-07-22 09:24:55.796316923 +0000 UTC m=+451.390309090"
Jul 22 09:24:55.812518 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:55.812481    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6" podStartSLOduration=1.788556132 podStartE2EDuration="3.812467611s" totalImagesPullingTime="2.023911479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:24:55.811471852 +0000 UTC m=+451.405464020" watchObservedRunningTime="2026-07-22 09:24:55.812467611 +0000 UTC m=+451.406459753"
Jul 22 09:24:56.023238 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.023215    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:56.128466 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.128442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4w8p\" (UniqueName: \"kubernetes.io/projected/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449-kube-api-access-w4w8p\") pod \"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449\" (UID: \"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449\") "
Jul 22 09:24:56.130534 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.130509    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449-kube-api-access-w4w8p" (OuterVolumeSpecName: "kube-api-access-w4w8p") pod "7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" (UID: "7421dcca-5c15-4ebb-b4c1-9ef9ed2de449"). InnerVolumeSpecName "kube-api-access-w4w8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:24:56.229697 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.229672    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4w8p\" (UniqueName: \"kubernetes.io/projected/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449-kube-api-access-w4w8p\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:24:56.780818 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.780789    2560 generic.go:356] "Generic (PLEG): container finished" podID="7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" containerID="c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30" exitCode=0
Jul 22 09:24:56.781206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.780857    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6"
Jul 22 09:24:56.781206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.780879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6" event={"ID":"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449","Type":"ContainerDied","Data":"c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30"}
Jul 22 09:24:56.781206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.780964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2vp6" event={"ID":"7421dcca-5c15-4ebb-b4c1-9ef9ed2de449","Type":"ContainerDied","Data":"7f94e0db54264dc975979dd75905e028a66bf5838a09826b8d7c032a185b94e6"}
Jul 22 09:24:56.781206 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.780991    2560 scope.go:117] "RemoveContainer" containerID="c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30"
Jul 22 09:24:56.789863 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.789826    2560 scope.go:117] "RemoveContainer" containerID="c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30"
Jul 22 09:24:56.790123 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:24:56.790104    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30\": container with ID starting with c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30 not found: ID does not exist" containerID="c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30"
Jul 22 09:24:56.790185 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.790136    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30"} err="failed to get container status \"c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30\": rpc error: code = NotFound desc = could not find container \"c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30\": container with ID starting with c4a0809c5704630861e89d152be763f5fafd50be5aa3b9b02edf44360d34da30 not found: ID does not exist"
Jul 22 09:24:56.801706 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.801683    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2vp6"]
Jul 22 09:24:56.803905 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.803884    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2vp6"]
Jul 22 09:24:56.908292 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:24:56.908269    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" path="/var/lib/kubelet/pods/7421dcca-5c15-4ebb-b4c1-9ef9ed2de449/volumes"
Jul 22 09:25:03.733422 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:03.733378    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:25:03.733808 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:03.733461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:25:03.755646 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:03.755623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:25:03.832867 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:03.832820    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9c2vc"
Jul 22 09:25:24.837365 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.837335    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"]
Jul 22 09:25:24.837679 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.837632    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" containerName="registry-server"
Jul 22 09:25:24.837679 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.837642    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" containerName="registry-server"
Jul 22 09:25:24.837746 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.837704    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7421dcca-5c15-4ebb-b4c1-9ef9ed2de449" containerName="registry-server"
Jul 22 09:25:24.840176 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.840160    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:24.847768 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.847749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bvf5p\""
Jul 22 09:25:24.923108 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.923083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4g4\" (UniqueName: \"kubernetes.io/projected/1625cfda-658b-42d2-9c9e-67ad78204d7f-kube-api-access-mv4g4\") pod \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" (UID: \"1625cfda-658b-42d2-9c9e-67ad78204d7f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:24.939099 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:24.939068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"]
Jul 22 09:25:25.023627 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:25.023597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4g4\" (UniqueName: \"kubernetes.io/projected/1625cfda-658b-42d2-9c9e-67ad78204d7f-kube-api-access-mv4g4\") pod \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" (UID: \"1625cfda-658b-42d2-9c9e-67ad78204d7f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:25.092214 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:25.092159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4g4\" (UniqueName: \"kubernetes.io/projected/1625cfda-658b-42d2-9c9e-67ad78204d7f-kube-api-access-mv4g4\") pod \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" (UID: \"1625cfda-658b-42d2-9c9e-67ad78204d7f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:25.150350 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:25.150325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:25.300460 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:25.299502    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"]
Jul 22 09:25:25.907185 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:25.907141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh" event={"ID":"1625cfda-658b-42d2-9c9e-67ad78204d7f","Type":"ContainerStarted","Data":"5a85d2ef580c6da149f51a34bc3d96a63e8d97d9093b719e4b1de71082ac22ab"}
Jul 22 09:25:26.912916 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:26.912886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh" event={"ID":"1625cfda-658b-42d2-9c9e-67ad78204d7f","Type":"ContainerStarted","Data":"17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737"}
Jul 22 09:25:26.913257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:26.912961    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:27.003384 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:27.003341    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh" podStartSLOduration=1.689603345 podStartE2EDuration="3.003324954s" totalImagesPullingTime="1.313721609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:27.001485028 +0000 UTC m=+482.595477190" watchObservedRunningTime="2026-07-22 09:25:27.003324954 +0000 UTC m=+482.597317076"
Jul 22 09:25:30.872780 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:30.872738    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"]
Jul 22 09:25:30.880854 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:30.880818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:30.887688 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:30.887666    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mbtvm\""
Jul 22 09:25:30.899286 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:30.899262    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"]
Jul 22 09:25:30.969341 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:30.969313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:30.969486 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:30.969455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7p2q\" (UniqueName: \"kubernetes.io/projected/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-kube-api-access-c7p2q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:31.069753 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.069727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p2q\" (UniqueName: \"kubernetes.io/projected/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-kube-api-access-c7p2q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:31.069892 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.069787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:31.070094 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.070079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:31.084533 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.084506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7p2q\" (UniqueName: \"kubernetes.io/projected/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-kube-api-access-c7p2q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:31.191003 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.190985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:31.330159 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.330137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"]
Jul 22 09:25:31.332656 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:25:31.332628    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd5bcc0_0616_45c3_9ab3_daad50bd2a24.slice/crio-f79d9627774e8292fcec1c1ef457e1083ecbb44333d5fd1f39757c55653bf304 WatchSource:0}: Error finding container f79d9627774e8292fcec1c1ef457e1083ecbb44333d5fd1f39757c55653bf304: Status 404 returned error can't find the container with id f79d9627774e8292fcec1c1ef457e1083ecbb44333d5fd1f39757c55653bf304
Jul 22 09:25:31.935715 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:31.935683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn" event={"ID":"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24","Type":"ContainerStarted","Data":"f79d9627774e8292fcec1c1ef457e1083ecbb44333d5fd1f39757c55653bf304"}
Jul 22 09:25:34.146302 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.146267    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"]
Jul 22 09:25:34.150173 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.150154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:34.153480 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.153456    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bh6mc\""
Jul 22 09:25:34.153480 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.153472    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 09:25:34.167176 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.167150    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"]
Jul 22 09:25:34.196446 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.196414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48nw\" (UniqueName: \"kubernetes.io/projected/04702b35-af37-46ef-8efb-37f1de562e0f-kube-api-access-l48nw\") pod \"dns-operator-controller-manager-864dd78c4c-sh9k7\" (UID: \"04702b35-af37-46ef-8efb-37f1de562e0f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:34.297565 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.297535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48nw\" (UniqueName: \"kubernetes.io/projected/04702b35-af37-46ef-8efb-37f1de562e0f-kube-api-access-l48nw\") pod \"dns-operator-controller-manager-864dd78c4c-sh9k7\" (UID: \"04702b35-af37-46ef-8efb-37f1de562e0f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:34.307140 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.307116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48nw\" (UniqueName: \"kubernetes.io/projected/04702b35-af37-46ef-8efb-37f1de562e0f-kube-api-access-l48nw\") pod \"dns-operator-controller-manager-864dd78c4c-sh9k7\" (UID: \"04702b35-af37-46ef-8efb-37f1de562e0f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:34.460396 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.460329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:34.618785 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.618757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"]
Jul 22 09:25:34.622380 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:25:34.622351    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04702b35_af37_46ef_8efb_37f1de562e0f.slice/crio-5195ce5f1a016e0658fa6aa92e2bb9e1a28bf2e6246e9bf0546c2b3aaf16cd57 WatchSource:0}: Error finding container 5195ce5f1a016e0658fa6aa92e2bb9e1a28bf2e6246e9bf0546c2b3aaf16cd57: Status 404 returned error can't find the container with id 5195ce5f1a016e0658fa6aa92e2bb9e1a28bf2e6246e9bf0546c2b3aaf16cd57
Jul 22 09:25:34.953165 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:34.953133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7" event={"ID":"04702b35-af37-46ef-8efb-37f1de562e0f","Type":"ContainerStarted","Data":"5195ce5f1a016e0658fa6aa92e2bb9e1a28bf2e6246e9bf0546c2b3aaf16cd57"}
Jul 22 09:25:36.963176 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:36.963138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn" event={"ID":"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24","Type":"ContainerStarted","Data":"bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e"}
Jul 22 09:25:36.963628 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:36.963207    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:37.033341 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:37.033280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn" podStartSLOduration=2.363706985 podStartE2EDuration="7.033265472s" totalImagesPullingTime="4.669558487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:37.032750769 +0000 UTC m=+492.626742913" watchObservedRunningTime="2026-07-22 09:25:37.033265472 +0000 UTC m=+492.627257615"
Jul 22 09:25:37.919792 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:37.919766    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:37.969089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:37.969062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7" event={"ID":"04702b35-af37-46ef-8efb-37f1de562e0f","Type":"ContainerStarted","Data":"57c256ac31daf1a0f0dc105aa1577f5274991f56c2e72a8ccb7819e0ebc79944"}
Jul 22 09:25:37.969470 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:37.969249    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:38.182950 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.182854    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7" podStartSLOduration=1.365785213 podStartE2EDuration="4.182825714s" totalImagesPullingTime="2.817040501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:38.015461174 +0000 UTC m=+493.609453318" watchObservedRunningTime="2026-07-22 09:25:38.182825714 +0000 UTC m=+493.776817856"
Jul 22 09:25:38.183698 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.183683    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"]
Jul 22 09:25:38.187040 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.187018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:38.190944 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.190922    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qqqtc\""
Jul 22 09:25:38.208480 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.208459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"]
Jul 22 09:25:38.234291 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.234261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldlzg\" (UniqueName: \"kubernetes.io/projected/043de58b-a326-474f-8492-2de51b7aaf75-kube-api-access-ldlzg\") pod \"authorino-operator-75cc8d5cb7-sjb6r\" (UID: \"043de58b-a326-474f-8492-2de51b7aaf75\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:38.335033 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.335008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldlzg\" (UniqueName: \"kubernetes.io/projected/043de58b-a326-474f-8492-2de51b7aaf75-kube-api-access-ldlzg\") pod \"authorino-operator-75cc8d5cb7-sjb6r\" (UID: \"043de58b-a326-474f-8492-2de51b7aaf75\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:38.348305 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.348278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldlzg\" (UniqueName: \"kubernetes.io/projected/043de58b-a326-474f-8492-2de51b7aaf75-kube-api-access-ldlzg\") pod \"authorino-operator-75cc8d5cb7-sjb6r\" (UID: \"043de58b-a326-474f-8492-2de51b7aaf75\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:38.496969 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.496912    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:38.652585 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.652563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"]
Jul 22 09:25:38.655164 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:25:38.655135    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043de58b_a326_474f_8492_2de51b7aaf75.slice/crio-3998488a58eb691a62c1ffe98f6daec5df447cbeab3eb637024d2ec56dfaab24 WatchSource:0}: Error finding container 3998488a58eb691a62c1ffe98f6daec5df447cbeab3eb637024d2ec56dfaab24: Status 404 returned error can't find the container with id 3998488a58eb691a62c1ffe98f6daec5df447cbeab3eb637024d2ec56dfaab24
Jul 22 09:25:38.974795 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:38.974767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r" event={"ID":"043de58b-a326-474f-8492-2de51b7aaf75","Type":"ContainerStarted","Data":"3998488a58eb691a62c1ffe98f6daec5df447cbeab3eb637024d2ec56dfaab24"}
Jul 22 09:25:41.991280 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:41.991240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r" event={"ID":"043de58b-a326-474f-8492-2de51b7aaf75","Type":"ContainerStarted","Data":"1017425152c7fa700b466e5295260345b3ae5623947030cb041bbbc1de7fe97f"}
Jul 22 09:25:41.991733 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:41.991315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:42.026246 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:42.026199    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r" podStartSLOduration=1.752047917 podStartE2EDuration="4.026184224s" totalImagesPullingTime="2.274136307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:42.025356991 +0000 UTC m=+497.619349137" watchObservedRunningTime="2026-07-22 09:25:42.026184224 +0000 UTC m=+497.620176366"
Jul 22 09:25:47.971083 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:47.971051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:48.977212 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:48.977184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sh9k7"
Jul 22 09:25:50.122587 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.122553    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"]
Jul 22 09:25:50.123005 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.122714    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" containerName="manager" containerID="cri-o://bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e" gracePeriod=2
Jul 22 09:25:50.144356 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.144332    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"]
Jul 22 09:25:50.157207 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.157160    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\": pods \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.170089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.170056    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"]
Jul 22 09:25:50.170318 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.170293    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" containerName="manager" containerID="cri-o://17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737" gracePeriod=2
Jul 22 09:25:50.171861 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.171818    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"]
Jul 22 09:25:50.172195 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.172179    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" containerName="manager"
Jul 22 09:25:50.172195 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.172195    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" containerName="manager"
Jul 22 09:25:50.172330 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.172263    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" containerName="manager"
Jul 22 09:25:50.175190 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.175174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.177437 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.177386    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.183526 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.183508    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"]
Jul 22 09:25:50.211199 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.211173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"]
Jul 22 09:25:50.218887 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.218865    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"]
Jul 22 09:25:50.219233 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.219219    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" containerName="manager"
Jul 22 09:25:50.219302 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.219234    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" containerName="manager"
Jul 22 09:25:50.219302 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.219300    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" containerName="manager"
Jul 22 09:25:50.222372 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.222356    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:25:50.228666 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.228645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tmkl\" (UniqueName: \"kubernetes.io/projected/bd90bfc6-908a-4aa9-a441-65af77d93148-kube-api-access-6tmkl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-flg8j\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.228775 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.228676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd90bfc6-908a-4aa9-a441-65af77d93148-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-flg8j\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.234567 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.234539    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.237460 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.237428    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:50.238407 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.238373    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"]
Jul 22 09:25:50.242406 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.242279    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.244816 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.244792    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:50.329477 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.329443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tmkl\" (UniqueName: \"kubernetes.io/projected/bd90bfc6-908a-4aa9-a441-65af77d93148-kube-api-access-6tmkl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-flg8j\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.329477 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.329483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd90bfc6-908a-4aa9-a441-65af77d93148-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-flg8j\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.329694 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.329512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjwb\" (UniqueName: \"kubernetes.io/projected/a3c40e69-2276-44d7-8c1f-cf4ae6658ffc-kube-api-access-vmjwb\") pod \"limitador-operator-controller-manager-859d7b78bd-8rshf\" (UID: \"a3c40e69-2276-44d7-8c1f-cf4ae6658ffc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:25:50.329899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.329877    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd90bfc6-908a-4aa9-a441-65af77d93148-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-flg8j\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.353500 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.353357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tmkl\" (UniqueName: \"kubernetes.io/projected/bd90bfc6-908a-4aa9-a441-65af77d93148-kube-api-access-6tmkl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-flg8j\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.429977 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.429945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjwb\" (UniqueName: \"kubernetes.io/projected/a3c40e69-2276-44d7-8c1f-cf4ae6658ffc-kube-api-access-vmjwb\") pod \"limitador-operator-controller-manager-859d7b78bd-8rshf\" (UID: \"a3c40e69-2276-44d7-8c1f-cf4ae6658ffc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:25:50.430828 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.430809    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.437988 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.437961    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.440915 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.440893    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:50.441045 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.441023    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:50.442662 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.442646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjwb\" (UniqueName: \"kubernetes.io/projected/a3c40e69-2276-44d7-8c1f-cf4ae6658ffc-kube-api-access-vmjwb\") pod \"limitador-operator-controller-manager-859d7b78bd-8rshf\" (UID: \"a3c40e69-2276-44d7-8c1f-cf4ae6658ffc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:25:50.444072 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.444053    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l2mn\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:50.446603 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:50.446578    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6v8bh\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:50.530450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.530417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-extensions-socket-volume\") pod \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") "
Jul 22 09:25:50.530623 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.530473    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv4g4\" (UniqueName: \"kubernetes.io/projected/1625cfda-658b-42d2-9c9e-67ad78204d7f-kube-api-access-mv4g4\") pod \"1625cfda-658b-42d2-9c9e-67ad78204d7f\" (UID: \"1625cfda-658b-42d2-9c9e-67ad78204d7f\") "
Jul 22 09:25:50.530623 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.530509    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7p2q\" (UniqueName: \"kubernetes.io/projected/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-kube-api-access-c7p2q\") pod \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\" (UID: \"ecd5bcc0-0616-45c3-9ab3-daad50bd2a24\") "
Jul 22 09:25:50.530901 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.530874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" (UID: "ecd5bcc0-0616-45c3-9ab3-daad50bd2a24"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 09:25:50.532511 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.532490    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-kube-api-access-c7p2q" (OuterVolumeSpecName: "kube-api-access-c7p2q") pod "ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" (UID: "ecd5bcc0-0616-45c3-9ab3-daad50bd2a24"). InnerVolumeSpecName "kube-api-access-c7p2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:25:50.532582 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.532522    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1625cfda-658b-42d2-9c9e-67ad78204d7f-kube-api-access-mv4g4" (OuterVolumeSpecName: "kube-api-access-mv4g4") pod "1625cfda-658b-42d2-9c9e-67ad78204d7f" (UID: "1625cfda-658b-42d2-9c9e-67ad78204d7f"). InnerVolumeSpecName "kube-api-access-mv4g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:25:50.546628 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.546607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:50.554623 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.554605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:25:50.631677 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.631641    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-extensions-socket-volume\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:25:50.631822 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.631682    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv4g4\" (UniqueName: \"kubernetes.io/projected/1625cfda-658b-42d2-9c9e-67ad78204d7f-kube-api-access-mv4g4\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:25:50.631822 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.631699    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7p2q\" (UniqueName: \"kubernetes.io/projected/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24-kube-api-access-c7p2q\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:25:50.731589 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.731564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"]
Jul 22 09:25:50.734076 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:25:50.734051    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd90bfc6_908a_4aa9_a441_65af77d93148.slice/crio-9f51d7d9fd12719d44ce86352843356f51157f000783d38f892a42ce29338123 WatchSource:0}: Error finding container 9f51d7d9fd12719d44ce86352843356f51157f000783d38f892a42ce29338123: Status 404 returned error can't find the container with id 9f51d7d9fd12719d44ce86352843356f51157f000783d38f892a42ce29338123
Jul 22 09:25:50.765366 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.765346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"]
Jul 22 09:25:50.774025 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:25:50.774001    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c40e69_2276_44d7_8c1f_cf4ae6658ffc.slice/crio-67bbf0b16d9e572c684ac816994978a92db7320ce8b0b8df6bc4eecc5ff28ef1 WatchSource:0}: Error finding container 67bbf0b16d9e572c684ac816994978a92db7320ce8b0b8df6bc4eecc5ff28ef1: Status 404 returned error can't find the container with id 67bbf0b16d9e572c684ac816994978a92db7320ce8b0b8df6bc4eecc5ff28ef1
Jul 22 09:25:50.909261 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.909183    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1625cfda-658b-42d2-9c9e-67ad78204d7f" path="/var/lib/kubelet/pods/1625cfda-658b-42d2-9c9e-67ad78204d7f/volumes"
Jul 22 09:25:50.909579 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:50.909563    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" path="/var/lib/kubelet/pods/ecd5bcc0-0616-45c3-9ab3-daad50bd2a24/volumes"
Jul 22 09:25:51.039438 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.039407    2560 generic.go:356] "Generic (PLEG): container finished" podID="1625cfda-658b-42d2-9c9e-67ad78204d7f" containerID="17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737" exitCode=0
Jul 22 09:25:51.039604 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.039458    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6v8bh"
Jul 22 09:25:51.039604 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.039500    2560 scope.go:117] "RemoveContainer" containerID="17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737"
Jul 22 09:25:51.041459 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.041433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf" event={"ID":"a3c40e69-2276-44d7-8c1f-cf4ae6658ffc","Type":"ContainerStarted","Data":"bcc00a23ea240734285301d7b52329fa31b5708c271da7290c79f95849521b0c"}
Jul 22 09:25:51.041791 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.041493    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:25:51.041791 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.041519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf" event={"ID":"a3c40e69-2276-44d7-8c1f-cf4ae6658ffc","Type":"ContainerStarted","Data":"67bbf0b16d9e572c684ac816994978a92db7320ce8b0b8df6bc4eecc5ff28ef1"}
Jul 22 09:25:51.043068 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.043036    2560 generic.go:356] "Generic (PLEG): container finished" podID="ecd5bcc0-0616-45c3-9ab3-daad50bd2a24" containerID="bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e" exitCode=0
Jul 22 09:25:51.043165 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.043079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l2mn"
Jul 22 09:25:51.044822 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.044801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j" event={"ID":"bd90bfc6-908a-4aa9-a441-65af77d93148","Type":"ContainerStarted","Data":"acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba"}
Jul 22 09:25:51.044912 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.044862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j" event={"ID":"bd90bfc6-908a-4aa9-a441-65af77d93148","Type":"ContainerStarted","Data":"9f51d7d9fd12719d44ce86352843356f51157f000783d38f892a42ce29338123"}
Jul 22 09:25:51.044912 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.044896    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:25:51.049081 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.049060    2560 scope.go:117] "RemoveContainer" containerID="17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737"
Jul 22 09:25:51.049327 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:51.049309    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737\": container with ID starting with 17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737 not found: ID does not exist" containerID="17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737"
Jul 22 09:25:51.049369 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.049333    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737"} err="failed to get container status \"17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737\": rpc error: code = NotFound desc = could not find container \"17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737\": container with ID starting with 17c634bc25d0613b9bb297cd057090ab94526ae42be57b0d6b3afaefee1c3737 not found: ID does not exist"
Jul 22 09:25:51.049369 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.049347    2560 scope.go:117] "RemoveContainer" containerID="bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e"
Jul 22 09:25:51.056686 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.056669    2560 scope.go:117] "RemoveContainer" containerID="bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e"
Jul 22 09:25:51.057005 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:25:51.056986    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e\": container with ID starting with bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e not found: ID does not exist" containerID="bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e"
Jul 22 09:25:51.057064 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.057013    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e"} err="failed to get container status \"bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e\": rpc error: code = NotFound desc = could not find container \"bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e\": container with ID starting with bf2e52c2f30b8503857a7b756ddcfdb50660a4b6b44897d53b0c02d729782d7e not found: ID does not exist"
Jul 22 09:25:51.094390 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:51.094345    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf" podStartSLOduration=1.094331202 podStartE2EDuration="1.094331202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:51.092764743 +0000 UTC m=+506.686756906" watchObservedRunningTime="2026-07-22 09:25:51.094331202 +0000 UTC m=+506.688323345"
Jul 22 09:25:52.258009 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.257961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j" podStartSLOduration=2.2579460989999998 podStartE2EDuration="2.257946099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:51.137012817 +0000 UTC m=+506.731004959" watchObservedRunningTime="2026-07-22 09:25:52.257946099 +0000 UTC m=+507.851938244"
Jul 22 09:25:52.258642 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.258626    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"]
Jul 22 09:25:52.263392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.263374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.299704 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.299678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"]
Jul 22 09:25:52.343685 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.343658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe984605-46cd-4dc2-93f8-8a6fc214463e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vkbrz\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.343780 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.343690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgc62\" (UniqueName: \"kubernetes.io/projected/fe984605-46cd-4dc2-93f8-8a6fc214463e-kube-api-access-bgc62\") pod \"kuadrant-operator-controller-manager-86878c769f-vkbrz\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.444042 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.444015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe984605-46cd-4dc2-93f8-8a6fc214463e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vkbrz\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.444141 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.444049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgc62\" (UniqueName: \"kubernetes.io/projected/fe984605-46cd-4dc2-93f8-8a6fc214463e-kube-api-access-bgc62\") pod \"kuadrant-operator-controller-manager-86878c769f-vkbrz\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.444472 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.444454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe984605-46cd-4dc2-93f8-8a6fc214463e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vkbrz\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.465951 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.465929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgc62\" (UniqueName: \"kubernetes.io/projected/fe984605-46cd-4dc2-93f8-8a6fc214463e-kube-api-access-bgc62\") pod \"kuadrant-operator-controller-manager-86878c769f-vkbrz\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.573144 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.573078    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:52.741778 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.741754    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"]
Jul 22 09:25:52.744315 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:25:52.744283    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe984605_46cd_4dc2_93f8_8a6fc214463e.slice/crio-33bfbb1409a9c2e7d9092834791e6221aa72e466e3fd06b294c0d3463591bbfc WatchSource:0}: Error finding container 33bfbb1409a9c2e7d9092834791e6221aa72e466e3fd06b294c0d3463591bbfc: Status 404 returned error can't find the container with id 33bfbb1409a9c2e7d9092834791e6221aa72e466e3fd06b294c0d3463591bbfc
Jul 22 09:25:52.997108 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:52.997079    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjb6r"
Jul 22 09:25:53.059061 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:53.059028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz" event={"ID":"fe984605-46cd-4dc2-93f8-8a6fc214463e","Type":"ContainerStarted","Data":"b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09"}
Jul 22 09:25:53.059241 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:53.059085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz" event={"ID":"fe984605-46cd-4dc2-93f8-8a6fc214463e","Type":"ContainerStarted","Data":"33bfbb1409a9c2e7d9092834791e6221aa72e466e3fd06b294c0d3463591bbfc"}
Jul 22 09:25:53.059241 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:53.059118    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:25:53.101363 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:25:53.101302    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz" podStartSLOduration=1.101285849 podStartE2EDuration="1.101285849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:25:53.098334809 +0000 UTC m=+508.692326953" watchObservedRunningTime="2026-07-22 09:25:53.101285849 +0000 UTC m=+508.695278054"
Jul 22 09:26:02.054454 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:02.054424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8rshf"
Jul 22 09:26:02.055058 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:02.054505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:26:04.066169 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.066136    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:26:04.123364 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.123335    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"]
Jul 22 09:26:04.123521 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.123502    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j" podUID="bd90bfc6-908a-4aa9-a441-65af77d93148" containerName="manager" containerID="cri-o://acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba" gracePeriod=10
Jul 22 09:26:04.367075 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.367052    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:26:04.443287 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.443258    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd90bfc6-908a-4aa9-a441-65af77d93148-extensions-socket-volume\") pod \"bd90bfc6-908a-4aa9-a441-65af77d93148\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") "
Jul 22 09:26:04.443446 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.443378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tmkl\" (UniqueName: \"kubernetes.io/projected/bd90bfc6-908a-4aa9-a441-65af77d93148-kube-api-access-6tmkl\") pod \"bd90bfc6-908a-4aa9-a441-65af77d93148\" (UID: \"bd90bfc6-908a-4aa9-a441-65af77d93148\") "
Jul 22 09:26:04.443677 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.443651    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd90bfc6-908a-4aa9-a441-65af77d93148-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bd90bfc6-908a-4aa9-a441-65af77d93148" (UID: "bd90bfc6-908a-4aa9-a441-65af77d93148"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 09:26:04.445221 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.445197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd90bfc6-908a-4aa9-a441-65af77d93148-kube-api-access-6tmkl" (OuterVolumeSpecName: "kube-api-access-6tmkl") pod "bd90bfc6-908a-4aa9-a441-65af77d93148" (UID: "bd90bfc6-908a-4aa9-a441-65af77d93148"). InnerVolumeSpecName "kube-api-access-6tmkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:26:04.544762 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.544733    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tmkl\" (UniqueName: \"kubernetes.io/projected/bd90bfc6-908a-4aa9-a441-65af77d93148-kube-api-access-6tmkl\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:04.544762 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:04.544758    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd90bfc6-908a-4aa9-a441-65af77d93148-extensions-socket-volume\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:05.117364 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.117331    2560 generic.go:356] "Generic (PLEG): container finished" podID="bd90bfc6-908a-4aa9-a441-65af77d93148" containerID="acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba" exitCode=0
Jul 22 09:26:05.117771 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.117379    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"
Jul 22 09:26:05.117771 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.117398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j" event={"ID":"bd90bfc6-908a-4aa9-a441-65af77d93148","Type":"ContainerDied","Data":"acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba"}
Jul 22 09:26:05.117771 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.117445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j" event={"ID":"bd90bfc6-908a-4aa9-a441-65af77d93148","Type":"ContainerDied","Data":"9f51d7d9fd12719d44ce86352843356f51157f000783d38f892a42ce29338123"}
Jul 22 09:26:05.117771 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.117470    2560 scope.go:117] "RemoveContainer" containerID="acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba"
Jul 22 09:26:05.125969 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.125794    2560 scope.go:117] "RemoveContainer" containerID="acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba"
Jul 22 09:26:05.126089 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:26:05.126070    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba\": container with ID starting with acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba not found: ID does not exist" containerID="acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba"
Jul 22 09:26:05.126138 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.126098    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba"} err="failed to get container status \"acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba\": rpc error: code = NotFound desc = could not find container \"acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba\": container with ID starting with acc3884cc5575bd61ef9dcd1e113a73e236f8e44d669fb1c847ff0b876ece9ba not found: ID does not exist"
Jul 22 09:26:05.136497 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.136476    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"]
Jul 22 09:26:05.144319 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:05.144301    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-flg8j"]
Jul 22 09:26:06.908289 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:06.908245    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd90bfc6-908a-4aa9-a441-65af77d93148" path="/var/lib/kubelet/pods/bd90bfc6-908a-4aa9-a441-65af77d93148/volumes"
Jul 22 09:26:22.641485 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.641409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:22.641821 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.641805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd90bfc6-908a-4aa9-a441-65af77d93148" containerName="manager"
Jul 22 09:26:22.641821 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.641817    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd90bfc6-908a-4aa9-a441-65af77d93148" containerName="manager"
Jul 22 09:26:22.641938 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.641901    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd90bfc6-908a-4aa9-a441-65af77d93148" containerName="manager"
Jul 22 09:26:22.644394 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.644370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.647203 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.647181    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 09:26:22.647317 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.647281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wnw8l\""
Jul 22 09:26:22.657451 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.657429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:22.739134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.739095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:22.789015 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.788986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbm7\" (UniqueName: \"kubernetes.io/projected/993c95cb-6f36-4157-a644-c062bce4aea6-kube-api-access-cpbm7\") pod \"limitador-limitador-64c94fd64f-47grc\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.789180 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.789050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/993c95cb-6f36-4157-a644-c062bce4aea6-config-file\") pod \"limitador-limitador-64c94fd64f-47grc\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.890351 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.890325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbm7\" (UniqueName: \"kubernetes.io/projected/993c95cb-6f36-4157-a644-c062bce4aea6-kube-api-access-cpbm7\") pod \"limitador-limitador-64c94fd64f-47grc\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.890510 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.890380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/993c95cb-6f36-4157-a644-c062bce4aea6-config-file\") pod \"limitador-limitador-64c94fd64f-47grc\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.890966 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.890948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/993c95cb-6f36-4157-a644-c062bce4aea6-config-file\") pod \"limitador-limitador-64c94fd64f-47grc\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.899233 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.899180    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbm7\" (UniqueName: \"kubernetes.io/projected/993c95cb-6f36-4157-a644-c062bce4aea6-kube-api-access-cpbm7\") pod \"limitador-limitador-64c94fd64f-47grc\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:22.955143 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:22.955115    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:23.096277 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.096252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:23.098977 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:26:23.098942    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993c95cb_6f36_4157_a644_c062bce4aea6.slice/crio-64d01b2a19881ee87d35c9619866d925bc6b86bd3dd21ed3a55d9ab673635df5 WatchSource:0}: Error finding container 64d01b2a19881ee87d35c9619866d925bc6b86bd3dd21ed3a55d9ab673635df5: Status 404 returned error can't find the container with id 64d01b2a19881ee87d35c9619866d925bc6b86bd3dd21ed3a55d9ab673635df5
Jul 22 09:26:23.205544 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.205480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc" event={"ID":"993c95cb-6f36-4157-a644-c062bce4aea6","Type":"ContainerStarted","Data":"64d01b2a19881ee87d35c9619866d925bc6b86bd3dd21ed3a55d9ab673635df5"}
Jul 22 09:26:23.464399 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.464319    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wxmdv"]
Jul 22 09:26:23.467209 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.467193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:23.469453 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.469432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wqn8n\""
Jul 22 09:26:23.473598 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.473576    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wxmdv"]
Jul 22 09:26:23.595540 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.595515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6678\" (UniqueName: \"kubernetes.io/projected/bfe1c728-fde3-4235-b497-aad1da6eb83f-kube-api-access-v6678\") pod \"authorino-58cd955675-wxmdv\" (UID: \"bfe1c728-fde3-4235-b497-aad1da6eb83f\") " pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:23.696759 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.696729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6678\" (UniqueName: \"kubernetes.io/projected/bfe1c728-fde3-4235-b497-aad1da6eb83f-kube-api-access-v6678\") pod \"authorino-58cd955675-wxmdv\" (UID: \"bfe1c728-fde3-4235-b497-aad1da6eb83f\") " pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:23.709091 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.709067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6678\" (UniqueName: \"kubernetes.io/projected/bfe1c728-fde3-4235-b497-aad1da6eb83f-kube-api-access-v6678\") pod \"authorino-58cd955675-wxmdv\" (UID: \"bfe1c728-fde3-4235-b497-aad1da6eb83f\") " pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:23.777978 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.777905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:23.956852 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:23.956803    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wxmdv"]
Jul 22 09:26:23.961291 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:26:23.961257    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfe1c728_fde3_4235_b497_aad1da6eb83f.slice/crio-c1f3b35bdead5fdcb5b2e8fc30808840ed3b951dbe0d7d5ba077c4a2669e0ef9 WatchSource:0}: Error finding container c1f3b35bdead5fdcb5b2e8fc30808840ed3b951dbe0d7d5ba077c4a2669e0ef9: Status 404 returned error can't find the container with id c1f3b35bdead5fdcb5b2e8fc30808840ed3b951dbe0d7d5ba077c4a2669e0ef9
Jul 22 09:26:24.212899 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:24.212857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wxmdv" event={"ID":"bfe1c728-fde3-4235-b497-aad1da6eb83f","Type":"ContainerStarted","Data":"c1f3b35bdead5fdcb5b2e8fc30808840ed3b951dbe0d7d5ba077c4a2669e0ef9"}
Jul 22 09:26:26.230241 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:26.230153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc" event={"ID":"993c95cb-6f36-4157-a644-c062bce4aea6","Type":"ContainerStarted","Data":"7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d"}
Jul 22 09:26:26.230663 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:26.230284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:26.276827 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:26.276771    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc" podStartSLOduration=1.410050459 podStartE2EDuration="4.276756347s" totalImagesPullingTime="2.866705888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:26:26.276547713 +0000 UTC m=+541.870539884" watchObservedRunningTime="2026-07-22 09:26:26.276756347 +0000 UTC m=+541.870748490"
Jul 22 09:26:28.242454 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:28.242378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wxmdv" event={"ID":"bfe1c728-fde3-4235-b497-aad1da6eb83f","Type":"ContainerStarted","Data":"e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750"}
Jul 22 09:26:28.260268 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:28.260220    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wxmdv" podStartSLOduration=1.3420447690000001 podStartE2EDuration="5.260201162s" totalImagesPullingTime="3.918156393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:26:28.259050196 +0000 UTC m=+543.853042341" watchObservedRunningTime="2026-07-22 09:26:28.260201162 +0000 UTC m=+543.854193305"
Jul 22 09:26:30.455458 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:30.455417    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wxmdv"]
Jul 22 09:26:30.455939 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:30.455627    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wxmdv" podUID="bfe1c728-fde3-4235-b497-aad1da6eb83f" containerName="authorino" containerID="cri-o://e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750" gracePeriod=30
Jul 22 09:26:30.704802 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:30.704774    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:30.757164 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:30.757110    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6678\" (UniqueName: \"kubernetes.io/projected/bfe1c728-fde3-4235-b497-aad1da6eb83f-kube-api-access-v6678\") pod \"bfe1c728-fde3-4235-b497-aad1da6eb83f\" (UID: \"bfe1c728-fde3-4235-b497-aad1da6eb83f\") "
Jul 22 09:26:30.758953 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:30.758931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe1c728-fde3-4235-b497-aad1da6eb83f-kube-api-access-v6678" (OuterVolumeSpecName: "kube-api-access-v6678") pod "bfe1c728-fde3-4235-b497-aad1da6eb83f" (UID: "bfe1c728-fde3-4235-b497-aad1da6eb83f"). InnerVolumeSpecName "kube-api-access-v6678". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:26:30.857979 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:30.857956    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6678\" (UniqueName: \"kubernetes.io/projected/bfe1c728-fde3-4235-b497-aad1da6eb83f-kube-api-access-v6678\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:31.258296 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.258268    2560 generic.go:356] "Generic (PLEG): container finished" podID="bfe1c728-fde3-4235-b497-aad1da6eb83f" containerID="e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750" exitCode=0
Jul 22 09:26:31.258445 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.258305    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wxmdv"
Jul 22 09:26:31.258445 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.258344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wxmdv" event={"ID":"bfe1c728-fde3-4235-b497-aad1da6eb83f","Type":"ContainerDied","Data":"e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750"}
Jul 22 09:26:31.258445 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.258378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wxmdv" event={"ID":"bfe1c728-fde3-4235-b497-aad1da6eb83f","Type":"ContainerDied","Data":"c1f3b35bdead5fdcb5b2e8fc30808840ed3b951dbe0d7d5ba077c4a2669e0ef9"}
Jul 22 09:26:31.258445 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.258397    2560 scope.go:117] "RemoveContainer" containerID="e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750"
Jul 22 09:26:31.266898 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.266882    2560 scope.go:117] "RemoveContainer" containerID="e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750"
Jul 22 09:26:31.267152 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:26:31.267127    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750\": container with ID starting with e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750 not found: ID does not exist" containerID="e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750"
Jul 22 09:26:31.267208 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.267159    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750"} err="failed to get container status \"e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750\": rpc error: code = NotFound desc = could not find container \"e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750\": container with ID starting with e23aa9f8e09406c007312726596e1b647b1d3ec8b63d1fc0000baed0f4ba1750 not found: ID does not exist"
Jul 22 09:26:31.275083 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.275063    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wxmdv"]
Jul 22 09:26:31.281354 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:31.281332    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wxmdv"]
Jul 22 09:26:32.908398 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:32.908351    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe1c728-fde3-4235-b497-aad1da6eb83f" path="/var/lib/kubelet/pods/bfe1c728-fde3-4235-b497-aad1da6eb83f/volumes"
Jul 22 09:26:37.237958 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:37.237925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:41.474851 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:41.474805    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:41.475329 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:41.475020    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc" podUID="993c95cb-6f36-4157-a644-c062bce4aea6" containerName="limitador" containerID="cri-o://7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d" gracePeriod=30
Jul 22 09:26:42.027483 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.027459    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:42.029713 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.029693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/993c95cb-6f36-4157-a644-c062bce4aea6-config-file\") pod \"993c95cb-6f36-4157-a644-c062bce4aea6\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") "
Jul 22 09:26:42.029816 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.029766    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpbm7\" (UniqueName: \"kubernetes.io/projected/993c95cb-6f36-4157-a644-c062bce4aea6-kube-api-access-cpbm7\") pod \"993c95cb-6f36-4157-a644-c062bce4aea6\" (UID: \"993c95cb-6f36-4157-a644-c062bce4aea6\") "
Jul 22 09:26:42.030019 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.029997    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/993c95cb-6f36-4157-a644-c062bce4aea6-config-file" (OuterVolumeSpecName: "config-file") pod "993c95cb-6f36-4157-a644-c062bce4aea6" (UID: "993c95cb-6f36-4157-a644-c062bce4aea6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 09:26:42.030089 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.030072    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/993c95cb-6f36-4157-a644-c062bce4aea6-config-file\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:42.031645 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.031623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/993c95cb-6f36-4157-a644-c062bce4aea6-kube-api-access-cpbm7" (OuterVolumeSpecName: "kube-api-access-cpbm7") pod "993c95cb-6f36-4157-a644-c062bce4aea6" (UID: "993c95cb-6f36-4157-a644-c062bce4aea6"). InnerVolumeSpecName "kube-api-access-cpbm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:26:42.131088 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.131060    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpbm7\" (UniqueName: \"kubernetes.io/projected/993c95cb-6f36-4157-a644-c062bce4aea6-kube-api-access-cpbm7\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:42.310938 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.310862    2560 generic.go:356] "Generic (PLEG): container finished" podID="993c95cb-6f36-4157-a644-c062bce4aea6" containerID="7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d" exitCode=0
Jul 22 09:26:42.310938 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.310912    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc"
Jul 22 09:26:42.311113 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.310949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc" event={"ID":"993c95cb-6f36-4157-a644-c062bce4aea6","Type":"ContainerDied","Data":"7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d"}
Jul 22 09:26:42.311113 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.311023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-47grc" event={"ID":"993c95cb-6f36-4157-a644-c062bce4aea6","Type":"ContainerDied","Data":"64d01b2a19881ee87d35c9619866d925bc6b86bd3dd21ed3a55d9ab673635df5"}
Jul 22 09:26:42.311113 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.311054    2560 scope.go:117] "RemoveContainer" containerID="7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d"
Jul 22 09:26:42.320318 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.320299    2560 scope.go:117] "RemoveContainer" containerID="7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d"
Jul 22 09:26:42.320572 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:26:42.320554    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d\": container with ID starting with 7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d not found: ID does not exist" containerID="7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d"
Jul 22 09:26:42.320619 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.320581    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d"} err="failed to get container status \"7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d\": rpc error: code = NotFound desc = could not find container \"7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d\": container with ID starting with 7148cf677f812f1866ad405b7a347fc6eed8e3b9e1ba0f806c493385f5fae85d not found: ID does not exist"
Jul 22 09:26:42.333995 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.333971    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:42.342043 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.342017    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-47grc"]
Jul 22 09:26:42.908461 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:42.908426    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="993c95cb-6f36-4157-a644-c062bce4aea6" path="/var/lib/kubelet/pods/993c95cb-6f36-4157-a644-c062bce4aea6/volumes"
Jul 22 09:26:44.246723 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.246684    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"]
Jul 22 09:26:44.247222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.247066    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe1c728-fde3-4235-b497-aad1da6eb83f" containerName="authorino"
Jul 22 09:26:44.247222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.247078    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe1c728-fde3-4235-b497-aad1da6eb83f" containerName="authorino"
Jul 22 09:26:44.247222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.247087    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="993c95cb-6f36-4157-a644-c062bce4aea6" containerName="limitador"
Jul 22 09:26:44.247222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.247093    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="993c95cb-6f36-4157-a644-c062bce4aea6" containerName="limitador"
Jul 22 09:26:44.247222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.247146    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="993c95cb-6f36-4157-a644-c062bce4aea6" containerName="limitador"
Jul 22 09:26:44.247222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.247154    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe1c728-fde3-4235-b497-aad1da6eb83f" containerName="authorino"
Jul 22 09:26:44.251204 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.251177    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.253926 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.253901    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-pqzjd\""
Jul 22 09:26:44.254119 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.254101    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 09:26:44.254971 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.254948    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 09:26:44.255081 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.254949    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 09:26:44.261018 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.260998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"]
Jul 22 09:26:44.344517 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.344492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x658d\" (UniqueName: \"kubernetes.io/projected/c2990309-674f-4e26-b16c-ecd99f65de1e-kube-api-access-x658d\") pod \"postgres-69fb4594cf-lxn62\" (UID: \"c2990309-674f-4e26-b16c-ecd99f65de1e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.344648 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.344521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2990309-674f-4e26-b16c-ecd99f65de1e-data\") pod \"postgres-69fb4594cf-lxn62\" (UID: \"c2990309-674f-4e26-b16c-ecd99f65de1e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.444910 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.444879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x658d\" (UniqueName: \"kubernetes.io/projected/c2990309-674f-4e26-b16c-ecd99f65de1e-kube-api-access-x658d\") pod \"postgres-69fb4594cf-lxn62\" (UID: \"c2990309-674f-4e26-b16c-ecd99f65de1e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.445037 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.444916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2990309-674f-4e26-b16c-ecd99f65de1e-data\") pod \"postgres-69fb4594cf-lxn62\" (UID: \"c2990309-674f-4e26-b16c-ecd99f65de1e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.445224 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.445205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2990309-674f-4e26-b16c-ecd99f65de1e-data\") pod \"postgres-69fb4594cf-lxn62\" (UID: \"c2990309-674f-4e26-b16c-ecd99f65de1e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.454799 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.454777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x658d\" (UniqueName: \"kubernetes.io/projected/c2990309-674f-4e26-b16c-ecd99f65de1e-kube-api-access-x658d\") pod \"postgres-69fb4594cf-lxn62\" (UID: \"c2990309-674f-4e26-b16c-ecd99f65de1e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.564077 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.564028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:44.697276 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:44.697248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"]
Jul 22 09:26:44.699940 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:26:44.699909    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2990309_674f_4e26_b16c_ecd99f65de1e.slice/crio-f2687d0e58f92a6775eb3ae97b360ebe6b0131d06a6af0a42a0efea1299d0d41 WatchSource:0}: Error finding container f2687d0e58f92a6775eb3ae97b360ebe6b0131d06a6af0a42a0efea1299d0d41: Status 404 returned error can't find the container with id f2687d0e58f92a6775eb3ae97b360ebe6b0131d06a6af0a42a0efea1299d0d41
Jul 22 09:26:45.326753 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:45.326720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62" event={"ID":"c2990309-674f-4e26-b16c-ecd99f65de1e","Type":"ContainerStarted","Data":"f2687d0e58f92a6775eb3ae97b360ebe6b0131d06a6af0a42a0efea1299d0d41"}
Jul 22 09:26:50.354325 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:50.354288    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62" event={"ID":"c2990309-674f-4e26-b16c-ecd99f65de1e","Type":"ContainerStarted","Data":"b1f5f0c461ee3118ec92800d7f85f3c9fae826c01559967af5a969729a1a09ce"}
Jul 22 09:26:50.354691 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:50.354349    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:50.374431 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:50.374386    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62" podStartSLOduration=1.619018216 podStartE2EDuration="6.374371225s" totalImagesPullingTime="4.755353009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:26:50.372084522 +0000 UTC m=+565.966076664" watchObservedRunningTime="2026-07-22 09:26:50.374371225 +0000 UTC m=+565.968363382"
Jul 22 09:26:56.387756 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:56.387729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lxn62"
Jul 22 09:26:56.924389 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:56.924340    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb6nx"]
Jul 22 09:26:56.930564 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:56.930544    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:56.933155 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:56.933137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wqn8n\""
Jul 22 09:26:56.935960 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:56.935940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb6nx"]
Jul 22 09:26:57.049356 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.049327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk26g\" (UniqueName: \"kubernetes.io/projected/db260d82-eef1-411b-9a5c-37293bd002ba-kube-api-access-wk26g\") pod \"authorino-5d4b67c446-bb6nx\" (UID: \"db260d82-eef1-411b-9a5c-37293bd002ba\") " pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:57.148690 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.148667    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb6nx"]
Jul 22 09:26:57.148886 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:26:57.148866    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wk26g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-bb6nx" podUID="db260d82-eef1-411b-9a5c-37293bd002ba"
Jul 22 09:26:57.150179 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.150154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk26g\" (UniqueName: \"kubernetes.io/projected/db260d82-eef1-411b-9a5c-37293bd002ba-kube-api-access-wk26g\") pod \"authorino-5d4b67c446-bb6nx\" (UID: \"db260d82-eef1-411b-9a5c-37293bd002ba\") " pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:57.162726 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.162701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk26g\" (UniqueName: \"kubernetes.io/projected/db260d82-eef1-411b-9a5c-37293bd002ba-kube-api-access-wk26g\") pod \"authorino-5d4b67c446-bb6nx\" (UID: \"db260d82-eef1-411b-9a5c-37293bd002ba\") " pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:57.182703 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.182646    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8fdd7d787-f4dhs"]
Jul 22 09:26:57.186774 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.186758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:57.194733 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.194711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8fdd7d787-f4dhs"]
Jul 22 09:26:57.251115 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.251091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcdgg\" (UniqueName: \"kubernetes.io/projected/f1d54055-53e2-4c71-9bfb-0aee359155fc-kube-api-access-dcdgg\") pod \"authorino-8fdd7d787-f4dhs\" (UID: \"f1d54055-53e2-4c71-9bfb-0aee359155fc\") " pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:57.352447 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.352423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcdgg\" (UniqueName: \"kubernetes.io/projected/f1d54055-53e2-4c71-9bfb-0aee359155fc-kube-api-access-dcdgg\") pod \"authorino-8fdd7d787-f4dhs\" (UID: \"f1d54055-53e2-4c71-9bfb-0aee359155fc\") " pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:57.361021 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.361002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcdgg\" (UniqueName: \"kubernetes.io/projected/f1d54055-53e2-4c71-9bfb-0aee359155fc-kube-api-access-dcdgg\") pod \"authorino-8fdd7d787-f4dhs\" (UID: \"f1d54055-53e2-4c71-9bfb-0aee359155fc\") " pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:57.386158 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.386139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:57.393545 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.393525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:57.453166 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.453116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk26g\" (UniqueName: \"kubernetes.io/projected/db260d82-eef1-411b-9a5c-37293bd002ba-kube-api-access-wk26g\") pod \"db260d82-eef1-411b-9a5c-37293bd002ba\" (UID: \"db260d82-eef1-411b-9a5c-37293bd002ba\") "
Jul 22 09:26:57.455132 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.455111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db260d82-eef1-411b-9a5c-37293bd002ba-kube-api-access-wk26g" (OuterVolumeSpecName: "kube-api-access-wk26g") pod "db260d82-eef1-411b-9a5c-37293bd002ba" (UID: "db260d82-eef1-411b-9a5c-37293bd002ba"). InnerVolumeSpecName "kube-api-access-wk26g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:26:57.496203 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.496185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:57.553933 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.553889    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk26g\" (UniqueName: \"kubernetes.io/projected/db260d82-eef1-411b-9a5c-37293bd002ba-kube-api-access-wk26g\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:57.571377 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.571326    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8fdd7d787-f4dhs"]
Jul 22 09:26:57.641611 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:57.641589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8fdd7d787-f4dhs"]
Jul 22 09:26:57.642884 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:26:57.642858    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1d54055_53e2_4c71_9bfb_0aee359155fc.slice/crio-28a10e7c84600a6d7112835b7d12b2d7df80730c4f3dc3d96990d46c84dade13 WatchSource:0}: Error finding container 28a10e7c84600a6d7112835b7d12b2d7df80730c4f3dc3d96990d46c84dade13: Status 404 returned error can't find the container with id 28a10e7c84600a6d7112835b7d12b2d7df80730c4f3dc3d96990d46c84dade13
Jul 22 09:26:58.392521 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.392482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8fdd7d787-f4dhs" event={"ID":"f1d54055-53e2-4c71-9bfb-0aee359155fc","Type":"ContainerStarted","Data":"5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811"}
Jul 22 09:26:58.392521 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.392506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb6nx"
Jul 22 09:26:58.392706 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.392530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8fdd7d787-f4dhs" event={"ID":"f1d54055-53e2-4c71-9bfb-0aee359155fc","Type":"ContainerStarted","Data":"28a10e7c84600a6d7112835b7d12b2d7df80730c4f3dc3d96990d46c84dade13"}
Jul 22 09:26:58.392706 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.392502    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8fdd7d787-f4dhs" podUID="f1d54055-53e2-4c71-9bfb-0aee359155fc" containerName="authorino" containerID="cri-o://5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811" gracePeriod=30
Jul 22 09:26:58.435877 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.435820    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8fdd7d787-f4dhs" podStartSLOduration=0.84165958 podStartE2EDuration="1.435805363s" totalImagesPullingTime="594.145783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:26:58.410806549 +0000 UTC m=+574.004798694" watchObservedRunningTime="2026-07-22 09:26:58.435805363 +0000 UTC m=+574.029797505"
Jul 22 09:26:58.445678 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.445655    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb6nx"]
Jul 22 09:26:58.448697 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.448671    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb6nx"]
Jul 22 09:26:58.643286 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.643265    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:58.764878 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.764804    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcdgg\" (UniqueName: \"kubernetes.io/projected/f1d54055-53e2-4c71-9bfb-0aee359155fc-kube-api-access-dcdgg\") pod \"f1d54055-53e2-4c71-9bfb-0aee359155fc\" (UID: \"f1d54055-53e2-4c71-9bfb-0aee359155fc\") "
Jul 22 09:26:58.766733 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.766702    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d54055-53e2-4c71-9bfb-0aee359155fc-kube-api-access-dcdgg" (OuterVolumeSpecName: "kube-api-access-dcdgg") pod "f1d54055-53e2-4c71-9bfb-0aee359155fc" (UID: "f1d54055-53e2-4c71-9bfb-0aee359155fc"). InnerVolumeSpecName "kube-api-access-dcdgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:26:58.865631 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.865607    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcdgg\" (UniqueName: \"kubernetes.io/projected/f1d54055-53e2-4c71-9bfb-0aee359155fc-kube-api-access-dcdgg\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:26:58.907964 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:58.907941    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db260d82-eef1-411b-9a5c-37293bd002ba" path="/var/lib/kubelet/pods/db260d82-eef1-411b-9a5c-37293bd002ba/volumes"
Jul 22 09:26:59.398706 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.398669    2560 generic.go:356] "Generic (PLEG): container finished" podID="f1d54055-53e2-4c71-9bfb-0aee359155fc" containerID="5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811" exitCode=0
Jul 22 09:26:59.398907 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.398719    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8fdd7d787-f4dhs"
Jul 22 09:26:59.398907 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.398749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8fdd7d787-f4dhs" event={"ID":"f1d54055-53e2-4c71-9bfb-0aee359155fc","Type":"ContainerDied","Data":"5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811"}
Jul 22 09:26:59.398907 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.398785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8fdd7d787-f4dhs" event={"ID":"f1d54055-53e2-4c71-9bfb-0aee359155fc","Type":"ContainerDied","Data":"28a10e7c84600a6d7112835b7d12b2d7df80730c4f3dc3d96990d46c84dade13"}
Jul 22 09:26:59.398907 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.398802    2560 scope.go:117] "RemoveContainer" containerID="5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811"
Jul 22 09:26:59.407343 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.407326    2560 scope.go:117] "RemoveContainer" containerID="5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811"
Jul 22 09:26:59.407584 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:26:59.407561    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811\": container with ID starting with 5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811 not found: ID does not exist" containerID="5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811"
Jul 22 09:26:59.407640 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.407592    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811"} err="failed to get container status \"5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811\": rpc error: code = NotFound desc = could not find container \"5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811\": container with ID starting with 5aff0bd2206e9b425d8938907ab870b0fb2324acd1db608ce615c53f443bf811 not found: ID does not exist"
Jul 22 09:26:59.418255 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.418201    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8fdd7d787-f4dhs"]
Jul 22 09:26:59.420815 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:26:59.420792    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8fdd7d787-f4dhs"]
Jul 22 09:27:00.908541 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:00.908512    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d54055-53e2-4c71-9bfb-0aee359155fc" path="/var/lib/kubelet/pods/f1d54055-53e2-4c71-9bfb-0aee359155fc/volumes"
Jul 22 09:27:03.210817 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.210784    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-645db78b78-l7jmk"]
Jul 22 09:27:03.211216 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.211172    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d54055-53e2-4c71-9bfb-0aee359155fc" containerName="authorino"
Jul 22 09:27:03.211216 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.211185    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d54055-53e2-4c71-9bfb-0aee359155fc" containerName="authorino"
Jul 22 09:27:03.211292 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.211257    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d54055-53e2-4c71-9bfb-0aee359155fc" containerName="authorino"
Jul 22 09:27:03.445603 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.445529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-645db78b78-l7jmk"]
Jul 22 09:27:03.445603 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.445566    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6745b5844c-9xm46"]
Jul 22 09:27:03.445799 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.445637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:03.448490 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.448465    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 09:27:03.448633 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.448476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 09:27:03.448633 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.448504    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ks2jk\""
Jul 22 09:27:03.458329 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.458307    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6745b5844c-9xm46"]
Jul 22 09:27:03.458440 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.458403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:03.502822 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.502800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:03.502953 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.502849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2wxs\" (UniqueName: \"kubernetes.io/projected/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-kube-api-access-s2wxs\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:03.503036 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.503018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:03.503097 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.503066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgwrd\" (UniqueName: \"kubernetes.io/projected/94bf574c-a1b1-43a1-b489-37edf1ff80e7-kube-api-access-vgwrd\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:03.603748 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.603725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:03.603882 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.603753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgwrd\" (UniqueName: \"kubernetes.io/projected/94bf574c-a1b1-43a1-b489-37edf1ff80e7-kube-api-access-vgwrd\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:03.603882 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.603789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:03.603882 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.603807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2wxs\" (UniqueName: \"kubernetes.io/projected/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-kube-api-access-s2wxs\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:03.604006 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:27:03.603885    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 22 09:27:03.604006 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:27:03.603902    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 22 09:27:03.604006 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:27:03.603952    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert podName:d0f1e0c4-bbeb-42c9-9995-c10cfc71f183 nodeName:}" failed. No retries permitted until 2026-07-22 09:27:04.103936535 +0000 UTC m=+579.697928656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert") pod "maas-controller-6745b5844c-9xm46" (UID: "d0f1e0c4-bbeb-42c9-9995-c10cfc71f183") : secret "maas-controller-webhook-cert" not found
Jul 22 09:27:03.604006 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:27:03.603966    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert podName:94bf574c-a1b1-43a1-b489-37edf1ff80e7 nodeName:}" failed. No retries permitted until 2026-07-22 09:27:04.103959728 +0000 UTC m=+579.697951849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert") pod "maas-controller-645db78b78-l7jmk" (UID: "94bf574c-a1b1-43a1-b489-37edf1ff80e7") : secret "maas-controller-webhook-cert" not found
Jul 22 09:27:03.631411 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.631387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgwrd\" (UniqueName: \"kubernetes.io/projected/94bf574c-a1b1-43a1-b489-37edf1ff80e7-kube-api-access-vgwrd\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:03.632176 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:03.632155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2wxs\" (UniqueName: \"kubernetes.io/projected/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-kube-api-access-s2wxs\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:04.108814 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.108779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:04.109031 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.108854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:04.111287 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.111262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert\") pod \"maas-controller-6745b5844c-9xm46\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") " pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:04.111392 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.111269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert\") pod \"maas-controller-645db78b78-l7jmk\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") " pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:04.355708 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.355681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:04.367918 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.367891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:04.523885 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.523855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-645db78b78-l7jmk"]
Jul 22 09:27:04.526601 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:27:04.526576    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bf574c_a1b1_43a1_b489_37edf1ff80e7.slice/crio-d82e4f4eef6e3d10e8405cf05657c760ebaf2076096542c8b869bfc74552e19b WatchSource:0}: Error finding container d82e4f4eef6e3d10e8405cf05657c760ebaf2076096542c8b869bfc74552e19b: Status 404 returned error can't find the container with id d82e4f4eef6e3d10e8405cf05657c760ebaf2076096542c8b869bfc74552e19b
Jul 22 09:27:04.569450 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:04.569305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6745b5844c-9xm46"]
Jul 22 09:27:04.572085 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:27:04.572060    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f1e0c4_bbeb_42c9_9995_c10cfc71f183.slice/crio-0c7fadf84d0921bc2a878399e940b0bbf4364dfa5078f59606be6654334c4aed WatchSource:0}: Error finding container 0c7fadf84d0921bc2a878399e940b0bbf4364dfa5078f59606be6654334c4aed: Status 404 returned error can't find the container with id 0c7fadf84d0921bc2a878399e940b0bbf4364dfa5078f59606be6654334c4aed
Jul 22 09:27:05.436691 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:05.436632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645db78b78-l7jmk" event={"ID":"94bf574c-a1b1-43a1-b489-37edf1ff80e7","Type":"ContainerStarted","Data":"d82e4f4eef6e3d10e8405cf05657c760ebaf2076096542c8b869bfc74552e19b"}
Jul 22 09:27:05.438869 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:05.438827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-9xm46" event={"ID":"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183","Type":"ContainerStarted","Data":"0c7fadf84d0921bc2a878399e940b0bbf4364dfa5078f59606be6654334c4aed"}
Jul 22 09:27:07.451954 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:07.451913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645db78b78-l7jmk" event={"ID":"94bf574c-a1b1-43a1-b489-37edf1ff80e7","Type":"ContainerStarted","Data":"e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1"}
Jul 22 09:27:07.452453 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:07.452015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:07.453403 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:07.453376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-9xm46" event={"ID":"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183","Type":"ContainerStarted","Data":"047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078"}
Jul 22 09:27:07.453511 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:07.453480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:07.499201 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:07.499155    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-645db78b78-l7jmk" podStartSLOduration=2.049985759 podStartE2EDuration="4.499142964s" totalImagesPullingTime="2.449157205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:27:07.497417162 +0000 UTC m=+583.091409330" watchObservedRunningTime="2026-07-22 09:27:07.499142964 +0000 UTC m=+583.093135107"
Jul 22 09:27:07.529050 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:07.529003    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6745b5844c-9xm46" podStartSLOduration=2.112780247 podStartE2EDuration="4.528988581s" totalImagesPullingTime="2.416208334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:27:07.527689684 +0000 UTC m=+583.121681826" watchObservedRunningTime="2026-07-22 09:27:07.528988581 +0000 UTC m=+583.122980768"
Jul 22 09:27:18.460037 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.460006    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:27:18.460427 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.460084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:18.574574 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.574543    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-645db78b78-l7jmk"]
Jul 22 09:27:18.574738 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.574713    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-645db78b78-l7jmk" podUID="94bf574c-a1b1-43a1-b489-37edf1ff80e7" containerName="manager" containerID="cri-o://e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1" gracePeriod=30
Jul 22 09:27:18.823297 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.823268    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:18.942747 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.942722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert\") pod \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") "
Jul 22 09:27:18.942944 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.942814    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgwrd\" (UniqueName: \"kubernetes.io/projected/94bf574c-a1b1-43a1-b489-37edf1ff80e7-kube-api-access-vgwrd\") pod \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\" (UID: \"94bf574c-a1b1-43a1-b489-37edf1ff80e7\") "
Jul 22 09:27:18.944954 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.944928    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94bf574c-a1b1-43a1-b489-37edf1ff80e7-kube-api-access-vgwrd" (OuterVolumeSpecName: "kube-api-access-vgwrd") pod "94bf574c-a1b1-43a1-b489-37edf1ff80e7" (UID: "94bf574c-a1b1-43a1-b489-37edf1ff80e7"). InnerVolumeSpecName "kube-api-access-vgwrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:27:18.945054 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:18.944992    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "94bf574c-a1b1-43a1-b489-37edf1ff80e7" (UID: "94bf574c-a1b1-43a1-b489-37edf1ff80e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:27:19.044235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.044152    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94bf574c-a1b1-43a1-b489-37edf1ff80e7-webhook-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:27:19.044235 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.044181    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgwrd\" (UniqueName: \"kubernetes.io/projected/94bf574c-a1b1-43a1-b489-37edf1ff80e7-kube-api-access-vgwrd\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:27:19.514958 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.514924    2560 generic.go:356] "Generic (PLEG): container finished" podID="94bf574c-a1b1-43a1-b489-37edf1ff80e7" containerID="e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1" exitCode=0
Jul 22 09:27:19.515400 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.514971    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645db78b78-l7jmk"
Jul 22 09:27:19.515400 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.514997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645db78b78-l7jmk" event={"ID":"94bf574c-a1b1-43a1-b489-37edf1ff80e7","Type":"ContainerDied","Data":"e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1"}
Jul 22 09:27:19.515400 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.515048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645db78b78-l7jmk" event={"ID":"94bf574c-a1b1-43a1-b489-37edf1ff80e7","Type":"ContainerDied","Data":"d82e4f4eef6e3d10e8405cf05657c760ebaf2076096542c8b869bfc74552e19b"}
Jul 22 09:27:19.515400 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.515080    2560 scope.go:117] "RemoveContainer" containerID="e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1"
Jul 22 09:27:19.524160 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.524144    2560 scope.go:117] "RemoveContainer" containerID="e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1"
Jul 22 09:27:19.524419 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:27:19.524401    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1\": container with ID starting with e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1 not found: ID does not exist" containerID="e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1"
Jul 22 09:27:19.524461 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.524428    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1"} err="failed to get container status \"e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1\": rpc error: code = NotFound desc = could not find container \"e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1\": container with ID starting with e0cd081e7dba1dee5d5a6f4f9990d7ae6730d6d2ca49243e369572853c5006a1 not found: ID does not exist"
Jul 22 09:27:19.543911 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.543883    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-645db78b78-l7jmk"]
Jul 22 09:27:19.545618 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:19.545596    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-645db78b78-l7jmk"]
Jul 22 09:27:20.908466 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:20.908421    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94bf574c-a1b1-43a1-b489-37edf1ff80e7" path="/var/lib/kubelet/pods/94bf574c-a1b1-43a1-b489-37edf1ff80e7/volumes"
Jul 22 09:27:24.796139 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:24.796107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:27:24.801963 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:24.801939    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:27:41.245624 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.245590    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"]
Jul 22 09:27:41.246106 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.245971    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94bf574c-a1b1-43a1-b489-37edf1ff80e7" containerName="manager"
Jul 22 09:27:41.246106 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.245984    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="94bf574c-a1b1-43a1-b489-37edf1ff80e7" containerName="manager"
Jul 22 09:27:41.246106 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.246035    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="94bf574c-a1b1-43a1-b489-37edf1ff80e7" containerName="manager"
Jul 22 09:27:41.254081 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.254061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.256809 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.256788    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j6jlh\""
Jul 22 09:27:41.257288 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.257271    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 09:27:41.262923 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.262901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"]
Jul 22 09:27:41.416958 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.416925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txgtd\" (UniqueName: \"kubernetes.io/projected/609abafb-fb9c-4155-8103-69443d87d4cf-kube-api-access-txgtd\") pod \"payload-pre-processing-7677b774bb-vmpzj\" (UID: \"609abafb-fb9c-4155-8103-69443d87d4cf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.417115 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.416978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/609abafb-fb9c-4155-8103-69443d87d4cf-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vmpzj\" (UID: \"609abafb-fb9c-4155-8103-69443d87d4cf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.518344 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.518272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txgtd\" (UniqueName: \"kubernetes.io/projected/609abafb-fb9c-4155-8103-69443d87d4cf-kube-api-access-txgtd\") pod \"payload-pre-processing-7677b774bb-vmpzj\" (UID: \"609abafb-fb9c-4155-8103-69443d87d4cf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.518344 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.518318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/609abafb-fb9c-4155-8103-69443d87d4cf-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vmpzj\" (UID: \"609abafb-fb9c-4155-8103-69443d87d4cf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.519119 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.519096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/609abafb-fb9c-4155-8103-69443d87d4cf-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vmpzj\" (UID: \"609abafb-fb9c-4155-8103-69443d87d4cf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.527882 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.527859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txgtd\" (UniqueName: \"kubernetes.io/projected/609abafb-fb9c-4155-8103-69443d87d4cf-kube-api-access-txgtd\") pod \"payload-pre-processing-7677b774bb-vmpzj\" (UID: \"609abafb-fb9c-4155-8103-69443d87d4cf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.566244 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.566219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:41.703325 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:41.703238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"]
Jul 22 09:27:41.706011 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:27:41.705980    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609abafb_fb9c_4155_8103_69443d87d4cf.slice/crio-814cdffd3f86c7e646b65ea1d284815ff58897a87159e84150c4cc0b9f6d3c7b WatchSource:0}: Error finding container 814cdffd3f86c7e646b65ea1d284815ff58897a87159e84150c4cc0b9f6d3c7b: Status 404 returned error can't find the container with id 814cdffd3f86c7e646b65ea1d284815ff58897a87159e84150c4cc0b9f6d3c7b
Jul 22 09:27:42.652968 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:42.652898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj" event={"ID":"609abafb-fb9c-4155-8103-69443d87d4cf","Type":"ContainerStarted","Data":"814cdffd3f86c7e646b65ea1d284815ff58897a87159e84150c4cc0b9f6d3c7b"}
Jul 22 09:27:44.664057 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:44.664021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj" event={"ID":"609abafb-fb9c-4155-8103-69443d87d4cf","Type":"ContainerStarted","Data":"269b8cf7b4dce5f42dfe2aca2849ef8bb344a30e1ad32ec48c425b53cf7b95e5"}
Jul 22 09:27:44.664541 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:44.664167    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:44.683443 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:44.683399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj" podStartSLOduration=1.313569869 podStartE2EDuration="3.683385827s" totalImagesPullingTime="2.369815958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:27:44.681385644 +0000 UTC m=+620.275377786" watchObservedRunningTime="2026-07-22 09:27:44.683385827 +0000 UTC m=+620.277377972"
Jul 22 09:27:55.671732 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:55.671649    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vmpzj"
Jul 22 09:27:59.756337 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.756306    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"]
Jul 22 09:27:59.760136 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.760115    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.762533 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.762515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 09:27:59.763500 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.763467    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 09:27:59.763613 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.763590    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xgb7q\""
Jul 22 09:27:59.763732 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.763692    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 09:27:59.770469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.770450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"]
Jul 22 09:27:59.859091 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.859068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.859226 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.859096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.859226 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.859120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.859226 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.859151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.859337 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.859219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.859337 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.859282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6wpn\" (UniqueName: \"kubernetes.io/projected/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-kube-api-access-h6wpn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960086 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960225 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960225 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6wpn\" (UniqueName: \"kubernetes.io/projected/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-kube-api-access-h6wpn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960225 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960225 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960469 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960571 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960624 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.960659 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.960639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.962569 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.962545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.962718 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.962700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:27:59.969008 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:27:59.968986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6wpn\" (UniqueName: \"kubernetes.io/projected/faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6-kube-api-access-h6wpn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t\" (UID: \"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:28:00.071316 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:00.071236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:28:00.210174 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:00.210152    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"]
Jul 22 09:28:00.212176 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:28:00.212150    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa3717e_47f2_4fd9_b5c5_a16ac8c4cae6.slice/crio-10706791dd0a2091038b323068498f21316a3f2ac46dd465b015f48dc6f73d98 WatchSource:0}: Error finding container 10706791dd0a2091038b323068498f21316a3f2ac46dd465b015f48dc6f73d98: Status 404 returned error can't find the container with id 10706791dd0a2091038b323068498f21316a3f2ac46dd465b015f48dc6f73d98
Jul 22 09:28:00.742208 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:00.742172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t" event={"ID":"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6","Type":"ContainerStarted","Data":"10706791dd0a2091038b323068498f21316a3f2ac46dd465b015f48dc6f73d98"}
Jul 22 09:28:01.749038 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:01.748959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t" event={"ID":"faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6","Type":"ContainerStarted","Data":"868fedbb60b3f01cadb0b1623df987843d496b16d1b83f1b8d513cb038bfe3f2"}
Jul 22 09:28:01.771367 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:01.771315    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t" podStartSLOduration=1.57318398 podStartE2EDuration="2.771299291s" totalImagesPullingTime="1.198115311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:28:01.770045301 +0000 UTC m=+637.364037495" watchObservedRunningTime="2026-07-22 09:28:01.771299291 +0000 UTC m=+637.365291434"
Jul 22 09:28:10.071997 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:10.071956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:28:10.072507 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:10.072022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:28:10.084048 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:10.084026    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:28:10.805902 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:10.805876    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t"
Jul 22 09:28:18.351185 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.351154    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"]
Jul 22 09:28:18.357941 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.357920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.360301 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.360280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 09:28:18.369261 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.369240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"]
Jul 22 09:28:18.509600 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.509571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.509783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.509611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.509783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.509666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.509783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.509696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.509783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.509744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvpmc\" (UniqueName: \"kubernetes.io/projected/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-kube-api-access-nvpmc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.509783 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.509765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610179 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610179 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610353 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610353 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610353 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvpmc\" (UniqueName: \"kubernetes.io/projected/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-kube-api-access-nvpmc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610353 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610723 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610884 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.610884 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.610735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.612782 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.612756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.612901 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.612872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.624969 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.624935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvpmc\" (UniqueName: \"kubernetes.io/projected/e5f43d59-eab4-42d1-9ef6-b8d100e828ac-kube-api-access-nvpmc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-snpfs\" (UID: \"e5f43d59-eab4-42d1-9ef6-b8d100e828ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.667910 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.667875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:18.810975 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.809660    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"]
Jul 22 09:28:18.813584 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:28:18.813544    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f43d59_eab4_42d1_9ef6_b8d100e828ac.slice/crio-2be99ae8d76b374b5719dfa365530903088f18091a28816d81157bbd7d3eaac5 WatchSource:0}: Error finding container 2be99ae8d76b374b5719dfa365530903088f18091a28816d81157bbd7d3eaac5: Status 404 returned error can't find the container with id 2be99ae8d76b374b5719dfa365530903088f18091a28816d81157bbd7d3eaac5
Jul 22 09:28:18.831701 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:18.831676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs" event={"ID":"e5f43d59-eab4-42d1-9ef6-b8d100e828ac","Type":"ContainerStarted","Data":"2be99ae8d76b374b5719dfa365530903088f18091a28816d81157bbd7d3eaac5"}
Jul 22 09:28:19.838864 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:19.838816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs" event={"ID":"e5f43d59-eab4-42d1-9ef6-b8d100e828ac","Type":"ContainerStarted","Data":"8a0517f3dcb94e68baf62beb60277c4c0aeb18496ea638ea303089f1b120265c"}
Jul 22 09:28:19.862552 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:19.862506    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs" podStartSLOduration=1.667569097 podStartE2EDuration="1.862491019s" totalImagesPullingTime="194.921922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:28:19.859360844 +0000 UTC m=+655.453352988" watchObservedRunningTime="2026-07-22 09:28:19.862491019 +0000 UTC m=+655.456483161"
Jul 22 09:28:28.668691 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:28.668652    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:28.669120 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:28.668735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:28.680969 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:28.680950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:28.897600 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:28.897577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-snpfs"
Jul 22 09:28:58.862459 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.862426    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"]
Jul 22 09:28:58.866449 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.866427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:58.869022 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.869001    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 09:28:58.881030 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.880999    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"]
Jul 22 09:28:58.933669 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.933646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:58.933821 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.933681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:58.933821 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.933722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:58.933821 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.933746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:58.933997 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.933825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03361f77-6d50-4b5e-9870-19cfbae54943-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:58.933997 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:58.933907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hj8\" (UniqueName: \"kubernetes.io/projected/03361f77-6d50-4b5e-9870-19cfbae54943-kube-api-access-49hj8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.034699 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.034667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03361f77-6d50-4b5e-9870-19cfbae54943-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.034864 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.034709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hj8\" (UniqueName: \"kubernetes.io/projected/03361f77-6d50-4b5e-9870-19cfbae54943-kube-api-access-49hj8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.034864 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.034792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.034965 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.034905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.034965 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.034950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.035077 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.034966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.035197 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.035179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.035257 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.035229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.035313 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.035300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.037057 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.037033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03361f77-6d50-4b5e-9870-19cfbae54943-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.037269 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.037249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03361f77-6d50-4b5e-9870-19cfbae54943-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.044617 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.044590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hj8\" (UniqueName: \"kubernetes.io/projected/03361f77-6d50-4b5e-9870-19cfbae54943-kube-api-access-49hj8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nwdgz\" (UID: \"03361f77-6d50-4b5e-9870-19cfbae54943\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.178824 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.178801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:28:59.322638 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.322613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"]
Jul 22 09:28:59.324594 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:28:59.324570    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03361f77_6d50_4b5e_9870_19cfbae54943.slice/crio-40be68b177e669b38dd2eae8778bbae517a1659ad26a310142ef86358061357f WatchSource:0}: Error finding container 40be68b177e669b38dd2eae8778bbae517a1659ad26a310142ef86358061357f: Status 404 returned error can't find the container with id 40be68b177e669b38dd2eae8778bbae517a1659ad26a310142ef86358061357f
Jul 22 09:28:59.325864 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:28:59.325846    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 09:29:00.034040 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:00.034005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz" event={"ID":"03361f77-6d50-4b5e-9870-19cfbae54943","Type":"ContainerStarted","Data":"6dd64af8b6f39482ee6af9bc7b3723e8049f3274a79e8717f070f426418ac442"}
Jul 22 09:29:00.034407 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:00.034060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz" event={"ID":"03361f77-6d50-4b5e-9870-19cfbae54943","Type":"ContainerStarted","Data":"40be68b177e669b38dd2eae8778bbae517a1659ad26a310142ef86358061357f"}
Jul 22 09:29:00.056878 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:00.056808    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz" podStartSLOduration=1.853043545 podStartE2EDuration="2.056789928s" totalImagesPullingTime="203.746383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:29:00.055289252 +0000 UTC m=+695.649281398" watchObservedRunningTime="2026-07-22 09:29:00.056789928 +0000 UTC m=+695.650782075"
Jul 22 09:29:09.179449 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:09.179415    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:29:09.180037 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:09.179480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:29:09.192149 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:09.192120    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:29:10.096857 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:10.096806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nwdgz"
Jul 22 09:29:56.855321 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.855287    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67598d8f66-kp2n2"]
Jul 22 09:29:56.859043 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.859018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:56.862537 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.862515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wqn8n\""
Jul 22 09:29:56.862655 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.862517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 09:29:56.866938 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.866917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67598d8f66-kp2n2"]
Jul 22 09:29:56.903471 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.903444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d81a5400-e086-47a9-9146-aba9de26849b-tls-cert\") pod \"authorino-67598d8f66-kp2n2\" (UID: \"d81a5400-e086-47a9-9146-aba9de26849b\") " pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:56.903589 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:56.903507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6bnb\" (UniqueName: \"kubernetes.io/projected/d81a5400-e086-47a9-9146-aba9de26849b-kube-api-access-z6bnb\") pod \"authorino-67598d8f66-kp2n2\" (UID: \"d81a5400-e086-47a9-9146-aba9de26849b\") " pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:57.004421 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.004392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d81a5400-e086-47a9-9146-aba9de26849b-tls-cert\") pod \"authorino-67598d8f66-kp2n2\" (UID: \"d81a5400-e086-47a9-9146-aba9de26849b\") " pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:57.004532 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.004449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6bnb\" (UniqueName: \"kubernetes.io/projected/d81a5400-e086-47a9-9146-aba9de26849b-kube-api-access-z6bnb\") pod \"authorino-67598d8f66-kp2n2\" (UID: \"d81a5400-e086-47a9-9146-aba9de26849b\") " pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:57.006753 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.006729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d81a5400-e086-47a9-9146-aba9de26849b-tls-cert\") pod \"authorino-67598d8f66-kp2n2\" (UID: \"d81a5400-e086-47a9-9146-aba9de26849b\") " pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:57.014526 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.014502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6bnb\" (UniqueName: \"kubernetes.io/projected/d81a5400-e086-47a9-9146-aba9de26849b-kube-api-access-z6bnb\") pod \"authorino-67598d8f66-kp2n2\" (UID: \"d81a5400-e086-47a9-9146-aba9de26849b\") " pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:57.168920 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.168890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67598d8f66-kp2n2"
Jul 22 09:29:57.299406 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.299281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67598d8f66-kp2n2"]
Jul 22 09:29:57.301755 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:29:57.301728    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd81a5400_e086_47a9_9146_aba9de26849b.slice/crio-9463f4e294f3e68f9b083e330e8162536a67da5491df151dc454c54bec5e87d9 WatchSource:0}: Error finding container 9463f4e294f3e68f9b083e330e8162536a67da5491df151dc454c54bec5e87d9: Status 404 returned error can't find the container with id 9463f4e294f3e68f9b083e330e8162536a67da5491df151dc454c54bec5e87d9
Jul 22 09:29:57.320894 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:57.320862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67598d8f66-kp2n2" event={"ID":"d81a5400-e086-47a9-9146-aba9de26849b","Type":"ContainerStarted","Data":"9463f4e294f3e68f9b083e330e8162536a67da5491df151dc454c54bec5e87d9"}
Jul 22 09:29:58.327652 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:58.327610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67598d8f66-kp2n2" event={"ID":"d81a5400-e086-47a9-9146-aba9de26849b","Type":"ContainerStarted","Data":"7b0c478144136b64509b1aab31bab900c5990bf4cafa0499167475b008a03d3f"}
Jul 22 09:29:58.349757 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:29:58.349705    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67598d8f66-kp2n2" podStartSLOduration=1.7809985350000002 podStartE2EDuration="2.349687631s" totalImagesPullingTime="568.689096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:29:58.349394613 +0000 UTC m=+753.943386768" watchObservedRunningTime="2026-07-22 09:29:58.349687631 +0000 UTC m=+753.943679774"
Jul 22 09:30:47.177635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.177546    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6745b5844c-9xm46"]
Jul 22 09:30:47.178245 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.177768    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6745b5844c-9xm46" podUID="d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" containerName="manager" containerID="cri-o://047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078" gracePeriod=30
Jul 22 09:30:47.439560 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.439467    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:30:47.572079 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.572041    2560 generic.go:356] "Generic (PLEG): container finished" podID="d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" containerID="047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078" exitCode=0
Jul 22 09:30:47.572242 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.572095    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-9xm46"
Jul 22 09:30:47.572242 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.572120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-9xm46" event={"ID":"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183","Type":"ContainerDied","Data":"047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078"}
Jul 22 09:30:47.572242 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.572197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-9xm46" event={"ID":"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183","Type":"ContainerDied","Data":"0c7fadf84d0921bc2a878399e940b0bbf4364dfa5078f59606be6654334c4aed"}
Jul 22 09:30:47.572242 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.572222    2560 scope.go:117] "RemoveContainer" containerID="047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078"
Jul 22 09:30:47.580484 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.580466    2560 scope.go:117] "RemoveContainer" containerID="047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078"
Jul 22 09:30:47.580750 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:30:47.580729    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078\": container with ID starting with 047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078 not found: ID does not exist" containerID="047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078"
Jul 22 09:30:47.580795 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.580757    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078"} err="failed to get container status \"047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078\": rpc error: code = NotFound desc = could not find container \"047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078\": container with ID starting with 047ceb1a392760e6b79c245d21bed9144e4b07736658971dd89924f29ec05078 not found: ID does not exist"
Jul 22 09:30:47.625079 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.625053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert\") pod \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") "
Jul 22 09:30:47.625182 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.625122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2wxs\" (UniqueName: \"kubernetes.io/projected/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-kube-api-access-s2wxs\") pod \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\" (UID: \"d0f1e0c4-bbeb-42c9-9995-c10cfc71f183\") "
Jul 22 09:30:47.627013 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.626988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" (UID: "d0f1e0c4-bbeb-42c9-9995-c10cfc71f183"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:30:47.627094 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.627020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-kube-api-access-s2wxs" (OuterVolumeSpecName: "kube-api-access-s2wxs") pod "d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" (UID: "d0f1e0c4-bbeb-42c9-9995-c10cfc71f183"). InnerVolumeSpecName "kube-api-access-s2wxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:30:47.725624 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.725571    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-webhook-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:30:47.725624 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.725593    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2wxs\" (UniqueName: \"kubernetes.io/projected/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183-kube-api-access-s2wxs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:30:47.896114 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.896089    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6745b5844c-9xm46"]
Jul 22 09:30:47.898997 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:47.898974    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6745b5844c-9xm46"]
Jul 22 09:30:48.908297 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:30:48.908256    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" path="/var/lib/kubelet/pods/d0f1e0c4-bbeb-42c9-9995-c10cfc71f183/volumes"
Jul 22 09:31:48.695497 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.695462    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6745b5844c-d9trc"]
Jul 22 09:31:48.695954 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.695869    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" containerName="manager"
Jul 22 09:31:48.695954 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.695882    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" containerName="manager"
Jul 22 09:31:48.696034 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.695973    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f1e0c4-bbeb-42c9-9995-c10cfc71f183" containerName="manager"
Jul 22 09:31:48.700148 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.700132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:48.703509 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.703478    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 09:31:48.703509 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.703478    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 09:31:48.703701 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.703482    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ks2jk\""
Jul 22 09:31:48.713491 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.713465    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6745b5844c-d9trc"]
Jul 22 09:31:48.746136 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.746102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/751f538c-ecc9-4733-90d4-5041f39420de-webhook-cert\") pod \"maas-controller-6745b5844c-d9trc\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") " pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:48.746255 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.746164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zml\" (UniqueName: \"kubernetes.io/projected/751f538c-ecc9-4733-90d4-5041f39420de-kube-api-access-22zml\") pod \"maas-controller-6745b5844c-d9trc\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") " pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:48.846686 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.846660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/751f538c-ecc9-4733-90d4-5041f39420de-webhook-cert\") pod \"maas-controller-6745b5844c-d9trc\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") " pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:48.846786 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.846697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22zml\" (UniqueName: \"kubernetes.io/projected/751f538c-ecc9-4733-90d4-5041f39420de-kube-api-access-22zml\") pod \"maas-controller-6745b5844c-d9trc\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") " pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:48.849034 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.849014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/751f538c-ecc9-4733-90d4-5041f39420de-webhook-cert\") pod \"maas-controller-6745b5844c-d9trc\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") " pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:48.856804 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:48.856784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zml\" (UniqueName: \"kubernetes.io/projected/751f538c-ecc9-4733-90d4-5041f39420de-kube-api-access-22zml\") pod \"maas-controller-6745b5844c-d9trc\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") " pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:49.010038 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:49.009972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:49.150111 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:49.150087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6745b5844c-d9trc"]
Jul 22 09:31:49.152753 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:31:49.152724    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751f538c_ecc9_4733_90d4_5041f39420de.slice/crio-9bfc8001b914ddec65fea92196cfa792998c1078867cdf41d5f536f0e191830d WatchSource:0}: Error finding container 9bfc8001b914ddec65fea92196cfa792998c1078867cdf41d5f536f0e191830d: Status 404 returned error can't find the container with id 9bfc8001b914ddec65fea92196cfa792998c1078867cdf41d5f536f0e191830d
Jul 22 09:31:49.881635 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:49.881608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-d9trc" event={"ID":"751f538c-ecc9-4733-90d4-5041f39420de","Type":"ContainerStarted","Data":"300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d"}
Jul 22 09:31:49.881994 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:49.881659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-d9trc" event={"ID":"751f538c-ecc9-4733-90d4-5041f39420de","Type":"ContainerStarted","Data":"9bfc8001b914ddec65fea92196cfa792998c1078867cdf41d5f536f0e191830d"}
Jul 22 09:31:49.881994 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:49.881750    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:31:49.903575 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:31:49.903523    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6745b5844c-d9trc" podStartSLOduration=1.386418153 podStartE2EDuration="1.903505868s" totalImagesPullingTime="517.087715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:31:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:31:49.901591402 +0000 UTC m=+865.495583542" watchObservedRunningTime="2026-07-22 09:31:49.903505868 +0000 UTC m=+865.497498011"
Jul 22 09:32:00.889012 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:00.888978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:32:05.510978 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.510940    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6745b5844c-d9trc"]
Jul 22 09:32:05.511418 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.511145    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6745b5844c-d9trc" podUID="751f538c-ecc9-4733-90d4-5041f39420de" containerName="manager" containerID="cri-o://300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d" gracePeriod=30
Jul 22 09:32:05.760703 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.760683    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:32:05.890118 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.890090    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/751f538c-ecc9-4733-90d4-5041f39420de-webhook-cert\") pod \"751f538c-ecc9-4733-90d4-5041f39420de\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") "
Jul 22 09:32:05.890311 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.890146    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22zml\" (UniqueName: \"kubernetes.io/projected/751f538c-ecc9-4733-90d4-5041f39420de-kube-api-access-22zml\") pod \"751f538c-ecc9-4733-90d4-5041f39420de\" (UID: \"751f538c-ecc9-4733-90d4-5041f39420de\") "
Jul 22 09:32:05.892233 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.892197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751f538c-ecc9-4733-90d4-5041f39420de-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "751f538c-ecc9-4733-90d4-5041f39420de" (UID: "751f538c-ecc9-4733-90d4-5041f39420de"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 09:32:05.892395 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.892282    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751f538c-ecc9-4733-90d4-5041f39420de-kube-api-access-22zml" (OuterVolumeSpecName: "kube-api-access-22zml") pod "751f538c-ecc9-4733-90d4-5041f39420de" (UID: "751f538c-ecc9-4733-90d4-5041f39420de"). InnerVolumeSpecName "kube-api-access-22zml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:32:05.971109 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.971073    2560 generic.go:356] "Generic (PLEG): container finished" podID="751f538c-ecc9-4733-90d4-5041f39420de" containerID="300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d" exitCode=0
Jul 22 09:32:05.971278 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.971117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-d9trc"
Jul 22 09:32:05.971278 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.971156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-d9trc" event={"ID":"751f538c-ecc9-4733-90d4-5041f39420de","Type":"ContainerDied","Data":"300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d"}
Jul 22 09:32:05.971278 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.971207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-d9trc" event={"ID":"751f538c-ecc9-4733-90d4-5041f39420de","Type":"ContainerDied","Data":"9bfc8001b914ddec65fea92196cfa792998c1078867cdf41d5f536f0e191830d"}
Jul 22 09:32:05.971278 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.971228    2560 scope.go:117] "RemoveContainer" containerID="300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d"
Jul 22 09:32:05.980305 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.980288    2560 scope.go:117] "RemoveContainer" containerID="300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d"
Jul 22 09:32:05.980577 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:32:05.980558    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d\": container with ID starting with 300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d not found: ID does not exist" containerID="300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d"
Jul 22 09:32:05.980625 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.980586    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d"} err="failed to get container status \"300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d\": rpc error: code = NotFound desc = could not find container \"300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d\": container with ID starting with 300d1d35de2a2a973f9d0f609f9d0412a0c69c60e76dd3905a99778a5295801d not found: ID does not exist"
Jul 22 09:32:05.991929 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.991907    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/751f538c-ecc9-4733-90d4-5041f39420de-webhook-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:32:05.992022 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.991941    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22zml\" (UniqueName: \"kubernetes.io/projected/751f538c-ecc9-4733-90d4-5041f39420de-kube-api-access-22zml\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:32:05.993314 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.993293    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6745b5844c-d9trc"]
Jul 22 09:32:05.997092 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:05.997072    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6745b5844c-d9trc"]
Jul 22 09:32:06.773558 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.773525    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6745b5844c-2p2zt"]
Jul 22 09:32:06.773943 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.773930    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751f538c-ecc9-4733-90d4-5041f39420de" containerName="manager"
Jul 22 09:32:06.773943 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.773944    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="751f538c-ecc9-4733-90d4-5041f39420de" containerName="manager"
Jul 22 09:32:06.774023 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.774017    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="751f538c-ecc9-4733-90d4-5041f39420de" containerName="manager"
Jul 22 09:32:06.778560 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.778536    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:06.783776 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.783753    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 09:32:06.783917 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.783759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ks2jk\""
Jul 22 09:32:06.783917 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.783865    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 09:32:06.787020 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.786993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6745b5844c-2p2zt"]
Jul 22 09:32:06.901562 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.901526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nktjn\" (UniqueName: \"kubernetes.io/projected/3071b259-f7a2-4467-9818-26808b4b6966-kube-api-access-nktjn\") pod \"maas-controller-6745b5844c-2p2zt\" (UID: \"3071b259-f7a2-4467-9818-26808b4b6966\") " pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:06.901713 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.901606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3071b259-f7a2-4467-9818-26808b4b6966-webhook-cert\") pod \"maas-controller-6745b5844c-2p2zt\" (UID: \"3071b259-f7a2-4467-9818-26808b4b6966\") " pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:06.909113 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:06.909089    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751f538c-ecc9-4733-90d4-5041f39420de" path="/var/lib/kubelet/pods/751f538c-ecc9-4733-90d4-5041f39420de/volumes"
Jul 22 09:32:07.002963 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.002932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3071b259-f7a2-4467-9818-26808b4b6966-webhook-cert\") pod \"maas-controller-6745b5844c-2p2zt\" (UID: \"3071b259-f7a2-4467-9818-26808b4b6966\") " pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:07.003134 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.003030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nktjn\" (UniqueName: \"kubernetes.io/projected/3071b259-f7a2-4467-9818-26808b4b6966-kube-api-access-nktjn\") pod \"maas-controller-6745b5844c-2p2zt\" (UID: \"3071b259-f7a2-4467-9818-26808b4b6966\") " pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:07.005560 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.005535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3071b259-f7a2-4467-9818-26808b4b6966-webhook-cert\") pod \"maas-controller-6745b5844c-2p2zt\" (UID: \"3071b259-f7a2-4467-9818-26808b4b6966\") " pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:07.019883 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.019863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nktjn\" (UniqueName: \"kubernetes.io/projected/3071b259-f7a2-4467-9818-26808b4b6966-kube-api-access-nktjn\") pod \"maas-controller-6745b5844c-2p2zt\" (UID: \"3071b259-f7a2-4467-9818-26808b4b6966\") " pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:07.089543 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.089474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:07.238771 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.238749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6745b5844c-2p2zt"]
Jul 22 09:32:07.240946 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:32:07.240918    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3071b259_f7a2_4467_9818_26808b4b6966.slice/crio-df73fdd9cd10dc671537a9b8562788fd02de36db5ee1eef7995aa91916b338db WatchSource:0}: Error finding container df73fdd9cd10dc671537a9b8562788fd02de36db5ee1eef7995aa91916b338db: Status 404 returned error can't find the container with id df73fdd9cd10dc671537a9b8562788fd02de36db5ee1eef7995aa91916b338db
Jul 22 09:32:07.984568 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.984529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-2p2zt" event={"ID":"3071b259-f7a2-4467-9818-26808b4b6966","Type":"ContainerStarted","Data":"316f1b595ce22f0c284060d77cc70ff4e6ec5238f84fec928e848c7c5ccf09dc"}
Jul 22 09:32:07.985018 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.984583    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6745b5844c-2p2zt" event={"ID":"3071b259-f7a2-4467-9818-26808b4b6966","Type":"ContainerStarted","Data":"df73fdd9cd10dc671537a9b8562788fd02de36db5ee1eef7995aa91916b338db"}
Jul 22 09:32:07.985018 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:07.984636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:08.005446 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:08.005383    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6745b5844c-2p2zt" podStartSLOduration=1.648083836 podStartE2EDuration="2.005363221s" totalImagesPullingTime="357.279385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:32:08.004606497 +0000 UTC m=+883.598598641" watchObservedRunningTime="2026-07-22 09:32:08.005363221 +0000 UTC m=+883.599355364"
Jul 22 09:32:18.992371 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:18.992285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6745b5844c-2p2zt"
Jul 22 09:32:24.828697 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:24.828665    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:32:24.831168 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:32:24.831147    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:36:47.754791 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:47.754706    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"]
Jul 22 09:36:47.757658 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:47.754936    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz" podUID="fe984605-46cd-4dc2-93f8-8a6fc214463e" containerName="manager" containerID="cri-o://b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09" gracePeriod=10
Jul 22 09:36:51.614551 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.614523    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:36:51.720421 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.720337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe984605-46cd-4dc2-93f8-8a6fc214463e-extensions-socket-volume\") pod \"fe984605-46cd-4dc2-93f8-8a6fc214463e\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") "
Jul 22 09:36:51.720421 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.720395    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgc62\" (UniqueName: \"kubernetes.io/projected/fe984605-46cd-4dc2-93f8-8a6fc214463e-kube-api-access-bgc62\") pod \"fe984605-46cd-4dc2-93f8-8a6fc214463e\" (UID: \"fe984605-46cd-4dc2-93f8-8a6fc214463e\") "
Jul 22 09:36:51.720727 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.720705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe984605-46cd-4dc2-93f8-8a6fc214463e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe984605-46cd-4dc2-93f8-8a6fc214463e" (UID: "fe984605-46cd-4dc2-93f8-8a6fc214463e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 09:36:51.722535 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.722515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe984605-46cd-4dc2-93f8-8a6fc214463e-kube-api-access-bgc62" (OuterVolumeSpecName: "kube-api-access-bgc62") pod "fe984605-46cd-4dc2-93f8-8a6fc214463e" (UID: "fe984605-46cd-4dc2-93f8-8a6fc214463e"). InnerVolumeSpecName "kube-api-access-bgc62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 09:36:51.821296 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.821261    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe984605-46cd-4dc2-93f8-8a6fc214463e-extensions-socket-volume\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:36:51.821296 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:51.821289    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgc62\" (UniqueName: \"kubernetes.io/projected/fe984605-46cd-4dc2-93f8-8a6fc214463e-kube-api-access-bgc62\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 09:36:52.416434 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.416393    2560 generic.go:356] "Generic (PLEG): container finished" podID="fe984605-46cd-4dc2-93f8-8a6fc214463e" containerID="b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09" exitCode=0
Jul 22 09:36:52.416615 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.416443    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"
Jul 22 09:36:52.416615 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.416481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz" event={"ID":"fe984605-46cd-4dc2-93f8-8a6fc214463e","Type":"ContainerDied","Data":"b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09"}
Jul 22 09:36:52.416615 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.416533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz" event={"ID":"fe984605-46cd-4dc2-93f8-8a6fc214463e","Type":"ContainerDied","Data":"33bfbb1409a9c2e7d9092834791e6221aa72e466e3fd06b294c0d3463591bbfc"}
Jul 22 09:36:52.416615 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.416561    2560 scope.go:117] "RemoveContainer" containerID="b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09"
Jul 22 09:36:52.426704 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.426689    2560 scope.go:117] "RemoveContainer" containerID="b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09"
Jul 22 09:36:52.426982 ip-10-0-142-141 kubenswrapper[2560]: E0722 09:36:52.426966    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09\": container with ID starting with b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09 not found: ID does not exist" containerID="b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09"
Jul 22 09:36:52.427051 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.426988    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09"} err="failed to get container status \"b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09\": rpc error: code = NotFound desc = could not find container \"b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09\": container with ID starting with b6b2296cd0ae63d3c2f899061ac6a240cce29c886a90ef6ed009d23b17f87e09 not found: ID does not exist"
Jul 22 09:36:52.439909 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.439886    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"]
Jul 22 09:36:52.447193 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.447171    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vkbrz"]
Jul 22 09:36:52.914003 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:36:52.913968    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe984605-46cd-4dc2-93f8-8a6fc214463e" path="/var/lib/kubelet/pods/fe984605-46cd-4dc2-93f8-8a6fc214463e/volumes"
Jul 22 09:37:24.858436 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:24.858409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:37:24.859022 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:24.858491    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:37:48.889828 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.889794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"]
Jul 22 09:37:48.890219 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.890205    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe984605-46cd-4dc2-93f8-8a6fc214463e" containerName="manager"
Jul 22 09:37:48.890263 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.890221    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe984605-46cd-4dc2-93f8-8a6fc214463e" containerName="manager"
Jul 22 09:37:48.890298 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.890289    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe984605-46cd-4dc2-93f8-8a6fc214463e" containerName="manager"
Jul 22 09:37:48.894404 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.894386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:48.898039 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.898019    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mbtvm\""
Jul 22 09:37:48.909459 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:48.909427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"]
Jul 22 09:37:49.003709 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.003684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad4bf55c-8f51-44ab-9c32-6f4fe98efca6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-psw89\" (UID: \"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.003814 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.003735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbg77\" (UniqueName: \"kubernetes.io/projected/ad4bf55c-8f51-44ab-9c32-6f4fe98efca6-kube-api-access-pbg77\") pod \"kuadrant-operator-controller-manager-86878c769f-psw89\" (UID: \"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.104144 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.104116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbg77\" (UniqueName: \"kubernetes.io/projected/ad4bf55c-8f51-44ab-9c32-6f4fe98efca6-kube-api-access-pbg77\") pod \"kuadrant-operator-controller-manager-86878c769f-psw89\" (UID: \"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.104237 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.104186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad4bf55c-8f51-44ab-9c32-6f4fe98efca6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-psw89\" (UID: \"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.104532 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.104516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad4bf55c-8f51-44ab-9c32-6f4fe98efca6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-psw89\" (UID: \"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.116769 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.116744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbg77\" (UniqueName: \"kubernetes.io/projected/ad4bf55c-8f51-44ab-9c32-6f4fe98efca6-kube-api-access-pbg77\") pod \"kuadrant-operator-controller-manager-86878c769f-psw89\" (UID: \"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.205248 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.205193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.346222 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.346189    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"]
Jul 22 09:37:49.349364 ip-10-0-142-141 kubenswrapper[2560]: W0722 09:37:49.349336    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4bf55c_8f51_44ab_9c32_6f4fe98efca6.slice/crio-17faff626847809272f1916fcdd1e5a4f2fd18bc97c51d7f49844945181c25fd WatchSource:0}: Error finding container 17faff626847809272f1916fcdd1e5a4f2fd18bc97c51d7f49844945181c25fd: Status 404 returned error can't find the container with id 17faff626847809272f1916fcdd1e5a4f2fd18bc97c51d7f49844945181c25fd
Jul 22 09:37:49.687929 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.687900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89" event={"ID":"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6","Type":"ContainerStarted","Data":"829d04ad862bddb1d72c479a91196221c6e8a0d379c3dbc705fae5055ea30ef2"}
Jul 22 09:37:49.688077 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.687952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89" event={"ID":"ad4bf55c-8f51-44ab-9c32-6f4fe98efca6","Type":"ContainerStarted","Data":"17faff626847809272f1916fcdd1e5a4f2fd18bc97c51d7f49844945181c25fd"}
Jul 22 09:37:49.688077 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.687975    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:37:49.713895 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:37:49.713822    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89" podStartSLOduration=1.713807656 podStartE2EDuration="1.713807656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 09:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 09:37:49.710773521 +0000 UTC m=+1225.304765818" watchObservedRunningTime="2026-07-22 09:37:49.713807656 +0000 UTC m=+1225.307799800"
Jul 22 09:38:00.695696 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:38:00.695660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-psw89"
Jul 22 09:42:24.889721 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:42:24.889693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:42:24.892524 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:42:24.892499    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:47:24.919650 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:47:24.919620    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:47:24.924059 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:47:24.924039    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:52:24.955362 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:52:24.955333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:52:24.961063 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:52:24.961039    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:57:24.985178 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:57:24.985056    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 09:57:24.991689 ip-10-0-142-141 kubenswrapper[2560]: I0722 09:57:24.991663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 10:02:25.014621 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:02:25.014516    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 10:02:25.026980 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:02:25.026956    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 10:03:00.433985 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.433948    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140659278496304"]
Jul 22 10:03:00.437621 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.437600    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:00.440235 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.440214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dpq4v\""
Jul 22 10:03:00.447217 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.447198    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278496304"]
Jul 22 10:03:00.547741 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.547714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf469\" (UniqueName: \"kubernetes.io/projected/619bbab9-8366-4bec-92ee-8dcabdbbaeea-kube-api-access-vf469\") pod \"test-curl-7422-140659278496304\" (UID: \"619bbab9-8366-4bec-92ee-8dcabdbbaeea\") " pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:00.648315 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.648290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf469\" (UniqueName: \"kubernetes.io/projected/619bbab9-8366-4bec-92ee-8dcabdbbaeea-kube-api-access-vf469\") pod \"test-curl-7422-140659278496304\" (UID: \"619bbab9-8366-4bec-92ee-8dcabdbbaeea\") " pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:00.657679 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.657652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf469\" (UniqueName: \"kubernetes.io/projected/619bbab9-8366-4bec-92ee-8dcabdbbaeea-kube-api-access-vf469\") pod \"test-curl-7422-140659278496304\" (UID: \"619bbab9-8366-4bec-92ee-8dcabdbbaeea\") " pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:00.748220 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.748153    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:00.884623 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.884601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278496304"]
Jul 22 10:03:00.886911 ip-10-0-142-141 kubenswrapper[2560]: W0722 10:03:00.886882    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod619bbab9_8366_4bec_92ee_8dcabdbbaeea.slice/crio-a722d1f2843dcc5dd1989841dd0f970d6a82c56f4ee7bb3da775af81822055d0 WatchSource:0}: Error finding container a722d1f2843dcc5dd1989841dd0f970d6a82c56f4ee7bb3da775af81822055d0: Status 404 returned error can't find the container with id a722d1f2843dcc5dd1989841dd0f970d6a82c56f4ee7bb3da775af81822055d0
Jul 22 10:03:00.888173 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:00.888154    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 10:03:01.224308 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:01.224275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278496304" event={"ID":"619bbab9-8366-4bec-92ee-8dcabdbbaeea","Type":"ContainerStarted","Data":"a722d1f2843dcc5dd1989841dd0f970d6a82c56f4ee7bb3da775af81822055d0"}
Jul 22 10:03:02.230243 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:02.230208    2560 generic.go:356] "Generic (PLEG): container finished" podID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" containerID="a01ad52e4e692d0d4d88c9ad0028687992c818be5999ce4e9aab9c495781f2df" exitCode=0
Jul 22 10:03:02.230625 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:02.230293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278496304" event={"ID":"619bbab9-8366-4bec-92ee-8dcabdbbaeea","Type":"ContainerDied","Data":"a01ad52e4e692d0d4d88c9ad0028687992c818be5999ce4e9aab9c495781f2df"}
Jul 22 10:03:03.370703 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.370682    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:03.410760 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.410737    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140659278496304_619bbab9-8366-4bec-92ee-8dcabdbbaeea/test-curl-7422-140659278496304/0.log"
Jul 22 10:03:03.434254 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.434230    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140659278496304"]
Jul 22 10:03:03.438491 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.438470    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140659278496304"]
Jul 22 10:03:03.475122 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.475098    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf469\" (UniqueName: \"kubernetes.io/projected/619bbab9-8366-4bec-92ee-8dcabdbbaeea-kube-api-access-vf469\") pod \"619bbab9-8366-4bec-92ee-8dcabdbbaeea\" (UID: \"619bbab9-8366-4bec-92ee-8dcabdbbaeea\") "
Jul 22 10:03:03.477083 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.477064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619bbab9-8366-4bec-92ee-8dcabdbbaeea-kube-api-access-vf469" (OuterVolumeSpecName: "kube-api-access-vf469") pod "619bbab9-8366-4bec-92ee-8dcabdbbaeea" (UID: "619bbab9-8366-4bec-92ee-8dcabdbbaeea"). InnerVolumeSpecName "kube-api-access-vf469". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 10:03:03.561547 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.561465    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140659278498608"]
Jul 22 10:03:03.561888 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.561874    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" containerName="test-curl-7422-140659278496304"
Jul 22 10:03:03.561937 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.561889    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" containerName="test-curl-7422-140659278496304"
Jul 22 10:03:03.561972 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.561955    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" containerName="test-curl-7422-140659278496304"
Jul 22 10:03:03.564812 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.564794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:03.571560 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.571520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278498608"]
Jul 22 10:03:03.575811 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.575790    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf469\" (UniqueName: \"kubernetes.io/projected/619bbab9-8366-4bec-92ee-8dcabdbbaeea-kube-api-access-vf469\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 10:03:03.677181 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.677148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8h7\" (UniqueName: \"kubernetes.io/projected/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a-kube-api-access-xn8h7\") pod \"test-curl-7422-140659278498608\" (UID: \"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a\") " pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:03.778057 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.778030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8h7\" (UniqueName: \"kubernetes.io/projected/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a-kube-api-access-xn8h7\") pod \"test-curl-7422-140659278498608\" (UID: \"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a\") " pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:03.787065 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.787035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8h7\" (UniqueName: \"kubernetes.io/projected/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a-kube-api-access-xn8h7\") pod \"test-curl-7422-140659278498608\" (UID: \"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a\") " pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:03.875492 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:03.875474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:04.012469 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:04.012433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278498608"]
Jul 22 10:03:04.013991 ip-10-0-142-141 kubenswrapper[2560]: W0722 10:03:04.013956    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8ef4bfc_6724_4eac_8efe_0e3ef065cb6a.slice/crio-040e5407be97aace3fe7da87451d5350c94bc105280e41817c9924d834b4e4b8 WatchSource:0}: Error finding container 040e5407be97aace3fe7da87451d5350c94bc105280e41817c9924d834b4e4b8: Status 404 returned error can't find the container with id 040e5407be97aace3fe7da87451d5350c94bc105280e41817c9924d834b4e4b8
Jul 22 10:03:04.241042 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:04.240985    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:04.241165 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:04.240991    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a722d1f2843dcc5dd1989841dd0f970d6a82c56f4ee7bb3da775af81822055d0"
Jul 22 10:03:04.242114 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:04.242091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278498608" event={"ID":"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a","Type":"ContainerStarted","Data":"040e5407be97aace3fe7da87451d5350c94bc105280e41817c9924d834b4e4b8"}
Jul 22 10:03:04.251609 ip-10-0-142-141 kubenswrapper[2560]: E0722 10:03:04.251582    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140659278496304\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:04.907248 ip-10-0-142-141 kubenswrapper[2560]: E0722 10:03:04.907203    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140659278496304\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" pod="opendatahub/test-curl-7422-140659278496304"
Jul 22 10:03:04.908801 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:04.908778    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619bbab9-8366-4bec-92ee-8dcabdbbaeea" path="/var/lib/kubelet/pods/619bbab9-8366-4bec-92ee-8dcabdbbaeea/volumes"
Jul 22 10:03:05.248073 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:05.247998    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a" containerID="73021d715d54796c573f5a23dc7fc8d0eb907c9159c3b0fa4abf043b8854a0dc" exitCode=0
Jul 22 10:03:05.248073 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:05.248041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278498608" event={"ID":"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a","Type":"ContainerDied","Data":"73021d715d54796c573f5a23dc7fc8d0eb907c9159c3b0fa4abf043b8854a0dc"}
Jul 22 10:03:06.402678 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.402653    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:06.432233 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.432206    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140659278498608_f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a/test-curl-7422-140659278498608/0.log"
Jul 22 10:03:06.457464 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.457440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140659278498608"]
Jul 22 10:03:06.461825 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.461804    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140659278498608"]
Jul 22 10:03:06.498984 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.498952    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn8h7\" (UniqueName: \"kubernetes.io/projected/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a-kube-api-access-xn8h7\") pod \"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a\" (UID: \"f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a\") "
Jul 22 10:03:06.500957 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.500933    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a-kube-api-access-xn8h7" (OuterVolumeSpecName: "kube-api-access-xn8h7") pod "f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a" (UID: "f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a"). InnerVolumeSpecName "kube-api-access-xn8h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 10:03:06.600502 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.600460    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn8h7\" (UniqueName: \"kubernetes.io/projected/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a-kube-api-access-xn8h7\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 10:03:06.615698 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.615665    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:06.616129 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.616109    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a" containerName="test-curl-7422-140659278498608"
Jul 22 10:03:06.616129 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.616127    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a" containerName="test-curl-7422-140659278498608"
Jul 22 10:03:06.616306 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.616203    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a" containerName="test-curl-7422-140659278498608"
Jul 22 10:03:06.619220 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.619203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:06.627195 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.627170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:06.701351 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.701325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjjw9\" (UniqueName: \"kubernetes.io/projected/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f-kube-api-access-jjjw9\") pod \"test-curl-7422-140659278541856\" (UID: \"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f\") " pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:06.802428 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.802353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjjw9\" (UniqueName: \"kubernetes.io/projected/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f-kube-api-access-jjjw9\") pod \"test-curl-7422-140659278541856\" (UID: \"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f\") " pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:06.811111 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.811075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjjw9\" (UniqueName: \"kubernetes.io/projected/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f-kube-api-access-jjjw9\") pod \"test-curl-7422-140659278541856\" (UID: \"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f\") " pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:06.909052 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.909023    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a" path="/var/lib/kubelet/pods/f8ef4bfc-6724-4eac-8efe-0e3ef065cb6a/volumes"
Jul 22 10:03:06.929247 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:06.929215    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:07.067354 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:07.067328    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:07.069895 ip-10-0-142-141 kubenswrapper[2560]: W0722 10:03:07.069867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec174cf9_97b1_42fd_a4c9_f8c3f407ac5f.slice/crio-aafc0c513423b2393f60ac2fa3beded4113ac7ade5930eb462549a78408c137d WatchSource:0}: Error finding container aafc0c513423b2393f60ac2fa3beded4113ac7ade5930eb462549a78408c137d: Status 404 returned error can't find the container with id aafc0c513423b2393f60ac2fa3beded4113ac7ade5930eb462549a78408c137d
Jul 22 10:03:07.259028 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:07.259000    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278498608"
Jul 22 10:03:07.259214 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:07.259065    2560 scope.go:117] "RemoveContainer" containerID="73021d715d54796c573f5a23dc7fc8d0eb907c9159c3b0fa4abf043b8854a0dc"
Jul 22 10:03:07.260322 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:07.260129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278541856" event={"ID":"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f","Type":"ContainerStarted","Data":"aafc0c513423b2393f60ac2fa3beded4113ac7ade5930eb462549a78408c137d"}
Jul 22 10:03:08.267279 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:08.267244    2560 generic.go:356] "Generic (PLEG): container finished" podID="ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" containerID="aae32e625c2de29260d8a085e461ac77950e272c26c984ed32e080a47705583b" exitCode=0
Jul 22 10:03:08.267696 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:08.267299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278541856" event={"ID":"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f","Type":"ContainerDied","Data":"aae32e625c2de29260d8a085e461ac77950e272c26c984ed32e080a47705583b"}
Jul 22 10:03:09.409351 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.409326    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:09.436344 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.436318    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140659278541856_ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f/test-curl-7422-140659278541856/0.log"
Jul 22 10:03:09.460499 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.460459    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:09.464520 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.464491    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:09.527258 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.527200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjjw9\" (UniqueName: \"kubernetes.io/projected/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f-kube-api-access-jjjw9\") pod \"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f\" (UID: \"ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f\") "
Jul 22 10:03:09.529193 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.529175    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f-kube-api-access-jjjw9" (OuterVolumeSpecName: "kube-api-access-jjjw9") pod "ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" (UID: "ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f"). InnerVolumeSpecName "kube-api-access-jjjw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 10:03:09.588425 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.588397    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:09.588822 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.588805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" containerName="test-curl-7422-140659278541856"
Jul 22 10:03:09.588932 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.588824    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" containerName="test-curl-7422-140659278541856"
Jul 22 10:03:09.588991 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.588942    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" containerName="test-curl-7422-140659278541856"
Jul 22 10:03:09.592105 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.592085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:09.600684 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.600662    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:09.628039 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.628020    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjjw9\" (UniqueName: \"kubernetes.io/projected/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f-kube-api-access-jjjw9\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 10:03:09.728530 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.728505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfb7t\" (UniqueName: \"kubernetes.io/projected/928a60ca-9019-4961-ba94-1338d9540b90-kube-api-access-hfb7t\") pod \"test-curl-7422-140659278541856\" (UID: \"928a60ca-9019-4961-ba94-1338d9540b90\") " pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:09.829406 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.829326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfb7t\" (UniqueName: \"kubernetes.io/projected/928a60ca-9019-4961-ba94-1338d9540b90-kube-api-access-hfb7t\") pod \"test-curl-7422-140659278541856\" (UID: \"928a60ca-9019-4961-ba94-1338d9540b90\") " pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:09.837935 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.837912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfb7t\" (UniqueName: \"kubernetes.io/projected/928a60ca-9019-4961-ba94-1338d9540b90-kube-api-access-hfb7t\") pod \"test-curl-7422-140659278541856\" (UID: \"928a60ca-9019-4961-ba94-1338d9540b90\") " pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:09.901652 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:09.901631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:10.033172 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:10.033141    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:10.036130 ip-10-0-142-141 kubenswrapper[2560]: W0722 10:03:10.036108    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod928a60ca_9019_4961_ba94_1338d9540b90.slice/crio-75cb37682dd79003879b83c819e1c94297cbe15f0e21471b6e2fdaf382a360ac WatchSource:0}: Error finding container 75cb37682dd79003879b83c819e1c94297cbe15f0e21471b6e2fdaf382a360ac: Status 404 returned error can't find the container with id 75cb37682dd79003879b83c819e1c94297cbe15f0e21471b6e2fdaf382a360ac
Jul 22 10:03:10.277860 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:10.277814    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:10.277860 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:10.277826    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aafc0c513423b2393f60ac2fa3beded4113ac7ade5930eb462549a78408c137d"
Jul 22 10:03:10.279021 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:10.279000    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278541856" event={"ID":"928a60ca-9019-4961-ba94-1338d9540b90","Type":"ContainerStarted","Data":"75cb37682dd79003879b83c819e1c94297cbe15f0e21471b6e2fdaf382a360ac"}
Jul 22 10:03:10.290216 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:10.290188    2560 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7422-140659278541856" oldPodUID="ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" podUID="928a60ca-9019-4961-ba94-1338d9540b90"
Jul 22 10:03:10.908555 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:10.908524    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f" path="/var/lib/kubelet/pods/ec174cf9-97b1-42fd-a4c9-f8c3f407ac5f/volumes"
Jul 22 10:03:11.285224 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:11.285143    2560 generic.go:356] "Generic (PLEG): container finished" podID="928a60ca-9019-4961-ba94-1338d9540b90" containerID="604d67dd1b75756f5d507ef3d7693ab770bb9abe688ba2ea34113701b776c3a1" exitCode=0
Jul 22 10:03:11.285366 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:11.285221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278541856" event={"ID":"928a60ca-9019-4961-ba94-1338d9540b90","Type":"ContainerDied","Data":"604d67dd1b75756f5d507ef3d7693ab770bb9abe688ba2ea34113701b776c3a1"}
Jul 22 10:03:12.431075 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.431053    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:12.452183 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.452165    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140659278541856_928a60ca-9019-4961-ba94-1338d9540b90/test-curl-7422-140659278541856/0.log"
Jul 22 10:03:12.479114 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.479090    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:12.484241 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.484222    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140659278541856"]
Jul 22 10:03:12.552978 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.552917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfb7t\" (UniqueName: \"kubernetes.io/projected/928a60ca-9019-4961-ba94-1338d9540b90-kube-api-access-hfb7t\") pod \"928a60ca-9019-4961-ba94-1338d9540b90\" (UID: \"928a60ca-9019-4961-ba94-1338d9540b90\") "
Jul 22 10:03:12.554877 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.554851    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/928a60ca-9019-4961-ba94-1338d9540b90-kube-api-access-hfb7t" (OuterVolumeSpecName: "kube-api-access-hfb7t") pod "928a60ca-9019-4961-ba94-1338d9540b90" (UID: "928a60ca-9019-4961-ba94-1338d9540b90"). InnerVolumeSpecName "kube-api-access-hfb7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 10:03:12.610331 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.610303    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140659278542864"]
Jul 22 10:03:12.610724 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.610706    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="928a60ca-9019-4961-ba94-1338d9540b90" containerName="test-curl-7422-140659278541856"
Jul 22 10:03:12.610795 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.610727    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="928a60ca-9019-4961-ba94-1338d9540b90" containerName="test-curl-7422-140659278541856"
Jul 22 10:03:12.610890 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.610830    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="928a60ca-9019-4961-ba94-1338d9540b90" containerName="test-curl-7422-140659278541856"
Jul 22 10:03:12.613745 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.613728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:12.622243 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.622224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278542864"]
Jul 22 10:03:12.654417 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.654395    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfb7t\" (UniqueName: \"kubernetes.io/projected/928a60ca-9019-4961-ba94-1338d9540b90-kube-api-access-hfb7t\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 10:03:12.754997 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.754970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmq9n\" (UniqueName: \"kubernetes.io/projected/92372ec4-bf18-44aa-8707-7e8864e4d0f5-kube-api-access-dmq9n\") pod \"test-curl-7422-140659278542864\" (UID: \"92372ec4-bf18-44aa-8707-7e8864e4d0f5\") " pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:12.855992 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.855929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmq9n\" (UniqueName: \"kubernetes.io/projected/92372ec4-bf18-44aa-8707-7e8864e4d0f5-kube-api-access-dmq9n\") pod \"test-curl-7422-140659278542864\" (UID: \"92372ec4-bf18-44aa-8707-7e8864e4d0f5\") " pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:12.865402 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.865377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmq9n\" (UniqueName: \"kubernetes.io/projected/92372ec4-bf18-44aa-8707-7e8864e4d0f5-kube-api-access-dmq9n\") pod \"test-curl-7422-140659278542864\" (UID: \"92372ec4-bf18-44aa-8707-7e8864e4d0f5\") " pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:12.908819 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.908795    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="928a60ca-9019-4961-ba94-1338d9540b90" path="/var/lib/kubelet/pods/928a60ca-9019-4961-ba94-1338d9540b90/volumes"
Jul 22 10:03:12.923139 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:12.923121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:13.058396 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:13.058366    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140659278542864"]
Jul 22 10:03:13.059854 ip-10-0-142-141 kubenswrapper[2560]: W0722 10:03:13.059818    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92372ec4_bf18_44aa_8707_7e8864e4d0f5.slice/crio-0f92e9749f5c2b93d22c87cf594d1bb37ae21d99b7e373ab6b6c36d3aec9364f WatchSource:0}: Error finding container 0f92e9749f5c2b93d22c87cf594d1bb37ae21d99b7e373ab6b6c36d3aec9364f: Status 404 returned error can't find the container with id 0f92e9749f5c2b93d22c87cf594d1bb37ae21d99b7e373ab6b6c36d3aec9364f
Jul 22 10:03:13.297180 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:13.297159    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278541856"
Jul 22 10:03:13.297305 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:13.297217    2560 scope.go:117] "RemoveContainer" containerID="604d67dd1b75756f5d507ef3d7693ab770bb9abe688ba2ea34113701b776c3a1"
Jul 22 10:03:13.298583 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:13.298557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278542864" event={"ID":"92372ec4-bf18-44aa-8707-7e8864e4d0f5","Type":"ContainerStarted","Data":"0f92e9749f5c2b93d22c87cf594d1bb37ae21d99b7e373ab6b6c36d3aec9364f"}
Jul 22 10:03:14.305350 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:14.305318    2560 generic.go:356] "Generic (PLEG): container finished" podID="92372ec4-bf18-44aa-8707-7e8864e4d0f5" containerID="6559005c2d9aa9253ff4aa92d99cd3a1ae015524e7fd4afffb6198b85b1b7c6a" exitCode=0
Jul 22 10:03:14.305350 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:14.305351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140659278542864" event={"ID":"92372ec4-bf18-44aa-8707-7e8864e4d0f5","Type":"ContainerDied","Data":"6559005c2d9aa9253ff4aa92d99cd3a1ae015524e7fd4afffb6198b85b1b7c6a"}
Jul 22 10:03:15.448424 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.448395    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:15.469606 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.469583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140659278542864_92372ec4-bf18-44aa-8707-7e8864e4d0f5/test-curl-7422-140659278542864/0.log"
Jul 22 10:03:15.494082 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.494054    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140659278542864"]
Jul 22 10:03:15.498198 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.498175    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140659278542864"]
Jul 22 10:03:15.578195 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.578132    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmq9n\" (UniqueName: \"kubernetes.io/projected/92372ec4-bf18-44aa-8707-7e8864e4d0f5-kube-api-access-dmq9n\") pod \"92372ec4-bf18-44aa-8707-7e8864e4d0f5\" (UID: \"92372ec4-bf18-44aa-8707-7e8864e4d0f5\") "
Jul 22 10:03:15.580162 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.580140    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92372ec4-bf18-44aa-8707-7e8864e4d0f5-kube-api-access-dmq9n" (OuterVolumeSpecName: "kube-api-access-dmq9n") pod "92372ec4-bf18-44aa-8707-7e8864e4d0f5" (UID: "92372ec4-bf18-44aa-8707-7e8864e4d0f5"). InnerVolumeSpecName "kube-api-access-dmq9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 10:03:15.679694 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:15.679671    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmq9n\" (UniqueName: \"kubernetes.io/projected/92372ec4-bf18-44aa-8707-7e8864e4d0f5-kube-api-access-dmq9n\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 22 10:03:16.316442 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:16.316413    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f92e9749f5c2b93d22c87cf594d1bb37ae21d99b7e373ab6b6c36d3aec9364f"
Jul 22 10:03:16.316442 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:16.316440    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:16.326950 ip-10-0-142-141 kubenswrapper[2560]: E0722 10:03:16.326921    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140659278542864\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="92372ec4-bf18-44aa-8707-7e8864e4d0f5" pod="opendatahub/test-curl-7422-140659278542864"
Jul 22 10:03:16.909612 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:03:16.909573    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92372ec4-bf18-44aa-8707-7e8864e4d0f5" path="/var/lib/kubelet/pods/92372ec4-bf18-44aa-8707-7e8864e4d0f5/volumes"
Jul 22 10:04:03.638116 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:03.638031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67598d8f66-kp2n2_d81a5400-e086-47a9-9146-aba9de26849b/authorino/0.log"
Jul 22 10:04:09.282610 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:09.282576    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hs4qq_be13115f-8f27-4516-abd3-7e926858c4a1/manager/0.log"
Jul 22 10:04:09.407087 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:09.407060    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wm7xw_67ed7ab6-92a2-4a27-88e4-bffed11ae9cc/manager/0.log"
Jul 22 10:04:09.526728 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:09.526654    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6745b5844c-2p2zt_3071b259-f7a2-4467-9818-26808b4b6966/manager/0.log"
Jul 22 10:04:09.650175 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:09.650146    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tjxzw_57c7aec0-484b-4983-80e1-cb64e6c4bad3/server/0.log"
Jul 22 10:04:09.768026 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:09.768004    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pgnbj_2c82ad94-e361-4cfc-9321-fd3960948dd2/manager/0.log"
Jul 22 10:04:10.158553 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:10.158526    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67797c6b-q88lf_30021c60-c08b-497a-952f-91a9e229e670/copy-manifests/0.log"
Jul 22 10:04:10.169970 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:10.169946    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67797c6b-q88lf_30021c60-c08b-497a-952f-91a9e229e670/manager/0.log"
Jul 22 10:04:11.014438 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:11.014409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-lxn62_c2990309-674f-4e26-b16c-ecd99f65de1e/postgres/0.log"
Jul 22 10:04:12.370584 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:12.370557    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67598d8f66-kp2n2_d81a5400-e086-47a9-9146-aba9de26849b/authorino/0.log"
Jul 22 10:04:12.507440 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:12.507407    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sjb6r_043de58b-a326-474f-8492-2de51b7aaf75/manager/0.log"
Jul 22 10:04:12.618492 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:12.618467    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sh9k7_04702b35-af37-46ef-8efb-37f1de562e0f/manager/0.log"
Jul 22 10:04:12.843972 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:12.843939    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9c2vc_7682d9e7-6f2c-405d-b02c-1e83b631ec13/registry-server/0.log"
Jul 22 10:04:12.967867 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:12.967827    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-psw89_ad4bf55c-8f51-44ab-9c32-6f4fe98efca6/manager/0.log"
Jul 22 10:04:13.200922 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:13.200894    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8rshf_a3c40e69-2276-44d7-8c1f-cf4ae6658ffc/manager/0.log"
Jul 22 10:04:13.549809 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:13.549712    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46ncxs_c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6/istio-proxy/0.log"
Jul 22 10:04:13.786680 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:13.786652    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68755c4d9c-ctpzh_de3a12cd-85b1-4062-918c-c366f5d9c972/kube-auth-proxy/0.log"
Jul 22 10:04:14.152244 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:14.152210    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vmpzj_609abafb-fb9c-4155-8103-69443d87d4cf/payload-pre-processing/0.log"
Jul 22 10:04:14.396759 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:14.396731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cc969ffc4-l8wp8_fe1d7805-b978-45fc-b2b0-b43c5477ff14/router/0.log"
Jul 22 10:04:14.760413 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:14.760382    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xw74t_faa3717e-47f2-4fd9-b5c5-a16ac8c4cae6/main/0.log"
Jul 22 10:04:14.998563 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:14.998535    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-snpfs_e5f43d59-eab4-42d1-9ef6-b8d100e828ac/main/0.log"
Jul 22 10:04:15.214184 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:15.214155    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nwdgz_03361f77-6d50-4b5e-9870-19cfbae54943/main/0.log"
Jul 22 10:04:23.308732 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:23.308705    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4p5ct_650050ff-f9f6-4c60-a177-dab5d00e8a3b/global-pull-secret-syncer/0.log"
Jul 22 10:04:23.443412 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:23.443385    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vghc5_63287e77-8966-4a82-af46-abba71eeb638/konnectivity-agent/0.log"
Jul 22 10:04:23.557615 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:23.557583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-141.ec2.internal_9051b14160ff1bc1e70b7082345b9d33/haproxy/0.log"
Jul 22 10:04:28.804736 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:28.804700    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67598d8f66-kp2n2_d81a5400-e086-47a9-9146-aba9de26849b/authorino/0.log"
Jul 22 10:04:28.840113 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:28.840082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sjb6r_043de58b-a326-474f-8492-2de51b7aaf75/manager/0.log"
Jul 22 10:04:28.895661 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:28.895636    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sh9k7_04702b35-af37-46ef-8efb-37f1de562e0f/manager/0.log"
Jul 22 10:04:29.034085 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:29.034046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9c2vc_7682d9e7-6f2c-405d-b02c-1e83b631ec13/registry-server/0.log"
Jul 22 10:04:29.180758 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:29.180728    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-psw89_ad4bf55c-8f51-44ab-9c32-6f4fe98efca6/manager/0.log"
Jul 22 10:04:29.296562 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:29.296530    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8rshf_a3c40e69-2276-44d7-8c1f-cf4ae6658ffc/manager/0.log"
Jul 22 10:04:31.156460 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:31.156428    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-hvkd6_e40312be-71ff-4b92-924f-b09c0cf425b7/cluster-monitoring-operator/0.log"
Jul 22 10:04:31.524273 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:31.524195    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wt4q5_cbb7ecfc-069c-45a6-bc57-c88eca2d75f9/node-exporter/0.log"
Jul 22 10:04:31.550814 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:31.550788    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wt4q5_cbb7ecfc-069c-45a6-bc57-c88eca2d75f9/kube-rbac-proxy/0.log"
Jul 22 10:04:31.574567 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:31.574547    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wt4q5_cbb7ecfc-069c-45a6-bc57-c88eca2d75f9/init-textfile/0.log"
Jul 22 10:04:33.233749 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.233720    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"]
Jul 22 10:04:33.234257 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.234233    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92372ec4-bf18-44aa-8707-7e8864e4d0f5" containerName="test-curl-7422-140659278542864"
Jul 22 10:04:33.234257 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.234260    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="92372ec4-bf18-44aa-8707-7e8864e4d0f5" containerName="test-curl-7422-140659278542864"
Jul 22 10:04:33.234453 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.234371    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="92372ec4-bf18-44aa-8707-7e8864e4d0f5" containerName="test-curl-7422-140659278542864"
Jul 22 10:04:33.237693 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.237677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.240167 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.240146    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzwpt\"/\"default-dockercfg-54vb5\""
Jul 22 10:04:33.240532 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.240513    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzwpt\"/\"openshift-service-ca.crt\""
Jul 22 10:04:33.241074 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.241058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzwpt\"/\"kube-root-ca.crt\""
Jul 22 10:04:33.246278 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.246249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"]
Jul 22 10:04:33.313640 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.313610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-lib-modules\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.313640 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.313645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-sys\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.313884 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.313744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wkw\" (UniqueName: \"kubernetes.io/projected/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-kube-api-access-g2wkw\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.313884 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.313774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-proc\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.313884 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.313793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-podres\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.414755 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wkw\" (UniqueName: \"kubernetes.io/projected/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-kube-api-access-g2wkw\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.414755 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-proc\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415002 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-podres\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415002 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-lib-modules\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415002 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-sys\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415002 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-proc\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415002 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-podres\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415002 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.414983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-sys\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.415208 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.415015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-lib-modules\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.423750 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.423730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wkw\" (UniqueName: \"kubernetes.io/projected/2c31c365-2c9b-43e7-b62e-823e63e9c0ea-kube-api-access-g2wkw\") pod \"perf-node-gather-daemonset-r4d4k\" (UID: \"2c31c365-2c9b-43e7-b62e-823e63e9c0ea\") " pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.547983 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.547895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:33.679909 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.679761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"]
Jul 22 10:04:33.683385 ip-10-0-142-141 kubenswrapper[2560]: W0722 10:04:33.683356    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2c31c365_2c9b_43e7_b62e_823e63e9c0ea.slice/crio-dcf76ececaf07b2676ca142b2ef9f661cfd1322b71a0eff3147cda890c2d5753 WatchSource:0}: Error finding container dcf76ececaf07b2676ca142b2ef9f661cfd1322b71a0eff3147cda890c2d5753: Status 404 returned error can't find the container with id dcf76ececaf07b2676ca142b2ef9f661cfd1322b71a0eff3147cda890c2d5753
Jul 22 10:04:33.707747 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:33.707722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k" event={"ID":"2c31c365-2c9b-43e7-b62e-823e63e9c0ea","Type":"ContainerStarted","Data":"dcf76ececaf07b2676ca142b2ef9f661cfd1322b71a0eff3147cda890c2d5753"}
Jul 22 10:04:34.021152 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:34.021104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/1.log"
Jul 22 10:04:34.026817 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:34.026798    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6xp9p_5f46ab7c-43a8-4e94-a860-198824b5873c/console-operator/2.log"
Jul 22 10:04:34.714296 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:34.714259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k" event={"ID":"2c31c365-2c9b-43e7-b62e-823e63e9c0ea","Type":"ContainerStarted","Data":"aa7a5c57357edcd0330675cedfd9f26d73ecd44b5ee6bae26332067cdb7349d8"}
Jul 22 10:04:34.714735 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:34.714397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:34.732702 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:34.732656    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k" podStartSLOduration=1.7326425460000001 podStartE2EDuration="1.732642546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 10:04:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 10:04:34.73025806 +0000 UTC m=+2830.324250204" watchObservedRunningTime="2026-07-22 10:04:34.732642546 +0000 UTC m=+2830.326634689"
Jul 22 10:04:35.195111 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:35.195082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-5c4mv_1409545b-1e29-4fe4-876c-3ac155805d90/volume-data-source-validator/0.log"
Jul 22 10:04:36.387993 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:36.387971    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdgvk_4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee/dns/0.log"
Jul 22 10:04:36.412790 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:36.412767    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdgvk_4333e6d8-fb5b-4fd7-9b65-8ff34bf155ee/kube-rbac-proxy/0.log"
Jul 22 10:04:36.491946 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:36.491918    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vsg8g_a7e01367-743a-4de8-9f3c-49e4f8a19916/dns-node-resolver/0.log"
Jul 22 10:04:37.128030 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:37.127996    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xc9cj_d45cc663-ff38-4f9c-b108-a4df2906f1f0/node-ca/0.log"
Jul 22 10:04:38.096257 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:38.096224    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46ncxs_c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6/istio-proxy/0.log"
Jul 22 10:04:38.250771 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:38.250738    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68755c4d9c-ctpzh_de3a12cd-85b1-4062-918c-c366f5d9c972/kube-auth-proxy/0.log"
Jul 22 10:04:38.370194 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:38.370102    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vmpzj_609abafb-fb9c-4155-8103-69443d87d4cf/payload-pre-processing/0.log"
Jul 22 10:04:38.425629 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:38.425600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cc969ffc4-l8wp8_fe1d7805-b978-45fc-b2b0-b43c5477ff14/router/0.log"
Jul 22 10:04:39.217601 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:39.217567    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tq7b9_830f93ed-4dd1-446c-b1ac-84ae1a922645/serve-healthcheck-canary/0.log"
Jul 22 10:04:39.742906 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:39.742877    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-7r88r_6ad6bdb6-50e4-441a-aa6f-164b1a9a9288/insights-operator/0.log"
Jul 22 10:04:39.743592 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:39.743577    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-7r88r_6ad6bdb6-50e4-441a-aa6f-164b1a9a9288/insights-operator/1.log"
Jul 22 10:04:39.843914 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:39.843888    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8tdj_c2dade4e-bb24-42b9-9dbd-a491661db59e/kube-rbac-proxy/0.log"
Jul 22 10:04:39.866156 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:39.866132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8tdj_c2dade4e-bb24-42b9-9dbd-a491661db59e/exporter/0.log"
Jul 22 10:04:39.890980 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:39.890959    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8tdj_c2dade4e-bb24-42b9-9dbd-a491661db59e/extractor/0.log"
Jul 22 10:04:40.729587 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:40.729556    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzwpt/perf-node-gather-daemonset-r4d4k"
Jul 22 10:04:42.228392 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.228363    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hs4qq_be13115f-8f27-4516-abd3-7e926858c4a1/manager/0.log"
Jul 22 10:04:42.409595 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.409567    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wm7xw_67ed7ab6-92a2-4a27-88e4-bffed11ae9cc/manager/0.log"
Jul 22 10:04:42.523518 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.523493    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6745b5844c-2p2zt_3071b259-f7a2-4467-9818-26808b4b6966/manager/0.log"
Jul 22 10:04:42.552075 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.552046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tjxzw_57c7aec0-484b-4983-80e1-cb64e6c4bad3/server/0.log"
Jul 22 10:04:42.624774 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.624748    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pgnbj_2c82ad94-e361-4cfc-9321-fd3960948dd2/manager/0.log"
Jul 22 10:04:42.828165 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.828135    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67797c6b-q88lf_30021c60-c08b-497a-952f-91a9e229e670/manager/0.log"
Jul 22 10:04:42.850454 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:42.850435    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67797c6b-q88lf_30021c60-c08b-497a-952f-91a9e229e670/copy-manifests/0.log"
Jul 22 10:04:44.077592 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:44.077563    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46ncxs_c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6/istio-proxy/0.log"
Jul 22 10:04:44.211134 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:44.211108    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68755c4d9c-ctpzh_de3a12cd-85b1-4062-918c-c366f5d9c972/kube-auth-proxy/0.log"
Jul 22 10:04:44.299418 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:44.299388    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vmpzj_609abafb-fb9c-4155-8103-69443d87d4cf/payload-pre-processing/0.log"
Jul 22 10:04:44.334057 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:44.333983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cc969ffc4-l8wp8_fe1d7805-b978-45fc-b2b0-b43c5477ff14/router/0.log"
Jul 22 10:04:45.533851 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:45.533819    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46ncxs_c5a3d121-9ffe-4eb7-8b98-9db4fbd2cfa6/istio-proxy/0.log"
Jul 22 10:04:45.667539 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:45.667512    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68755c4d9c-ctpzh_de3a12cd-85b1-4062-918c-c366f5d9c972/kube-auth-proxy/0.log"
Jul 22 10:04:45.763339 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:45.763309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vmpzj_609abafb-fb9c-4155-8103-69443d87d4cf/payload-pre-processing/0.log"
Jul 22 10:04:45.800411 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:45.800346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cc969ffc4-l8wp8_fe1d7805-b978-45fc-b2b0-b43c5477ff14/router/0.log"
Jul 22 10:04:49.716688 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:49.716609    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7rd74_50b861eb-db72-43e2-a1d0-fe4f858dafa3/kube-storage-version-migrator-operator/1.log"
Jul 22 10:04:49.717415 ip-10-0-142-141 kubenswrapper[2560]: I0722 10:04:49.717393    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7rd74_50b861eb-db72-43e2-a1d0-fe4f858dafa3/kube-storage-version-migrator-operator/0.log"