Jun 03 01:04:33.708915 ip-10-0-142-91 systemd[1]: Starting Kubernetes Kubelet... Jun 03 01:04:34.192284 ip-10-0-142-91 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:34.192284 ip-10-0-142-91 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 01:04:34.192284 ip-10-0-142-91 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:34.192284 ip-10-0-142-91 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 01:04:34.192284 ip-10-0-142-91 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:34.195578 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.195479 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 01:04:34.199086 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199070 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.199086 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199086 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199090 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199093 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199097 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199100 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199103 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199106 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199108 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199111 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199114 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199116 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199122 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199127 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199130 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199133 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199135 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199138 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199141 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199144 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.199147 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199146 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199149 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199151 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199154 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199157 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199161 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199164 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199167 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199170 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199173 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199175 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199178 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199180 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199183 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199186 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199188 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199191 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199194 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199196 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199199 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.199592 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199202 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199205 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199207 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199210 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199212 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199216 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199218 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199221 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199223 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199225 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199228 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199231 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199233 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199236 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199240 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199244 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199247 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199249 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199252 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.200118 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199254 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199257 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199259 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199262 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199264 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199267 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199270 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199273 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199275 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199278 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199281 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199283 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199288 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199291 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199294 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199297 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199301 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199303 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199306 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199308 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.200580 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199311 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199314 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199316 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199319 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199321 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199324 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199327 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199744 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199750 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199753 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199756 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199758 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199761 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199764 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199767 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199769 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199772 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199775 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199778 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.201071 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199780 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199783 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199785 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199787 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199790 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199793 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199796 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199799 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199802 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199804 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199807 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199809 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199812 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199814 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199817 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199819 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199822 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199824 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199826 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199829 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.201575 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199834 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199837 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199839 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199842 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199845 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199848 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199851 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199854 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199856 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199858 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199861 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199863 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199866 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199868 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199870 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199873 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199875 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199878 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199880 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199883 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.202090 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199886 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199889 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199891 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199894 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199896 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199898 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199901 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199903 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199906 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199908 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199911 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199913 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199917 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199920 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199923 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199925 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199928 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199930 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199934 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.202612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199939 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199942 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199945 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199948 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199950 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199953 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199956 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199958 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199961 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199963 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199966 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199969 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199972 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199977 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.199979 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200055 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200062 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200069 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200073 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200078 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200081 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 01:04:34.203128 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200085 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200094 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200097 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200100 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200106 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200109 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200112 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200115 2566 flags.go:64] FLAG: --cgroup-root="" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200119 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200122 2566 flags.go:64] FLAG: --client-ca-file="" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200125 2566 flags.go:64] FLAG: --cloud-config="" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200128 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200131 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200136 2566 flags.go:64] FLAG: --cluster-domain="" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200139 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200142 2566 flags.go:64] FLAG: --config-dir="" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200145 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200148 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200152 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200155 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200159 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200162 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200165 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200169 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 01:04:34.203648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200172 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200176 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200179 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200183 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200186 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200189 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200192 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200195 2566 flags.go:64] FLAG: --enable-server="true" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200198 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200203 2566 flags.go:64] FLAG: --event-burst="100" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200206 2566 flags.go:64] FLAG: --event-qps="50" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200209 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200213 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200216 2566 flags.go:64] FLAG: --eviction-hard="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200220 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200223 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200226 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200229 2566 flags.go:64] FLAG: --eviction-soft="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200233 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200236 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200239 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200242 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200245 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200248 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200251 2566 flags.go:64] FLAG: --feature-gates="" Jun 03 01:04:34.204220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200254 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200258 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200261 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200264 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200267 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200270 2566 flags.go:64] FLAG: --help="false" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200273 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200276 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200280 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200283 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200286 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200290 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200293 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200296 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200298 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200301 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200304 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200308 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200311 2566 flags.go:64] FLAG: --kube-reserved="" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200314 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200317 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200320 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200323 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200326 2566 flags.go:64] FLAG: --lock-file="" Jun 03 01:04:34.204836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200329 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200332 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200336 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200341 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200344 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200347 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200350 2566 flags.go:64] FLAG: --logging-format="text" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200353 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200356 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200359 2566 flags.go:64] FLAG: --manifest-url="" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200362 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200367 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200370 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200374 2566 flags.go:64] FLAG: --max-pods="110" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200378 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200381 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200383 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200387 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200390 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200393 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200396 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200403 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200406 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200409 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 01:04:34.205419 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200412 2566 flags.go:64] FLAG: --pod-cidr="" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200416 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200422 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200425 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200429 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200432 2566 flags.go:64] FLAG: --port="10250" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200435 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200438 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0befd941739919df3" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200441 2566 flags.go:64] FLAG: --qos-reserved="" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200444 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200448 2566 flags.go:64] FLAG: --register-node="true" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200451 2566 flags.go:64] FLAG: --register-schedulable="true" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200454 2566 flags.go:64] FLAG: --register-with-taints="" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200458 2566 flags.go:64] FLAG: --registry-burst="10" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200460 2566 flags.go:64] FLAG: --registry-qps="5" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200463 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200466 2566 flags.go:64] FLAG: --reserved-memory="" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200470 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200473 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200476 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200479 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200482 2566 flags.go:64] FLAG: --runonce="false" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200485 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200488 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200491 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 03 01:04:34.206017 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200495 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200497 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200501 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200504 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200507 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200510 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200513 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200516 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200518 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200526 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200529 2566 flags.go:64] FLAG: --system-cgroups="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200532 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200538 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200540 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200543 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200547 2566 flags.go:64] FLAG: --tls-min-version="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200550 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200553 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200556 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200559 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200562 2566 flags.go:64] FLAG: --v="2" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200566 2566 flags.go:64] FLAG: --version="false" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200570 2566 flags.go:64] FLAG: --vmodule="" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200575 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.200578 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 01:04:34.206623 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200685 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200689 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200692 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200695 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200698 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200701 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200704 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200706 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200709 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200712 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200715 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200717 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200720 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200723 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200726 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200728 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200732 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200735 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200738 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200740 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.207231 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200743 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200746 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200748 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200752 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200755 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200758 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200761 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200763 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200766 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200768 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200771 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200773 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200776 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200778 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200781 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200783 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200786 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200788 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200791 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200793 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.208034 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200796 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200799 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200801 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200804 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200806 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200809 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200811 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200814 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200818 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200821 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200823 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200825 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200828 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200831 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200833 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200838 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200840 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200843 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200845 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200848 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.208925 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200850 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200853 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200855 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200858 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200860 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200863 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200865 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200868 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200871 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200873 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200876 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200878 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200881 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200883 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200887 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200891 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200898 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200900 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200903 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.209466 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200905 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200910 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200913 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200917 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200920 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200924 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.200927 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.210195 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.201610 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:34.211310 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.211267 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 01:04:34.211431 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.211422 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 01:04:34.211517 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211507 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.211517 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211517 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211521 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211524 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211528 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211530 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211533 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211536 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211539 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211542 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211546 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211549 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211552 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211555 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211558 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211561 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211564 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211567 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211569 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211573 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211575 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.211576 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211579 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211582 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211585 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211589 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211592 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211595 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211616 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211619 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211623 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211627 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211630 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211633 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211636 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211638 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211641 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211643 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211646 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211648 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211651 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211653 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.212121 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211656 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211658 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211661 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211663 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211666 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211670 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211675 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211678 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211681 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211684 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211686 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211689 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211693 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211696 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211699 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211703 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211705 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211709 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211711 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211714 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.212631 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211716 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211719 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211722 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211724 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211727 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211729 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211732 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211734 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211737 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211739 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211742 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211744 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211747 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211749 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211752 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211754 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211757 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211760 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211762 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211765 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.213111 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211767 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211769 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211772 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211775 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211778 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.211783 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211891 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211897 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211900 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211903 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211906 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211910 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211914 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211917 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211920 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.213589 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211923 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211925 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211928 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211931 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211933 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211936 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211938 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211941 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211944 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211946 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211949 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211951 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211954 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211957 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211960 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211963 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211965 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211968 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211970 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211973 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.214043 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211976 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211992 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.211996 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212000 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212003 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212006 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212008 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212011 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212014 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212017 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212020 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212023 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212025 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212028 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212031 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212033 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212036 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212038 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212041 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212044 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.214523 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212046 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212050 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212054 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212057 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212060 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212063 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212067 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212070 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212073 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212075 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212078 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212081 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212083 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212086 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212088 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212091 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212093 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212096 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212099 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212101 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.215037 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212105 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212107 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212110 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212112 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212115 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212118 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212120 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212123 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212125 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212128 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212131 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212133 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212136 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212139 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212141 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212144 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.215516 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:34.212146 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.215924 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.212151 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:34.215924 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.213034 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 01:04:34.219592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.219578 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 01:04:34.221155 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.221144 2566 server.go:1019] "Starting client certificate rotation" Jun 03 01:04:34.221258 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.221241 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 01:04:34.221292 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.221282 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 01:04:34.247848 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.247824 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 01:04:34.253702 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.253680 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 01:04:34.270812 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.270790 2566 log.go:25] "Validated CRI v1 runtime API" Jun 03 01:04:34.276941 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.276924 2566 log.go:25] "Validated CRI v1 image API" Jun 03 01:04:34.278777 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.278761 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 01:04:34.280812 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.280798 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 01:04:34.282701 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.282681 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bed345e4-199f-4b88-93fc-59815557ff8d:/dev/nvme0n1p4 e86737d8-8e59-417e-9803-74fcba941080:/dev/nvme0n1p3] Jun 03 01:04:34.282752 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.282701 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 01:04:34.288345 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.288220 2566 manager.go:217] Machine: {Timestamp:2026-06-03 01:04:34.287307369 +0000 UTC m=+0.447531929 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098212 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c391615cd0c7e892641daaa394b89 SystemUUID:ec2c3916-15cd-0c7e-8926-41daaa394b89 BootID:b52b41d0-0cb8-4a91-96f3-e1a0fded2a16 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:68:d5:f1:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:68:d5:f1:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:38:63:3a:1c:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 01:04:34.289212 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.289200 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 01:04:34.289306 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.289294 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 01:04:34.292875 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.292846 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 01:04:34.293021 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.292877 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 01:04:34.293068 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.293029 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 01:04:34.293068 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.293039 2566 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 01:04:34.293068 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.293047 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 01:04:34.293941 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.293930 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 01:04:34.295309 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.295299 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 01:04:34.295420 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.295411 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 01:04:34.298082 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.298073 2566 kubelet.go:491] "Attempting to sync node with API server" Jun 03 01:04:34.298120 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.298087 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 01:04:34.298120 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.298100 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 01:04:34.298120 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.298109 2566 kubelet.go:397] "Adding apiserver pod source" Jun 03 01:04:34.298120 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.298117 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 01:04:34.299388 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.299375 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 01:04:34.299445 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.299396 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 01:04:34.302327 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.302305 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtbfq" Jun 03 01:04:34.302976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.302956 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 01:04:34.304755 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.304741 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 01:04:34.306741 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306727 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 01:04:34.306741 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306744 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306751 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306757 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306766 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306773 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306779 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306785 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306792 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306799 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306808 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 01:04:34.306831 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.306813 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 01:04:34.307579 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.307568 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 01:04:34.307579 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.307579 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 01:04:34.308644 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.308620 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 01:04:34.308703 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.308620 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 01:04:34.310087 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.310070 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtbfq" Jun 03 01:04:34.310629 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.310612 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 01:04:34.310917 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.310904 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 01:04:34.310976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.310943 2566 server.go:1295] "Started kubelet" Jun 03 01:04:34.311094 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.311044 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 01:04:34.311168 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.311119 2566 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 01:04:34.311414 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.311169 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 01:04:34.312015 ip-10-0-142-91 systemd[1]: Started Kubernetes Kubelet. Jun 03 01:04:34.312173 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.312157 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 01:04:34.314628 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.314594 2566 server.go:317] "Adding debug handlers to kubelet server" Jun 03 01:04:34.316867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.316850 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 01:04:34.317369 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.317346 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 01:04:34.317446 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.317420 2566 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 01:04:34.317446 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.317430 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 01:04:34.317556 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.317486 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 01:04:34.317556 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.317534 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 03 01:04:34.317556 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.317542 2566 reconciler.go:26] "Reconciler: start to sync state" Jun 03 01:04:34.318284 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.318258 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.321748 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.321731 2566 factory.go:55] Registering systemd factory Jun 03 01:04:34.321880 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.321868 2566 factory.go:223] Registration of the systemd container factory successfully Jun 03 01:04:34.322177 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.322156 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 01:04:34.323739 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.323722 2566 factory.go:153] Registering CRI-O factory Jun 03 01:04:34.323829 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.323820 2566 factory.go:223] Registration of the crio container factory successfully Jun 03 01:04:34.323936 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.323923 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 01:04:34.324219 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.323946 2566 factory.go:103] Registering Raw factory Jun 03 01:04:34.324219 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.323968 2566 manager.go:1196] Started watching for new ooms in manager Jun 03 01:04:34.324687 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.324669 2566 manager.go:319] Starting recovery of all containers Jun 03 01:04:34.325199 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.325180 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 01:04:34.325460 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.325441 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:34.333226 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.332428 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-91.ec2.internal\" not found" node="ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.336860 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.336843 2566 manager.go:324] Recovery completed Jun 03 01:04:34.340937 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.340925 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.342632 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.342614 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.342711 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.342643 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.342711 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.342654 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.343164 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.343151 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 01:04:34.343225 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.343164 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 01:04:34.343225 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.343184 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 01:04:34.345466 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.345452 2566 policy_none.go:49] "None policy: Start" Jun 03 01:04:34.345536 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.345469 2566 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 01:04:34.345536 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.345480 2566 state_mem.go:35] "Initializing new in-memory state store" Jun 03 01:04:34.378165 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378149 2566 manager.go:341] "Starting Device Plugin manager" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.378198 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378213 2566 server.go:85] "Starting device plugin registration server" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378454 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378466 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378567 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378683 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.378693 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.379286 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 01:04:34.386818 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.379326 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.413689 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.413664 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 01:04:34.413689 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.413687 2566 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 01:04:34.413828 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.413704 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 01:04:34.413828 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.413711 2566 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 01:04:34.413828 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.413745 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 01:04:34.416280 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.416259 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:34.479586 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.479496 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.480477 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.480458 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.480574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.480485 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.480574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.480495 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.480574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.480521 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.490267 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.490248 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.490351 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.490274 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-91.ec2.internal\": node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.505540 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.505520 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.514097 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.514075 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal"] Jun 03 01:04:34.514153 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.514138 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.515810 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.515796 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.515884 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.515821 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.515884 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.515831 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.516998 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.516987 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.517160 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517147 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.517195 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517174 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.517839 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef2601ff4052832c62b15d76346838b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal\" (UID: \"6ef2601ff4052832c62b15d76346838b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.517907 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37f7a2ea0aeb6bfaa54aad3485eb0728-config\") pod \"kube-apiserver-proxy-ip-10-0-142-91.ec2.internal\" (UID: \"37f7a2ea0aeb6bfaa54aad3485eb0728\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.517907 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517871 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.517907 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517898 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.517907 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517875 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.518040 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517911 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.518040 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ef2601ff4052832c62b15d76346838b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal\" (UID: \"6ef2601ff4052832c62b15d76346838b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.518040 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517928 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.518040 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.517943 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.518986 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.518963 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.519028 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.519001 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.519672 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.519655 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.519741 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.519684 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.519741 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.519698 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.542183 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.542164 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-91.ec2.internal\" not found" node="ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.546538 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.546522 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-91.ec2.internal\" not found" node="ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.606613 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.606578 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.618701 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.618679 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37f7a2ea0aeb6bfaa54aad3485eb0728-config\") pod \"kube-apiserver-proxy-ip-10-0-142-91.ec2.internal\" (UID: \"37f7a2ea0aeb6bfaa54aad3485eb0728\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.618778 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.618708 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ef2601ff4052832c62b15d76346838b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal\" (UID: \"6ef2601ff4052832c62b15d76346838b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.618778 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.618726 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef2601ff4052832c62b15d76346838b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal\" (UID: \"6ef2601ff4052832c62b15d76346838b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.618778 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.618764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37f7a2ea0aeb6bfaa54aad3485eb0728-config\") pod \"kube-apiserver-proxy-ip-10-0-142-91.ec2.internal\" (UID: \"37f7a2ea0aeb6bfaa54aad3485eb0728\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.618778 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.618771 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ef2601ff4052832c62b15d76346838b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal\" (UID: \"6ef2601ff4052832c62b15d76346838b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.618910 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.618793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef2601ff4052832c62b15d76346838b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal\" (UID: \"6ef2601ff4052832c62b15d76346838b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.707141 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.707097 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.807793 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.807711 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:34.844196 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.844174 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.849674 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:34.849655 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:34.908148 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:34.908117 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:35.008654 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:35.008626 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:35.109162 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:35.109073 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:35.209689 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:35.209657 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:35.220961 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.220933 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 01:04:35.221135 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.221070 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 01:04:35.221135 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.221120 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 01:04:35.310591 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:35.310562 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:35.311671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.311641 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:59:34 +0000 UTC" deadline="2028-03-18 11:13:17.842868486 +0000 UTC" Jun 03 01:04:35.311751 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.311672 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15706h8m42.531200907s" Jun 03 01:04:35.315786 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:35.315758 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef2601ff4052832c62b15d76346838b.slice/crio-fdb9571374e44ec30c45ec4c88b8b85e78f4a2bb09a4131fc4fc660097f2f367 WatchSource:0}: Error finding container fdb9571374e44ec30c45ec4c88b8b85e78f4a2bb09a4131fc4fc660097f2f367: Status 404 returned error can't find the container with id fdb9571374e44ec30c45ec4c88b8b85e78f4a2bb09a4131fc4fc660097f2f367 Jun 03 01:04:35.316010 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:35.315987 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f7a2ea0aeb6bfaa54aad3485eb0728.slice/crio-618da87353ee9c6be233e2cc0ea2eb3de80a057f920e6ebc7964f8b9b68c65ed WatchSource:0}: Error finding container 618da87353ee9c6be233e2cc0ea2eb3de80a057f920e6ebc7964f8b9b68c65ed: Status 404 returned error can't find the container with id 618da87353ee9c6be233e2cc0ea2eb3de80a057f920e6ebc7964f8b9b68c65ed Jun 03 01:04:35.317064 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.317050 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 01:04:35.319256 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.319242 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:04:35.327518 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.327499 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 01:04:35.351375 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.351354 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmrkl" Jun 03 01:04:35.358195 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.358170 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmrkl" Jun 03 01:04:35.374743 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.374677 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:35.410947 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:35.410909 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-91.ec2.internal\" not found" Jun 03 01:04:35.417042 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.416989 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" event={"ID":"37f7a2ea0aeb6bfaa54aad3485eb0728","Type":"ContainerStarted","Data":"618da87353ee9c6be233e2cc0ea2eb3de80a057f920e6ebc7964f8b9b68c65ed"} Jun 03 01:04:35.417953 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.417932 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" event={"ID":"6ef2601ff4052832c62b15d76346838b","Type":"ContainerStarted","Data":"fdb9571374e44ec30c45ec4c88b8b85e78f4a2bb09a4131fc4fc660097f2f367"} Jun 03 01:04:35.488560 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.488530 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:35.518260 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.518234 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" Jun 03 01:04:35.529679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.529652 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 01:04:35.530730 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.530718 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" Jun 03 01:04:35.541898 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:35.541884 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 01:04:36.153489 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.153455 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:36.218797 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.218768 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:36.298709 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.298678 2566 apiserver.go:52] "Watching apiserver" Jun 03 01:04:36.303423 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.303403 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 01:04:36.303870 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.303850 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ccrpj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr","openshift-cluster-node-tuning-operator/tuned-jscpj","openshift-dns/node-resolver-l22jr","openshift-image-registry/node-ca-ssbn2","openshift-multus/multus-additional-cni-plugins-444b4","openshift-multus/multus-qv8sb","openshift-multus/network-metrics-daemon-xl69t","kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal","openshift-network-diagnostics/network-check-target-vhtcw","openshift-network-operator/iptables-alerter-xcgq5","openshift-ovn-kubernetes/ovnkube-node-6h5mn"] Jun 03 01:04:36.305224 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.305203 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.306160 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.306139 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.307267 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307211 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 01:04:36.307355 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307292 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.307718 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307541 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rvwl4\"" Jun 03 01:04:36.307718 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307558 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.307718 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307594 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 01:04:36.307883 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307789 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.307930 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.307902 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.308195 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.308178 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ffp97\"" Jun 03 01:04:36.308281 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.308216 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.308411 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.308365 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 01:04:36.308913 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.308870 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.309183 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.309165 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.309728 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.309708 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.309882 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.309866 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vqww4\"" Jun 03 01:04:36.310192 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.310175 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.310813 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.310460 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.310813 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.310659 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.310813 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.310753 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmh69\"" Jun 03 01:04:36.311572 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.311514 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.311983 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.311965 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.312056 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.312008 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 01:04:36.312295 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.312263 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.312392 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.312348 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wp548\"" Jun 03 01:04:36.312550 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.312531 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.313488 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.313469 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.313589 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.313567 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:36.314647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.314629 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 01:04:36.314736 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.314680 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 01:04:36.314989 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.314963 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 01:04:36.315063 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.314976 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-22xnx\"" Jun 03 01:04:36.316246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.315919 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2rhwr\"" Jun 03 01:04:36.316429 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.316407 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:36.316814 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.316769 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.317504 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.317317 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 01:04:36.317613 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.317552 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:36.318548 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.318527 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.318903 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.318885 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.319066 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.319050 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.319447 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.319431 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 01:04:36.320221 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.320199 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w4rvm\"" Jun 03 01:04:36.321470 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.321449 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 01:04:36.321581 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.321563 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 01:04:36.321671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.321554 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 01:04:36.321671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.321631 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9r74\"" Jun 03 01:04:36.321775 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.321478 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.322337 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.322316 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.322550 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.322531 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 01:04:36.327510 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8jqw\" (UniqueName: \"kubernetes.io/projected/cb5ae05c-160c-4db6-9840-0e49924dca26-kube-api-access-f8jqw\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.327621 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-systemd-units\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.327621 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327537 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-var-lib-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.327621 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-etc-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.327621 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8t7d\" (UniqueName: \"kubernetes.io/projected/bfd17aba-7ece-4233-8b08-53963e374fde-kube-api-access-l8t7d\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.327827 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovnkube-config\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.327827 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovnkube-script-lib\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.327827 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-socket-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.327827 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysctl-conf\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.327827 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-host\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.327827 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-kubelet\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-os-release\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-sys-fs\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-run\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-tuned\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327935 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac260f96-cf37-4922-996f-ffbdcb1ba2d1-konnectivity-ca\") pod \"konnectivity-agent-ccrpj\" (UID: \"ac260f96-cf37-4922-996f-ffbdcb1ba2d1\") " pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.327983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-system-cni-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9g6w\" (UniqueName: \"kubernetes.io/projected/2a0e03bc-7a90-467f-a43f-64d20e865cfe-kube-api-access-v9g6w\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-sys\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb5ae05c-160c-4db6-9840-0e49924dca26-serviceca\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.328102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-run-netns\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-etc-kubernetes\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svdwn\" (UniqueName: \"kubernetes.io/projected/e1db6eb3-8ba9-4907-a959-1a4e428982af-kube-api-access-svdwn\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysconfig\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-env-overrides\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328262 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfd17aba-7ece-4233-8b08-53963e374fde-cni-binary-copy\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-socket-dir-parent\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-systemd\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac260f96-cf37-4922-996f-ffbdcb1ba2d1-agent-certs\") pod \"konnectivity-agent-ccrpj\" (UID: \"ac260f96-cf37-4922-996f-ffbdcb1ba2d1\") " pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-netns\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328407 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-var-lib-kubelet\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hg8l\" (UniqueName: \"kubernetes.io/projected/bbde0f90-b113-483f-994d-ef9b0fd71f67-kube-api-access-5hg8l\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-log-socket\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-cnibin\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-kubelet\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.328592 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-cni-netd\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-lib-modules\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-slash\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-run-ovn-kubernetes\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-cni-bin\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj6m4\" (UniqueName: \"kubernetes.io/projected/083a92af-9f2b-4dad-a5bc-1c60a6470340-kube-api-access-kj6m4\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysctl-d\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6546c1ff-667d-471a-88fc-513321cd3b50-tmp-dir\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct89k\" (UniqueName: \"kubernetes.io/projected/6546c1ff-667d-471a-88fc-513321cd3b50-kube-api-access-ct89k\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-node-log\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-multus-certs\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkvk\" (UniqueName: \"kubernetes.io/projected/2d3982b4-66f4-495e-9b20-0703d72d90f3-kube-api-access-qlkvk\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-tmp\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.328987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-systemd\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.329321 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-k8s-cni-cncf-io\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329037 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1db6eb3-8ba9-4907-a959-1a4e428982af-iptables-alerter-script\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-kubernetes\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-cni-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329218 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-cni-bin\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-system-cni-dir\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-os-release\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-registration-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6546c1ff-667d-471a-88fc-513321cd3b50-hosts-file\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cnibin\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1db6eb3-8ba9-4907-a959-1a4e428982af-host-slash\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-ovn\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovn-node-metrics-cert\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfd17aba-7ece-4233-8b08-53963e374fde-multus-daemon-config\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:36.330117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-hostroot\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-conf-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329644 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329692 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-device-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd6p7\" (UniqueName: \"kubernetes.io/projected/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-kube-api-access-fd6p7\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb5ae05c-160c-4db6-9840-0e49924dca26-host\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-cni-multus\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cni-binary-copy\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.330679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.329879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-modprobe-d\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.359352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.359322 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:59:35 +0000 UTC" deadline="2028-02-07 02:09:46.892447176 +0000 UTC" Jun 03 01:04:36.359352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.359351 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14737h5m10.533100008s" Jun 03 01:04:36.418684 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.418589 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 01:04:36.430143 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430115 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svdwn\" (UniqueName: \"kubernetes.io/projected/e1db6eb3-8ba9-4907-a959-1a4e428982af-kube-api-access-svdwn\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.430303 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430151 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysconfig\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.430303 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430187 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-env-overrides\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.430303 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfd17aba-7ece-4233-8b08-53963e374fde-cni-binary-copy\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.430303 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430241 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-socket-dir-parent\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.430303 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430272 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-systemd\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.430303 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430297 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac260f96-cf37-4922-996f-ffbdcb1ba2d1-agent-certs\") pod \"konnectivity-agent-ccrpj\" (UID: \"ac260f96-cf37-4922-996f-ffbdcb1ba2d1\") " pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430320 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-netns\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430344 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-var-lib-kubelet\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430368 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hg8l\" (UniqueName: \"kubernetes.io/projected/bbde0f90-b113-483f-994d-ef9b0fd71f67-kube-api-access-5hg8l\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430394 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-log-socket\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430418 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-cnibin\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430442 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-kubelet\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430250 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysconfig\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430492 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-cni-netd\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-cni-netd\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430551 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-lib-modules\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.430584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430576 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-slash\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-log-socket\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430610 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-run-ovn-kubernetes\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-run-ovn-kubernetes\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430641 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-cni-bin\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430673 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj6m4\" (UniqueName: \"kubernetes.io/projected/083a92af-9f2b-4dad-a5bc-1c60a6470340-kube-api-access-kj6m4\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-cni-bin\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-cnibin\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-netns\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430751 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysctl-d\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430791 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6546c1ff-667d-471a-88fc-513321cd3b50-tmp-dir\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-kubelet\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-slash\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430823 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct89k\" (UniqueName: \"kubernetes.io/projected/6546c1ff-667d-471a-88fc-513321cd3b50-kube-api-access-ct89k\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430849 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-node-log\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430847 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430876 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-multus-certs\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430893 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysctl-d\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.431158 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430903 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430958 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkvk\" (UniqueName: \"kubernetes.io/projected/2d3982b4-66f4-495e-9b20-0703d72d90f3-kube-api-access-qlkvk\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431071 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-systemd\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-var-lib-kubelet\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431111 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-tmp\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431148 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-systemd\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-socket-dir-parent\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431176 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-k8s-cni-cncf-io\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431202 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1db6eb3-8ba9-4907-a959-1a4e428982af-iptables-alerter-script\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-multus-certs\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431232 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-kubernetes\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431269 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-node-log\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431274 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.430799 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-lib-modules\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431297 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-cni-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431324 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-cni-bin\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.432014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431351 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-system-cni-dir\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431368 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431376 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-os-release\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-systemd\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431405 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-registration-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431447 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6546c1ff-667d-471a-88fc-513321cd3b50-hosts-file\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6546c1ff-667d-471a-88fc-513321cd3b50-tmp-dir\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431721 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-kubernetes\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431772 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cnibin\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-registration-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431948 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1db6eb3-8ba9-4907-a959-1a4e428982af-host-slash\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.431983 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-ovn\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-env-overrides\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432058 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cnibin\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfd17aba-7ece-4233-8b08-53963e374fde-cni-binary-copy\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-ovn\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.432776 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-run-k8s-cni-cncf-io\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432615 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovn-node-metrics-cert\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-cni-bin\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-cni-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.432730 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6546c1ff-667d-471a-88fc-513321cd3b50-hosts-file\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-system-cni-dir\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.432870 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:36.932799809 +0000 UTC m=+3.093024360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a0e03bc-7a90-467f-a43f-64d20e865cfe-os-release\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432909 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfd17aba-7ece-4233-8b08-53963e374fde-multus-daemon-config\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.432956 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433165 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-hostroot\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433198 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-conf-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433253 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433290 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-device-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433336 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fd6p7\" (UniqueName: \"kubernetes.io/projected/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-kube-api-access-fd6p7\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433367 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb5ae05c-160c-4db6-9840-0e49924dca26-host\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.433542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfd17aba-7ece-4233-8b08-53963e374fde-multus-daemon-config\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433563 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433624 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-cni-multus\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433655 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cni-binary-copy\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433689 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433722 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-modprobe-d\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433756 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8jqw\" (UniqueName: \"kubernetes.io/projected/cb5ae05c-160c-4db6-9840-0e49924dca26-kube-api-access-f8jqw\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.433789 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-systemd-units\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-modprobe-d\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434147 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434222 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-var-lib-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434237 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-etc-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434299 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8t7d\" (UniqueName: \"kubernetes.io/projected/bfd17aba-7ece-4233-8b08-53963e374fde-kube-api-access-l8t7d\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-device-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434421 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-systemd-units\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434458 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb5ae05c-160c-4db6-9840-0e49924dca26-host\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434514 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovnkube-config\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-tmp\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434550 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovnkube-script-lib\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-hostroot\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434583 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-socket-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434631 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysctl-conf\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434514 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-etc-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434738 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-host\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434771 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-kubelet\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434804 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-os-release\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434842 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-sys-fs\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434852 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-host-var-lib-cni-multus\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.434935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.434875 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-run\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435075 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-multus-conf-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435136 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-tuned\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435153 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1db6eb3-8ba9-4907-a959-1a4e428982af-host-slash\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435174 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac260f96-cf37-4922-996f-ffbdcb1ba2d1-konnectivity-ca\") pod \"konnectivity-agent-ccrpj\" (UID: \"ac260f96-cf37-4922-996f-ffbdcb1ba2d1\") " pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435238 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-system-cni-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435248 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-socket-dir\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435273 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9g6w\" (UniqueName: \"kubernetes.io/projected/2a0e03bc-7a90-467f-a43f-64d20e865cfe-kube-api-access-v9g6w\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-sys\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cni-binary-copy\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435340 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb5ae05c-160c-4db6-9840-0e49924dca26-serviceca\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-sysctl-conf\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435367 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-run-netns\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-var-lib-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.435671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-run-openvswitch\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.436432 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.435940 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb5ae05c-160c-4db6-9840-0e49924dca26-serviceca\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.436432 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436004 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-run\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.436432 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovnkube-config\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.436432 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436064 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-os-release\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.436432 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3982b4-66f4-495e-9b20-0703d72d90f3-sys-fs\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.436432 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436175 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-run-netns\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.436732 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovnkube-script-lib\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.436732 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436635 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-etc-kubernetes\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.436828 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.436779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-etc-kubernetes\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.437255 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.437189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a0e03bc-7a90-467f-a43f-64d20e865cfe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.437255 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.437240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-sys\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.437565 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.437546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd17aba-7ece-4233-8b08-53963e374fde-system-cni-dir\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.437843 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.437817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac260f96-cf37-4922-996f-ffbdcb1ba2d1-konnectivity-ca\") pod \"konnectivity-agent-ccrpj\" (UID: \"ac260f96-cf37-4922-996f-ffbdcb1ba2d1\") " pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.437914 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.437904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-host\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.437968 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.437948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/083a92af-9f2b-4dad-a5bc-1c60a6470340-host-kubelet\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.439843 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.439415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1db6eb3-8ba9-4907-a959-1a4e428982af-iptables-alerter-script\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.439843 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.439515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/083a92af-9f2b-4dad-a5bc-1c60a6470340-ovn-node-metrics-cert\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.440260 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.440240 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:36.440342 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.440266 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:36.440342 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.440280 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:36.440450 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.440365 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:36.940347282 +0000 UTC m=+3.100571849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:36.440619 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.440531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-etc-tuned\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.441039 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.440995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac260f96-cf37-4922-996f-ffbdcb1ba2d1-agent-certs\") pod \"konnectivity-agent-ccrpj\" (UID: \"ac260f96-cf37-4922-996f-ffbdcb1ba2d1\") " pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.441117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.441040 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hg8l\" (UniqueName: \"kubernetes.io/projected/bbde0f90-b113-483f-994d-ef9b0fd71f67-kube-api-access-5hg8l\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.441247 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.441204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct89k\" (UniqueName: \"kubernetes.io/projected/6546c1ff-667d-471a-88fc-513321cd3b50-kube-api-access-ct89k\") pod \"node-resolver-l22jr\" (UID: \"6546c1ff-667d-471a-88fc-513321cd3b50\") " pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.442715 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.442651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8jqw\" (UniqueName: \"kubernetes.io/projected/cb5ae05c-160c-4db6-9840-0e49924dca26-kube-api-access-f8jqw\") pod \"node-ca-ssbn2\" (UID: \"cb5ae05c-160c-4db6-9840-0e49924dca26\") " pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.442817 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.442729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd6p7\" (UniqueName: \"kubernetes.io/projected/32d802aa-d62d-4424-b1e7-ce0804ec4bf1-kube-api-access-fd6p7\") pod \"tuned-jscpj\" (UID: \"32d802aa-d62d-4424-b1e7-ce0804ec4bf1\") " pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.444162 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.443989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj6m4\" (UniqueName: \"kubernetes.io/projected/083a92af-9f2b-4dad-a5bc-1c60a6470340-kube-api-access-kj6m4\") pod \"ovnkube-node-6h5mn\" (UID: \"083a92af-9f2b-4dad-a5bc-1c60a6470340\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.444162 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.444149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svdwn\" (UniqueName: \"kubernetes.io/projected/e1db6eb3-8ba9-4907-a959-1a4e428982af-kube-api-access-svdwn\") pod \"iptables-alerter-xcgq5\" (UID: \"e1db6eb3-8ba9-4907-a959-1a4e428982af\") " pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.444357 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.444336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkvk\" (UniqueName: \"kubernetes.io/projected/2d3982b4-66f4-495e-9b20-0703d72d90f3-kube-api-access-qlkvk\") pod \"aws-ebs-csi-driver-node-96jgr\" (UID: \"2d3982b4-66f4-495e-9b20-0703d72d90f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.444999 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.444975 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8t7d\" (UniqueName: \"kubernetes.io/projected/bfd17aba-7ece-4233-8b08-53963e374fde-kube-api-access-l8t7d\") pod \"multus-qv8sb\" (UID: \"bfd17aba-7ece-4233-8b08-53963e374fde\") " pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.445437 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.445417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9g6w\" (UniqueName: \"kubernetes.io/projected/2a0e03bc-7a90-467f-a43f-64d20e865cfe-kube-api-access-v9g6w\") pod \"multus-additional-cni-plugins-444b4\" (UID: \"2a0e03bc-7a90-467f-a43f-64d20e865cfe\") " pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.619390 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.619354 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qv8sb" Jun 03 01:04:36.625272 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.625241 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" Jun 03 01:04:36.634861 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.634838 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jscpj" Jun 03 01:04:36.639463 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.639444 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l22jr" Jun 03 01:04:36.646018 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.646000 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ssbn2" Jun 03 01:04:36.652559 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.652541 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-444b4" Jun 03 01:04:36.661146 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.661128 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:36.669738 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.669686 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcgq5" Jun 03 01:04:36.675337 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.675317 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:04:36.939621 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:36.939525 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:36.939768 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.939655 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.939768 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:36.939721 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:37.939701016 +0000 UTC m=+4.099925564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:37.040632 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.040581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:37.040792 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.040775 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:37.040870 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.040801 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:37.040870 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.040813 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:37.040966 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.040879 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:38.040858562 +0000 UTC m=+4.201083128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:37.191658 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.191628 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a92af_9f2b_4dad_a5bc_1c60a6470340.slice/crio-520cbc997df6e7a3c1b93fb175be2911b1bc33c4bf9d51454931ddbfe71b77a0 WatchSource:0}: Error finding container 520cbc997df6e7a3c1b93fb175be2911b1bc33c4bf9d51454931ddbfe71b77a0: Status 404 returned error can't find the container with id 520cbc997df6e7a3c1b93fb175be2911b1bc33c4bf9d51454931ddbfe71b77a0 Jun 03 01:04:37.192351 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.192295 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1db6eb3_8ba9_4907_a959_1a4e428982af.slice/crio-601c5ee3950ae9c5aa7df01e9e43d459779fea5878514e63585f3aae61db8559 WatchSource:0}: Error finding container 601c5ee3950ae9c5aa7df01e9e43d459779fea5878514e63585f3aae61db8559: Status 404 returned error can't find the container with id 601c5ee3950ae9c5aa7df01e9e43d459779fea5878514e63585f3aae61db8559 Jun 03 01:04:37.193480 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.193430 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0e03bc_7a90_467f_a43f_64d20e865cfe.slice/crio-48b65ed2f74ebebe90b0495c2cf90e3e7b38a7c26dc1c9300bb653a81b6a358d WatchSource:0}: Error finding container 48b65ed2f74ebebe90b0495c2cf90e3e7b38a7c26dc1c9300bb653a81b6a358d: Status 404 returned error can't find the container with id 48b65ed2f74ebebe90b0495c2cf90e3e7b38a7c26dc1c9300bb653a81b6a358d Jun 03 01:04:37.197372 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.197347 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6546c1ff_667d_471a_88fc_513321cd3b50.slice/crio-0556c654241fd15d9308dfcd543039414ef9a509356e3a1cc728c1808e6fc24e WatchSource:0}: Error finding container 0556c654241fd15d9308dfcd543039414ef9a509356e3a1cc728c1808e6fc24e: Status 404 returned error can't find the container with id 0556c654241fd15d9308dfcd543039414ef9a509356e3a1cc728c1808e6fc24e Jun 03 01:04:37.197882 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.197860 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5ae05c_160c_4db6_9840_0e49924dca26.slice/crio-e2ab4db215dbfb25453b30335fce9669ef3e3edb3e57daa306a51c027951e87b WatchSource:0}: Error finding container e2ab4db215dbfb25453b30335fce9669ef3e3edb3e57daa306a51c027951e87b: Status 404 returned error can't find the container with id e2ab4db215dbfb25453b30335fce9669ef3e3edb3e57daa306a51c027951e87b Jun 03 01:04:37.199486 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.199465 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac260f96_cf37_4922_996f_ffbdcb1ba2d1.slice/crio-0a58411dfb3c3b2e671e54a9c477fea5b69167ce184c63dfb9f37e4a351afb78 WatchSource:0}: Error finding container 0a58411dfb3c3b2e671e54a9c477fea5b69167ce184c63dfb9f37e4a351afb78: Status 404 returned error can't find the container with id 0a58411dfb3c3b2e671e54a9c477fea5b69167ce184c63dfb9f37e4a351afb78 Jun 03 01:04:37.201026 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.200861 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d802aa_d62d_4424_b1e7_ce0804ec4bf1.slice/crio-8353d90fb33bb0baaeee698ef7e88954226c2a6eb9a41b17e99bc7bd68a05bd9 WatchSource:0}: Error finding container 8353d90fb33bb0baaeee698ef7e88954226c2a6eb9a41b17e99bc7bd68a05bd9: Status 404 returned error can't find the container with id 8353d90fb33bb0baaeee698ef7e88954226c2a6eb9a41b17e99bc7bd68a05bd9 Jun 03 01:04:37.201742 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.201719 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd17aba_7ece_4233_8b08_53963e374fde.slice/crio-29d8d2b9fd8679d22ca871187f7fa2593b76c96df9fdd7785b415bf688edd7a5 WatchSource:0}: Error finding container 29d8d2b9fd8679d22ca871187f7fa2593b76c96df9fdd7785b415bf688edd7a5: Status 404 returned error can't find the container with id 29d8d2b9fd8679d22ca871187f7fa2593b76c96df9fdd7785b415bf688edd7a5 Jun 03 01:04:37.202964 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:04:37.202941 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3982b4_66f4_495e_9b20_0703d72d90f3.slice/crio-13dab38057a4eccd68b89a68349211d3346ace57243efe5a1cee5e94c654822f WatchSource:0}: Error finding container 13dab38057a4eccd68b89a68349211d3346ace57243efe5a1cee5e94c654822f: Status 404 returned error can't find the container with id 13dab38057a4eccd68b89a68349211d3346ace57243efe5a1cee5e94c654822f Jun 03 01:04:37.359823 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.359594 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:59:35 +0000 UTC" deadline="2028-01-15 02:42:24.353651146 +0000 UTC" Jun 03 01:04:37.359823 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.359820 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14185h37m46.993836831s" Jun 03 01:04:37.421625 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.421569 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qv8sb" event={"ID":"bfd17aba-7ece-4233-8b08-53963e374fde","Type":"ContainerStarted","Data":"29d8d2b9fd8679d22ca871187f7fa2593b76c96df9fdd7785b415bf688edd7a5"} Jun 03 01:04:37.422457 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.422430 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ccrpj" event={"ID":"ac260f96-cf37-4922-996f-ffbdcb1ba2d1","Type":"ContainerStarted","Data":"0a58411dfb3c3b2e671e54a9c477fea5b69167ce184c63dfb9f37e4a351afb78"} Jun 03 01:04:37.423532 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.423486 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l22jr" event={"ID":"6546c1ff-667d-471a-88fc-513321cd3b50","Type":"ContainerStarted","Data":"0556c654241fd15d9308dfcd543039414ef9a509356e3a1cc728c1808e6fc24e"} Jun 03 01:04:37.424383 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.424363 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcgq5" event={"ID":"e1db6eb3-8ba9-4907-a959-1a4e428982af","Type":"ContainerStarted","Data":"601c5ee3950ae9c5aa7df01e9e43d459779fea5878514e63585f3aae61db8559"} Jun 03 01:04:37.425204 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.425187 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"520cbc997df6e7a3c1b93fb175be2911b1bc33c4bf9d51454931ddbfe71b77a0"} Jun 03 01:04:37.426584 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.426541 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" event={"ID":"37f7a2ea0aeb6bfaa54aad3485eb0728","Type":"ContainerStarted","Data":"e727a31b12154ada1b4adcb01d1e8bd6a0e518db0494a233aab021fec32b8a81"} Jun 03 01:04:37.427535 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.427505 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" event={"ID":"2d3982b4-66f4-495e-9b20-0703d72d90f3","Type":"ContainerStarted","Data":"13dab38057a4eccd68b89a68349211d3346ace57243efe5a1cee5e94c654822f"} Jun 03 01:04:37.428449 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.428431 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jscpj" event={"ID":"32d802aa-d62d-4424-b1e7-ce0804ec4bf1","Type":"ContainerStarted","Data":"8353d90fb33bb0baaeee698ef7e88954226c2a6eb9a41b17e99bc7bd68a05bd9"} Jun 03 01:04:37.429352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.429334 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ssbn2" event={"ID":"cb5ae05c-160c-4db6-9840-0e49924dca26","Type":"ContainerStarted","Data":"e2ab4db215dbfb25453b30335fce9669ef3e3edb3e57daa306a51c027951e87b"} Jun 03 01:04:37.430252 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.430229 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerStarted","Data":"48b65ed2f74ebebe90b0495c2cf90e3e7b38a7c26dc1c9300bb653a81b6a358d"} Jun 03 01:04:37.792882 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.792749 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-91.ec2.internal" podStartSLOduration=2.792727371 podStartE2EDuration="2.792727371s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:04:37.440444027 +0000 UTC m=+3.600668595" watchObservedRunningTime="2026-06-03 01:04:37.792727371 +0000 UTC m=+3.952951948" Jun 03 01:04:37.793557 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.793526 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g2wt8"] Jun 03 01:04:37.795225 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.795201 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.795331 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.795281 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:37.846138 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.846022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a32155b2-feee-446f-9736-2105af7d2972-kubelet-config\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.846138 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.846066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a32155b2-feee-446f-9736-2105af7d2972-dbus\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.846138 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.846092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.946900 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.946860 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:37.947102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.946933 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a32155b2-feee-446f-9736-2105af7d2972-kubelet-config\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.947102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.946961 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a32155b2-feee-446f-9736-2105af7d2972-dbus\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.947102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.946995 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.947257 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.947139 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:37.947257 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.947206 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:38.447187373 +0000 UTC m=+4.607411940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:37.947619 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.947503 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:37.947619 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:37.947552 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.947537356 +0000 UTC m=+6.107761912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:37.947740 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.947630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a32155b2-feee-446f-9736-2105af7d2972-kubelet-config\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:37.947800 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:37.947768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a32155b2-feee-446f-9736-2105af7d2972-dbus\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:38.047810 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:38.047713 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:38.047962 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.047942 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:38.048016 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.047962 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:38.048016 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.047976 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:38.048115 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.048037 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:40.048017325 +0000 UTC m=+6.208241887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:38.416307 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:38.415752 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:38.416307 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.415893 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:38.416307 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:38.415947 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:38.416307 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.416059 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:38.450624 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:38.450088 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:38.450624 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.450219 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:38.450624 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:38.450276 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.450257959 +0000 UTC m=+5.610482510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:38.452723 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:38.451587 2566 generic.go:358] "Generic (PLEG): container finished" podID="6ef2601ff4052832c62b15d76346838b" containerID="02283438476c255dc12498537e0d5eec9e56252a64d3a6d6d6eb6de039c32f55" exitCode=0 Jun 03 01:04:38.452723 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:38.452510 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" event={"ID":"6ef2601ff4052832c62b15d76346838b","Type":"ContainerDied","Data":"02283438476c255dc12498537e0d5eec9e56252a64d3a6d6d6eb6de039c32f55"} Jun 03 01:04:39.415361 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:39.414872 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:39.415361 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:39.415010 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:39.460841 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:39.457789 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:39.460841 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:39.457943 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:39.460841 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:39.458004 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:41.457986637 +0000 UTC m=+7.618211200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:39.471820 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:39.471787 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" event={"ID":"6ef2601ff4052832c62b15d76346838b","Type":"ContainerStarted","Data":"3ea2d3a73f8deedb81254ab188bdbee215aa11fe74845b4b2d39d81c564c1458"} Jun 03 01:04:39.960873 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:39.960833 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:39.961071 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:39.961006 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:39.961130 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:39.961082 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:43.961061957 +0000 UTC m=+10.121286521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:40.062621 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:40.061971 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:40.062621 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:40.062134 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:40.062621 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:40.062153 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:40.062621 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:40.062166 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:40.062621 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:40.062226 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:44.062208073 +0000 UTC m=+10.222432623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:40.414749 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:40.414647 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:40.414749 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:40.414700 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:40.414957 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:40.414791 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:40.414957 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:40.414928 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:41.414117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:41.414087 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:41.414571 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:41.414219 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:41.475039 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:41.475002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:41.475221 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:41.475143 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:41.475221 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:41.475209 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:45.475190537 +0000 UTC m=+11.635415084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:42.414812 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:42.414737 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:42.415273 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:42.414886 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:42.415273 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:42.415042 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:42.415273 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:42.415173 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:43.414900 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:43.414864 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:43.415308 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:43.415012 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:43.994579 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:43.994405 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:43.994783 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:43.994591 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:43.994783 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:43.994670 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:51.994653693 +0000 UTC m=+18.154878240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:44.095413 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:44.095380 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:44.095587 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:44.095535 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:44.095587 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:44.095558 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:44.095587 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:44.095574 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:44.095780 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:44.095642 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:52.095628715 +0000 UTC m=+18.255853262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:44.415473 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:44.415394 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:44.415893 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:44.415521 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:44.415893 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:44.415588 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:44.415893 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:44.415712 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:45.414909 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:45.414880 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:45.415088 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:45.415000 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:45.506806 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:45.506767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:45.507209 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:45.506936 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:45.507209 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:45.507015 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:53.507000508 +0000 UTC m=+19.667225060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:46.414683 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:46.414171 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:46.414683 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:46.414291 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:46.414683 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:46.414420 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:46.414683 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:46.414624 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:47.414589 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.414535 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:47.415051 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:47.414717 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:47.487278 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.487238 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ssbn2" event={"ID":"cb5ae05c-160c-4db6-9840-0e49924dca26","Type":"ContainerStarted","Data":"599834606bfdf09851e67955bde6ac56d02d32437109180224970a5d5704c5bb"} Jun 03 01:04:47.488750 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.488705 2566 generic.go:358] "Generic (PLEG): container finished" podID="2a0e03bc-7a90-467f-a43f-64d20e865cfe" containerID="c20732947605e26980452982388dd83f5bf4fc9cfae18110bfc454278c38bab6" exitCode=0 Jun 03 01:04:47.488852 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.488798 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerDied","Data":"c20732947605e26980452982388dd83f5bf4fc9cfae18110bfc454278c38bab6"} Jun 03 01:04:47.490617 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.490564 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ccrpj" event={"ID":"ac260f96-cf37-4922-996f-ffbdcb1ba2d1","Type":"ContainerStarted","Data":"882e681ba34c55b43b2d6fef1f4b62e1e52897c4d26e56edcdd07f0b59e08f42"} Jun 03 01:04:47.492156 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.492131 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l22jr" event={"ID":"6546c1ff-667d-471a-88fc-513321cd3b50","Type":"ContainerStarted","Data":"1b237802d7f898c7dd9ac72e74cb10a9afa62fcaa16677f00fdc1b8968f1ab46"} Jun 03 01:04:47.493488 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.493460 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" event={"ID":"2d3982b4-66f4-495e-9b20-0703d72d90f3","Type":"ContainerStarted","Data":"b8de63469b561c85e7ab75941a83e1de1cf56cd5e94d0db0ab1851d865c707f9"} Jun 03 01:04:47.494774 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.494748 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jscpj" event={"ID":"32d802aa-d62d-4424-b1e7-ce0804ec4bf1","Type":"ContainerStarted","Data":"2d04062f5fffa2eef37177243c62a33dbace3ff77278e6bbc34be7dd4e1837ca"} Jun 03 01:04:47.503463 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.503411 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ssbn2" podStartSLOduration=4.00096339 podStartE2EDuration="13.503395619s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.199648663 +0000 UTC m=+3.359873212" lastFinishedPulling="2026-06-03 01:04:46.702080882 +0000 UTC m=+12.862305441" observedRunningTime="2026-06-03 01:04:47.502321976 +0000 UTC m=+13.662546547" watchObservedRunningTime="2026-06-03 01:04:47.503395619 +0000 UTC m=+13.663620189" Jun 03 01:04:47.505487 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.503918 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-91.ec2.internal" podStartSLOduration=12.503893937 podStartE2EDuration="12.503893937s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:04:39.485698961 +0000 UTC m=+5.645923531" watchObservedRunningTime="2026-06-03 01:04:47.503893937 +0000 UTC m=+13.664118507" Jun 03 01:04:47.517521 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.517476 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jscpj" podStartSLOduration=3.941550789 podStartE2EDuration="13.517439697s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.202553331 +0000 UTC m=+3.362777893" lastFinishedPulling="2026-06-03 01:04:46.778442237 +0000 UTC m=+12.938666801" observedRunningTime="2026-06-03 01:04:47.517197574 +0000 UTC m=+13.677422144" watchObservedRunningTime="2026-06-03 01:04:47.517439697 +0000 UTC m=+13.677664267" Jun 03 01:04:47.530575 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.530348 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l22jr" podStartSLOduration=4.023662629 podStartE2EDuration="13.530332456s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.199286937 +0000 UTC m=+3.359511485" lastFinishedPulling="2026-06-03 01:04:46.705956758 +0000 UTC m=+12.866181312" observedRunningTime="2026-06-03 01:04:47.529649305 +0000 UTC m=+13.689873873" watchObservedRunningTime="2026-06-03 01:04:47.530332456 +0000 UTC m=+13.690557028" Jun 03 01:04:47.560634 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:47.560564 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ccrpj" podStartSLOduration=4.059713039 podStartE2EDuration="13.56054589s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.201249239 +0000 UTC m=+3.361473786" lastFinishedPulling="2026-06-03 01:04:46.702082067 +0000 UTC m=+12.862306637" observedRunningTime="2026-06-03 01:04:47.559855341 +0000 UTC m=+13.720079910" watchObservedRunningTime="2026-06-03 01:04:47.56054589 +0000 UTC m=+13.720770459" Jun 03 01:04:48.414698 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:48.414663 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:48.415113 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:48.414712 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:48.415113 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:48.414798 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:48.415205 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:48.415155 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:48.498765 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:48.498729 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcgq5" event={"ID":"e1db6eb3-8ba9-4907-a959-1a4e428982af","Type":"ContainerStarted","Data":"8457224ab1a3027cbaa75fa70980c06a4f2b1a3ed16ef61aa92d797e954a1ce6"} Jun 03 01:04:48.512094 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:48.512030 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xcgq5" podStartSLOduration=4.971053479 podStartE2EDuration="14.512015883s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.194307844 +0000 UTC m=+3.354532391" lastFinishedPulling="2026-06-03 01:04:46.735270236 +0000 UTC m=+12.895494795" observedRunningTime="2026-06-03 01:04:48.511626753 +0000 UTC m=+14.671851324" watchObservedRunningTime="2026-06-03 01:04:48.512015883 +0000 UTC m=+14.672240452" Jun 03 01:04:49.414272 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:49.414236 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:49.414529 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:49.414365 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:50.413952 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:50.413922 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:50.414468 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:50.413919 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:50.414468 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:50.414047 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:50.414468 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:50.414141 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:50.925659 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:50.925626 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:50.925829 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:50.925740 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:51.413938 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:51.413910 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:51.414100 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:51.414030 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:51.503221 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:51.503193 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 01:04:52.054912 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:52.054866 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:52.055079 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.055047 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:52.055164 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.055136 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:08.055112498 +0000 UTC m=+34.215337098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:52.155643 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:52.155589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:52.155825 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.155766 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:52.155825 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.155794 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:52.155825 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.155809 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:52.155951 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.155875 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:08.155855864 +0000 UTC m=+34.316080424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:52.414769 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:52.414683 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:52.415370 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.414818 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:52.415370 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:52.414898 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:52.415370 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:52.415011 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:53.414360 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:53.414321 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:53.414547 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:53.414457 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:53.565392 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:53.565362 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:53.565808 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:53.565491 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:53.565808 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:53.565541 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:09.565527745 +0000 UTC m=+35.725752292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:53.964040 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:53.964003 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:53.964206 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:53.964127 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 01:04:53.964935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:53.964894 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ccrpj" Jun 03 01:04:54.415304 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:54.415268 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:54.415456 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:54.415372 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:54.415456 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:54.415447 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:54.415560 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:54.415538 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:55.414773 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:55.414739 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:55.415183 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:55.414871 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:56.414268 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:56.414050 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:56.414466 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:56.414073 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:56.414466 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:56.414370 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:56.414577 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:56.414459 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:57.414665 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:57.414636 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:57.415186 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:57.414734 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:58.088263 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.088231 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 01:04:58.389191 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.389111 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T01:04:58.088252413Z","UUID":"150ca53e-c3ea-452d-9822-42811a790a75","Handler":null,"Name":"","Endpoint":""} Jun 03 01:04:58.391415 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.391390 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 01:04:58.391516 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.391424 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 01:04:58.414090 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.414069 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:04:58.414259 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:58.414231 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:04:58.414330 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.414282 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:04:58.414421 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:58.414388 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:04:58.515281 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.515254 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qv8sb" event={"ID":"bfd17aba-7ece-4233-8b08-53963e374fde","Type":"ContainerStarted","Data":"e286349606b7c67e3d8c3f4407fc13e4f71d419cb6eaa5bb52c698b2b61a855d"} Jun 03 01:04:58.517175 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.517156 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"256aece6d41110f3d6746455ff3ae6b7a2e5db7c9c758676932cf0e6423f2cd7"} Jun 03 01:04:58.517287 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.517178 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"9b56256b09a9f5d2b3abdd402a2667daef99a640b1bd75093b86700cb339f2bf"} Jun 03 01:04:58.517287 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.517187 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"8808329772ecdad460a0554a35bf644f704aa474afe94b9e349d1df1b1651720"} Jun 03 01:04:58.517287 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.517196 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"3fb4e41a810c6d8031c3e15d87fc8542df37ce410acc04ee22b0b1ce0a26b703"} Jun 03 01:04:58.518790 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.518769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" event={"ID":"2d3982b4-66f4-495e-9b20-0703d72d90f3","Type":"ContainerStarted","Data":"db7b585d897cae088932fb6b0348fe3e55818dad4e04ab4fe43e353447d4d528"} Jun 03 01:04:58.522487 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.521679 2566 generic.go:358] "Generic (PLEG): container finished" podID="2a0e03bc-7a90-467f-a43f-64d20e865cfe" containerID="2a69ff3f4deaff1b46d45e01be4a3d2cb839f433ed9945304bc1c6e5953b50cc" exitCode=0 Jun 03 01:04:58.522487 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.521721 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerDied","Data":"2a69ff3f4deaff1b46d45e01be4a3d2cb839f433ed9945304bc1c6e5953b50cc"} Jun 03 01:04:58.532291 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:58.532256 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qv8sb" podStartSLOduration=3.815619033 podStartE2EDuration="24.532243733s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.20365314 +0000 UTC m=+3.363877686" lastFinishedPulling="2026-06-03 01:04:57.920277824 +0000 UTC m=+24.080502386" observedRunningTime="2026-06-03 01:04:58.532094956 +0000 UTC m=+24.692319519" watchObservedRunningTime="2026-06-03 01:04:58.532243733 +0000 UTC m=+24.692468302" Jun 03 01:04:59.413870 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.413842 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:04:59.414003 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:04:59.413943 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:04:59.525564 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.525529 2566 generic.go:358] "Generic (PLEG): container finished" podID="2a0e03bc-7a90-467f-a43f-64d20e865cfe" containerID="dae4fcb31a5dff9aecab03dfeea168550d1f6becc68a6c18581107edce1b9d1c" exitCode=0 Jun 03 01:04:59.526050 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.525626 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerDied","Data":"dae4fcb31a5dff9aecab03dfeea168550d1f6becc68a6c18581107edce1b9d1c"} Jun 03 01:04:59.528451 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.528329 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"7e56a53ccfa25215fc8f96dd35fb72727994ab38216b05d6dc6ce38e89bd49a6"} Jun 03 01:04:59.528451 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.528352 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"13717b6ba9c2ac861f16d8bb703a398cedc9b0faf674cc1cd9544bd077067a83"} Jun 03 01:04:59.530257 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.530232 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" event={"ID":"2d3982b4-66f4-495e-9b20-0703d72d90f3","Type":"ContainerStarted","Data":"ea31cf4ba7933c294272339a72901d4a9090dde05175c666e82dcc9ddffdace3"} Jun 03 01:04:59.562078 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:04:59.562036 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96jgr" podStartSLOduration=3.759320836 podStartE2EDuration="25.562025137s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.204986596 +0000 UTC m=+3.365211146" lastFinishedPulling="2026-06-03 01:04:59.007690897 +0000 UTC m=+25.167915447" observedRunningTime="2026-06-03 01:04:59.561166815 +0000 UTC m=+25.721391384" watchObservedRunningTime="2026-06-03 01:04:59.562025137 +0000 UTC m=+25.722249748" Jun 03 01:05:00.414036 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:00.414001 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:00.414180 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:00.414012 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:00.414257 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:00.414106 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:00.414301 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:00.414238 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:00.534658 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:00.534559 2566 generic.go:358] "Generic (PLEG): container finished" podID="2a0e03bc-7a90-467f-a43f-64d20e865cfe" containerID="5599c7f9643007811ff5f784c02274993a8b3fa1f6d48d0550eec907a91ceec7" exitCode=0 Jun 03 01:05:00.534658 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:00.534638 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerDied","Data":"5599c7f9643007811ff5f784c02274993a8b3fa1f6d48d0550eec907a91ceec7"} Jun 03 01:05:01.414855 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:01.414817 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:01.415058 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:01.414962 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:05:01.540125 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:01.540095 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"3a1fcdb5d819ce05cb0fbeb26626c8d9cdcf13b33bd3f6fc94b3cd7173e0ca87"} Jun 03 01:05:02.414648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:02.414587 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:02.414822 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:02.414749 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:02.414900 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:02.414823 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:02.414983 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:02.414944 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:03.414450 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:03.414261 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:03.414974 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:03.414528 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:05:03.547362 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:03.547321 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" event={"ID":"083a92af-9f2b-4dad-a5bc-1c60a6470340","Type":"ContainerStarted","Data":"9614d7c00e8a3eee851d810cec1d4aa7e84ebf54ea3858700e74b0f316210ee0"} Jun 03 01:05:03.547661 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:03.547637 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:05:03.547749 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:03.547676 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:05:03.564397 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:03.564375 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:05:03.570488 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:03.570424 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" podStartSLOduration=8.80244208 podStartE2EDuration="29.570408203s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.19432513 +0000 UTC m=+3.354549692" lastFinishedPulling="2026-06-03 01:04:57.962291256 +0000 UTC m=+24.122515815" observedRunningTime="2026-06-03 01:05:03.570174638 +0000 UTC m=+29.730399208" watchObservedRunningTime="2026-06-03 01:05:03.570408203 +0000 UTC m=+29.730632774" Jun 03 01:05:04.414509 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.414483 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:04.415016 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:04.414553 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:04.415016 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.414647 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:04.415016 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:04.414767 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:04.549548 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.549513 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:05:04.564164 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.564140 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:05:04.766230 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.765926 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g2wt8"] Jun 03 01:05:04.766230 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.766076 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:04.766230 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:04.766184 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:05:04.769173 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.769093 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xl69t"] Jun 03 01:05:04.769294 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.769216 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:04.769353 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:04.769332 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:04.769837 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.769813 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhtcw"] Jun 03 01:05:04.769935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:04.769921 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:04.770033 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:04.770015 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:06.414129 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:06.414098 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:06.414557 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:06.414098 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:06.414557 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:06.414198 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:05:06.414557 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:06.414098 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:06.414557 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:06.414289 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:06.414557 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:06.414365 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:08.086646 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:08.086591 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:08.087066 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.086751 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:05:08.087066 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.086824 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:40.086807245 +0000 UTC m=+66.247031796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:05:08.187518 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:08.187486 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:08.187697 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.187661 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:05:08.187697 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.187678 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:05:08.187697 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.187689 2566 projected.go:194] Error preparing data for projected volume kube-api-access-5wcvd for pod openshift-network-diagnostics/network-check-target-vhtcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:05:08.187820 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.187735 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd podName:fc748d4b-03b7-4b92-872e-d879c3817133 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:40.187722779 +0000 UTC m=+66.347947326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wcvd" (UniqueName: "kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd") pod "network-check-target-vhtcw" (UID: "fc748d4b-03b7-4b92-872e-d879c3817133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:05:08.414970 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:08.414887 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:08.414970 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:08.414928 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:08.415237 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.415018 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:08.415237 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.415045 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:05:08.415237 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:08.415077 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:08.415237 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:08.415184 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:09.598554 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:09.598517 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:09.599031 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:09.598675 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:05:09.599031 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:09.598740 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret podName:a32155b2-feee-446f-9736-2105af7d2972 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:41.598723035 +0000 UTC m=+67.758947583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret") pod "global-pull-secret-syncer-g2wt8" (UID: "a32155b2-feee-446f-9736-2105af7d2972") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:05:10.414068 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:10.414034 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:10.414245 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:10.414043 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:10.414245 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:10.414138 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xl69t" podUID="bbde0f90-b113-483f-994d-ef9b0fd71f67" Jun 03 01:05:10.414245 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:10.414043 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:10.414405 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:10.414272 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wt8" podUID="a32155b2-feee-446f-9736-2105af7d2972" Jun 03 01:05:10.414405 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:10.414206 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhtcw" podUID="fc748d4b-03b7-4b92-872e-d879c3817133" Jun 03 01:05:11.564544 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.564469 2566 generic.go:358] "Generic (PLEG): container finished" podID="2a0e03bc-7a90-467f-a43f-64d20e865cfe" containerID="9722e4e71f05ac3f07eb67c491c9fc6f5647ebe5094cf3aaa07f99acfd59459b" exitCode=0 Jun 03 01:05:11.564544 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.564503 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerDied","Data":"9722e4e71f05ac3f07eb67c491c9fc6f5647ebe5094cf3aaa07f99acfd59459b"} Jun 03 01:05:11.613780 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.613732 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-91.ec2.internal" event="NodeReady" Jun 03 01:05:11.613891 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.613869 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 01:05:11.660066 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.660022 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mdfhz"] Jun 03 01:05:11.691923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.691897 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8fbtj"] Jun 03 01:05:11.692096 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.692046 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.694014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.693990 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 01:05:11.694014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.694010 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 01:05:11.694188 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.694076 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tw28v\"" Jun 03 01:05:11.712997 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.712973 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mdfhz"] Jun 03 01:05:11.713055 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.713011 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fbtj"] Jun 03 01:05:11.713055 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.713043 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:11.715048 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.715028 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 01:05:11.715149 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.715037 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kzjqn\"" Jun 03 01:05:11.715149 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.715037 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 01:05:11.715149 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.715093 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 01:05:11.813819 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.813790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p846\" (UniqueName: \"kubernetes.io/projected/de267643-0496-4cfb-a294-5fc62d88d384-kube-api-access-2p846\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:11.813953 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.813832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e5aa1ac-f321-468e-a999-a027c0b6387e-config-volume\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.813953 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.813850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:11.814063 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.813958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.814063 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.813991 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5aa1ac-f321-468e-a999-a027c0b6387e-tmp-dir\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.814063 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.814039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9ppp\" (UniqueName: \"kubernetes.io/projected/8e5aa1ac-f321-468e-a999-a027c0b6387e-kube-api-access-h9ppp\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.915177 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915099 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.915177 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915136 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5aa1ac-f321-468e-a999-a027c0b6387e-tmp-dir\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.915177 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915164 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9ppp\" (UniqueName: \"kubernetes.io/projected/8e5aa1ac-f321-468e-a999-a027c0b6387e-kube-api-access-h9ppp\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.915431 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:11.915243 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:11.915431 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915300 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p846\" (UniqueName: \"kubernetes.io/projected/de267643-0496-4cfb-a294-5fc62d88d384-kube-api-access-2p846\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:11.915431 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:11.915308 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.415292157 +0000 UTC m=+38.575516731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:11.915431 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915339 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e5aa1ac-f321-468e-a999-a027c0b6387e-config-volume\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.915431 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915357 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:11.915647 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:11.915491 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:11.915647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915488 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5aa1ac-f321-468e-a999-a027c0b6387e-tmp-dir\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.915647 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:11.915588 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.41553383 +0000 UTC m=+38.575758399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:11.915891 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.915874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e5aa1ac-f321-468e-a999-a027c0b6387e-config-volume\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.924872 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.924850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9ppp\" (UniqueName: \"kubernetes.io/projected/8e5aa1ac-f321-468e-a999-a027c0b6387e-kube-api-access-h9ppp\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:11.924975 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:11.924930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p846\" (UniqueName: \"kubernetes.io/projected/de267643-0496-4cfb-a294-5fc62d88d384-kube-api-access-2p846\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:12.414352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.414316 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:12.414352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.414331 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:12.414570 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.414326 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:12.416527 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.416506 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 01:05:12.416698 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.416511 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 01:05:12.416698 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.416511 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 01:05:12.416916 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.416901 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgszk\"" Jun 03 01:05:12.416981 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.416940 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 01:05:12.419980 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.419961 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:12.420067 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.420022 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:12.420108 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:12.420088 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:12.420108 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:12.420099 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:12.420171 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:12.420137 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:05:13.420123559 +0000 UTC m=+39.580348106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:12.420171 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:12.420149 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:13.420143068 +0000 UTC m=+39.580367615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:12.426211 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.426190 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-55dgg\"" Jun 03 01:05:12.569317 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.569287 2566 generic.go:358] "Generic (PLEG): container finished" podID="2a0e03bc-7a90-467f-a43f-64d20e865cfe" containerID="556e785cffce8b809b6c5ec6ee76a9e7463df8784b9912a1a3a0620ce5407b6a" exitCode=0 Jun 03 01:05:12.569739 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:12.569349 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerDied","Data":"556e785cffce8b809b6c5ec6ee76a9e7463df8784b9912a1a3a0620ce5407b6a"} Jun 03 01:05:13.427617 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:13.427564 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:13.427783 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:13.427634 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:13.427783 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:13.427723 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:13.427783 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:13.427743 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:13.427882 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:13.427791 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:05:15.427777781 +0000 UTC m=+41.588002328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:13.427882 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:13.427805 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:15.427799695 +0000 UTC m=+41.588024242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:13.574135 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:13.574103 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-444b4" event={"ID":"2a0e03bc-7a90-467f-a43f-64d20e865cfe","Type":"ContainerStarted","Data":"59a71c1f28ae94ab1b0d1da6bb6cf7cb60e33f52670e245bc14e79b8a1a781cc"} Jun 03 01:05:13.598422 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:13.598371 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-444b4" podStartSLOduration=6.057814027 podStartE2EDuration="39.598354397s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.196208884 +0000 UTC m=+3.356433433" lastFinishedPulling="2026-06-03 01:05:10.736749255 +0000 UTC m=+36.896973803" observedRunningTime="2026-06-03 01:05:13.597992029 +0000 UTC m=+39.758216597" watchObservedRunningTime="2026-06-03 01:05:13.598354397 +0000 UTC m=+39.758578967" Jun 03 01:05:15.442976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:15.442915 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:15.443503 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:15.443038 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:15.443503 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:15.443070 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:15.443503 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:15.443151 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:15.443503 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:15.443156 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:05:19.443139295 +0000 UTC m=+45.603363858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:15.443503 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:15.443211 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:19.443195254 +0000 UTC m=+45.603419804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:19.471460 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:19.471408 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:19.471460 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:19.471471 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:19.471982 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:19.471550 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:19.471982 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:19.471560 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:19.471982 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:19.471623 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:05:27.471588298 +0000 UTC m=+53.631812844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:19.471982 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:19.471640 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:27.471632047 +0000 UTC m=+53.631856594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:27.523216 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:27.523179 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:27.523593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:27.523254 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:27.523593 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:27.523318 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:27.523593 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:27.523338 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:27.523593 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:27.523380 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:05:43.523364155 +0000 UTC m=+69.683588702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:27.523593 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:27.523393 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:43.523386698 +0000 UTC m=+69.683611244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:36.578257 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:36.578229 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h5mn" Jun 03 01:05:40.106744 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.106702 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:05:40.108341 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.108322 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 01:05:40.117652 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:40.117634 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 01:05:40.117711 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:40.117699 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs podName:bbde0f90-b113-483f-994d-ef9b0fd71f67 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:44.117683767 +0000 UTC m=+130.277908314 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs") pod "network-metrics-daemon-xl69t" (UID: "bbde0f90-b113-483f-994d-ef9b0fd71f67") : secret "metrics-daemon-secret" not found Jun 03 01:05:40.207801 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.207770 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:40.209723 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.209708 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 01:05:40.220063 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.220035 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 01:05:40.231954 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.231925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wcvd\" (UniqueName: \"kubernetes.io/projected/fc748d4b-03b7-4b92-872e-d879c3817133-kube-api-access-5wcvd\") pod \"network-check-target-vhtcw\" (UID: \"fc748d4b-03b7-4b92-872e-d879c3817133\") " pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:40.326077 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.326047 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-55dgg\"" Jun 03 01:05:40.334513 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.334492 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:40.461349 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.461317 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhtcw"] Jun 03 01:05:40.465561 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:05:40.465532 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc748d4b_03b7_4b92_872e_d879c3817133.slice/crio-bd2a8333686b1db504dadb4baf090d344d4395e4cb9b4847962bc50261f7ee80 WatchSource:0}: Error finding container bd2a8333686b1db504dadb4baf090d344d4395e4cb9b4847962bc50261f7ee80: Status 404 returned error can't find the container with id bd2a8333686b1db504dadb4baf090d344d4395e4cb9b4847962bc50261f7ee80 Jun 03 01:05:40.627704 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:40.627670 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhtcw" event={"ID":"fc748d4b-03b7-4b92-872e-d879c3817133","Type":"ContainerStarted","Data":"bd2a8333686b1db504dadb4baf090d344d4395e4cb9b4847962bc50261f7ee80"} Jun 03 01:05:41.617697 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:41.617657 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:41.619888 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:41.619869 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 01:05:41.631159 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:41.631133 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a32155b2-feee-446f-9736-2105af7d2972-original-pull-secret\") pod \"global-pull-secret-syncer-g2wt8\" (UID: \"a32155b2-feee-446f-9736-2105af7d2972\") " pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:41.834246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:41.834203 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wt8" Jun 03 01:05:41.970815 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:41.970779 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g2wt8"] Jun 03 01:05:41.975504 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:05:41.975468 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda32155b2_feee_446f_9736_2105af7d2972.slice/crio-288e79b42a01facde83607f553d7477299a3924719afc55af607b2455f46802d WatchSource:0}: Error finding container 288e79b42a01facde83607f553d7477299a3924719afc55af607b2455f46802d: Status 404 returned error can't find the container with id 288e79b42a01facde83607f553d7477299a3924719afc55af607b2455f46802d Jun 03 01:05:42.633200 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:42.633145 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g2wt8" event={"ID":"a32155b2-feee-446f-9736-2105af7d2972","Type":"ContainerStarted","Data":"288e79b42a01facde83607f553d7477299a3924719afc55af607b2455f46802d"} Jun 03 01:05:43.533102 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:43.533065 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:05:43.533295 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:43.533149 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:05:43.533295 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:43.533259 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:43.533393 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:43.533311 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:15.533296981 +0000 UTC m=+101.693521528 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:05:43.533566 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:43.533544 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:43.533708 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:05:43.533659 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:06:15.533595527 +0000 UTC m=+101.693820094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:05:44.639299 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:44.639244 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhtcw" event={"ID":"fc748d4b-03b7-4b92-872e-d879c3817133","Type":"ContainerStarted","Data":"201917fc9efb225a570d5e473eb3cc0e7f37d6ec211d25796803b268422865fa"} Jun 03 01:05:44.639754 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:44.639530 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:05:46.644539 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:46.644502 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g2wt8" event={"ID":"a32155b2-feee-446f-9736-2105af7d2972","Type":"ContainerStarted","Data":"1743ef240d8a4a1cba385519c89e9e567ffb871bfb5b75c08f6eaa7a4744b9f9"} Jun 03 01:05:46.657523 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:46.657482 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vhtcw" podStartSLOduration=69.00833561 podStartE2EDuration="1m12.65746892s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:05:40.467211135 +0000 UTC m=+66.627435683" lastFinishedPulling="2026-06-03 01:05:44.116344437 +0000 UTC m=+70.276568993" observedRunningTime="2026-06-03 01:05:44.652547496 +0000 UTC m=+70.812772067" watchObservedRunningTime="2026-06-03 01:05:46.65746892 +0000 UTC m=+72.817693480" Jun 03 01:05:46.658223 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:05:46.658195 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g2wt8" podStartSLOduration=65.998696777 podStartE2EDuration="1m9.658190961s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:05:41.977237397 +0000 UTC m=+68.137461944" lastFinishedPulling="2026-06-03 01:05:45.636731582 +0000 UTC m=+71.796956128" observedRunningTime="2026-06-03 01:05:46.657789152 +0000 UTC m=+72.818013718" watchObservedRunningTime="2026-06-03 01:05:46.658190961 +0000 UTC m=+72.818415529" Jun 03 01:06:15.555469 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:15.555408 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:06:15.555469 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:15.555482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:06:15.556052 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:15.555656 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:06:15.556052 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:15.555737 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls podName:8e5aa1ac-f321-468e-a999-a027c0b6387e nodeName:}" failed. No retries permitted until 2026-06-03 01:07:19.555719083 +0000 UTC m=+165.715943635 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls") pod "dns-default-mdfhz" (UID: "8e5aa1ac-f321-468e-a999-a027c0b6387e") : secret "dns-default-metrics-tls" not found Jun 03 01:06:15.556052 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:15.555656 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:06:15.556052 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:15.555819 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert podName:de267643-0496-4cfb-a294-5fc62d88d384 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:19.555803476 +0000 UTC m=+165.716028039 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert") pod "ingress-canary-8fbtj" (UID: "de267643-0496-4cfb-a294-5fc62d88d384") : secret "canary-serving-cert" not found Jun 03 01:06:15.643853 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:15.643828 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vhtcw" Jun 03 01:06:16.284274 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.284240 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8499d87b85-4vgzx"] Jun 03 01:06:16.285871 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.285856 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.287651 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.287627 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 01:06:16.287788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.287703 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 01:06:16.287788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.287705 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jn44l\"" Jun 03 01:06:16.287788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.287750 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 01:06:16.287788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.287757 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 01:06:16.287994 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.287842 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 01:06:16.288117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.288102 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 01:06:16.298141 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.298119 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8499d87b85-4vgzx"] Jun 03 01:06:16.361198 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.361158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.361198 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.361197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-default-certificate\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.361395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.361235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-stats-auth\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.361395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.361259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.361395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.361278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh9bn\" (UniqueName: \"kubernetes.io/projected/281f53e8-9472-4a9d-84be-19abd23825c4-kube-api-access-kh9bn\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.391137 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.390974 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4"] Jun 03 01:06:16.392759 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.392738 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:16.394862 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.394837 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 01:06:16.394862 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.394837 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hj8hs\"" Jun 03 01:06:16.395030 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.394915 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:06:16.395536 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.395521 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 01:06:16.409126 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.409102 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4"] Jun 03 01:06:16.462043 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462014 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.462043 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462044 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-default-certificate\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.462246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462075 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:16.462246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462095 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-stats-auth\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.462246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462109 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.462246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462154 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh9bn\" (UniqueName: \"kubernetes.io/projected/281f53e8-9472-4a9d-84be-19abd23825c4-kube-api-access-kh9bn\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.462246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.462220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwx9\" (UniqueName: \"kubernetes.io/projected/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-kube-api-access-ctwx9\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:16.462480 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.462284 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 01:06:16.462480 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.462289 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:16.962264925 +0000 UTC m=+103.122489474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : configmap references non-existent config key: service-ca.crt Jun 03 01:06:16.462480 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.462364 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:16.962348197 +0000 UTC m=+103.122572749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : secret "router-metrics-certs-default" not found Jun 03 01:06:16.464632 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.464616 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-default-certificate\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.464682 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.464664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-stats-auth\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.469886 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.469867 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh9bn\" (UniqueName: \"kubernetes.io/projected/281f53e8-9472-4a9d-84be-19abd23825c4-kube-api-access-kh9bn\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.562627 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.562555 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwx9\" (UniqueName: \"kubernetes.io/projected/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-kube-api-access-ctwx9\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:16.562939 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.562663 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:16.562939 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.562764 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 01:06:16.562939 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.562825 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls podName:a768ace1-39af-4b5e-a3a3-7bef49f33ab3 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:17.062811057 +0000 UTC m=+103.223035611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rp7p4" (UID: "a768ace1-39af-4b5e-a3a3-7bef49f33ab3") : secret "samples-operator-tls" not found Jun 03 01:06:16.569843 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.569818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwx9\" (UniqueName: \"kubernetes.io/projected/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-kube-api-access-ctwx9\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:16.965974 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.965897 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.965974 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:16.965966 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:16.966145 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.966049 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 01:06:16.966145 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.966057 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:17.966044933 +0000 UTC m=+104.126269481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : configmap references non-existent config key: service-ca.crt Jun 03 01:06:16.966145 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:16.966106 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:17.966092526 +0000 UTC m=+104.126317073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : secret "router-metrics-certs-default" not found Jun 03 01:06:17.066678 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:17.066645 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:17.066850 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:17.066771 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 01:06:17.066850 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:17.066829 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls podName:a768ace1-39af-4b5e-a3a3-7bef49f33ab3 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:18.066815658 +0000 UTC m=+104.227040204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rp7p4" (UID: "a768ace1-39af-4b5e-a3a3-7bef49f33ab3") : secret "samples-operator-tls" not found Jun 03 01:06:17.972617 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:17.972567 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:17.973003 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:17.972636 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:17.973003 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:17.972749 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:19.972728722 +0000 UTC m=+106.132953278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : configmap references non-existent config key: service-ca.crt Jun 03 01:06:17.973003 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:17.972756 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 01:06:17.973003 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:17.972799 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:19.972789261 +0000 UTC m=+106.133013808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : secret "router-metrics-certs-default" not found Jun 03 01:06:18.073771 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:18.073738 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:18.073889 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:18.073871 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 01:06:18.073947 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:18.073931 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls podName:a768ace1-39af-4b5e-a3a3-7bef49f33ab3 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:20.073916513 +0000 UTC m=+106.234141060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rp7p4" (UID: "a768ace1-39af-4b5e-a3a3-7bef49f33ab3") : secret "samples-operator-tls" not found Jun 03 01:06:19.986215 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:19.986178 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:19.986703 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:19.986252 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:19.986703 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:19.986330 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 01:06:19.986703 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:19.986365 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:23.986351245 +0000 UTC m=+110.146575791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : configmap references non-existent config key: service-ca.crt Jun 03 01:06:19.986703 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:19.986386 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:23.986372686 +0000 UTC m=+110.146597233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : secret "router-metrics-certs-default" not found Jun 03 01:06:20.086922 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.086884 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:20.087072 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:20.087036 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 01:06:20.087112 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:20.087098 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls podName:a768ace1-39af-4b5e-a3a3-7bef49f33ab3 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:24.087083036 +0000 UTC m=+110.247307583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rp7p4" (UID: "a768ace1-39af-4b5e-a3a3-7bef49f33ab3") : secret "samples-operator-tls" not found Jun 03 01:06:20.386196 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.386167 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c"] Jun 03 01:06:20.388568 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.388554 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.395784 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.395763 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 01:06:20.395886 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.395804 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 01:06:20.396108 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.396092 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-r6cbt\"" Jun 03 01:06:20.396959 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.396946 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:06:20.397034 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.397019 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 01:06:20.409833 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.409810 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c"] Jun 03 01:06:20.489443 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.489411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-serving-cert\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.489593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.489541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65tj\" (UniqueName: \"kubernetes.io/projected/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-kube-api-access-d65tj\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.489593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.489569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-config\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.590014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.589968 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d65tj\" (UniqueName: \"kubernetes.io/projected/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-kube-api-access-d65tj\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.590154 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.590024 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-config\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.590154 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.590089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-serving-cert\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.590586 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.590565 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-config\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.592436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.592418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-serving-cert\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.597902 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.597883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65tj\" (UniqueName: \"kubernetes.io/projected/4f67c7d8-fec2-43b8-bdf5-469d67293cb0-kube-api-access-d65tj\") pod \"service-ca-operator-69877444c-6mz5c\" (UID: \"4f67c7d8-fec2-43b8-bdf5-469d67293cb0\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.697194 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.697117 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" Jun 03 01:06:20.812051 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:20.812021 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c"] Jun 03 01:06:20.815083 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:20.815047 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f67c7d8_fec2_43b8_bdf5_469d67293cb0.slice/crio-a503859539da80851a69dfa24eee5cce93a592702ef20349487915a0ba5c97a9 WatchSource:0}: Error finding container a503859539da80851a69dfa24eee5cce93a592702ef20349487915a0ba5c97a9: Status 404 returned error can't find the container with id a503859539da80851a69dfa24eee5cce93a592702ef20349487915a0ba5c97a9 Jun 03 01:06:21.211846 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.211817 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs"] Jun 03 01:06:21.214140 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.214126 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" Jun 03 01:06:21.215788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.215762 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c2ktq\"" Jun 03 01:06:21.221854 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.221823 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs"] Jun 03 01:06:21.295377 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.295352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9zg\" (UniqueName: \"kubernetes.io/projected/c57c8f23-ca39-4f54-85b4-01cf958d148d-kube-api-access-bd9zg\") pod \"network-check-source-56d84b9f44-m8mgs\" (UID: \"c57c8f23-ca39-4f54-85b4-01cf958d148d\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" Jun 03 01:06:21.396130 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.396089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9zg\" (UniqueName: \"kubernetes.io/projected/c57c8f23-ca39-4f54-85b4-01cf958d148d-kube-api-access-bd9zg\") pod \"network-check-source-56d84b9f44-m8mgs\" (UID: \"c57c8f23-ca39-4f54-85b4-01cf958d148d\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" Jun 03 01:06:21.403213 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.403182 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9zg\" (UniqueName: \"kubernetes.io/projected/c57c8f23-ca39-4f54-85b4-01cf958d148d-kube-api-access-bd9zg\") pod \"network-check-source-56d84b9f44-m8mgs\" (UID: \"c57c8f23-ca39-4f54-85b4-01cf958d148d\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" Jun 03 01:06:21.522372 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.522338 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" Jun 03 01:06:21.636172 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.636141 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs"] Jun 03 01:06:21.639430 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:21.639402 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57c8f23_ca39_4f54_85b4_01cf958d148d.slice/crio-984877c5ca315134b4a541d7e92760f37f65219cc9382c168702a4da52f46ccb WatchSource:0}: Error finding container 984877c5ca315134b4a541d7e92760f37f65219cc9382c168702a4da52f46ccb: Status 404 returned error can't find the container with id 984877c5ca315134b4a541d7e92760f37f65219cc9382c168702a4da52f46ccb Jun 03 01:06:21.712319 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.712289 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" event={"ID":"c57c8f23-ca39-4f54-85b4-01cf958d148d","Type":"ContainerStarted","Data":"3c4d41a57efba2ad54c1f685a3dfbe138df6b36d64f6be90186c87efdd54e343"} Jun 03 01:06:21.712448 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.712330 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" event={"ID":"c57c8f23-ca39-4f54-85b4-01cf958d148d","Type":"ContainerStarted","Data":"984877c5ca315134b4a541d7e92760f37f65219cc9382c168702a4da52f46ccb"} Jun 03 01:06:21.713373 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.713334 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" event={"ID":"4f67c7d8-fec2-43b8-bdf5-469d67293cb0","Type":"ContainerStarted","Data":"a503859539da80851a69dfa24eee5cce93a592702ef20349487915a0ba5c97a9"} Jun 03 01:06:21.725463 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:21.725415 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-m8mgs" podStartSLOduration=0.725181767 podStartE2EDuration="725.181767ms" podCreationTimestamp="2026-06-03 01:06:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:06:21.724527598 +0000 UTC m=+107.884752168" watchObservedRunningTime="2026-06-03 01:06:21.725181767 +0000 UTC m=+107.885406335" Jun 03 01:06:22.956614 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:22.956573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l22jr_6546c1ff-667d-471a-88fc-513321cd3b50/dns-node-resolver/0.log" Jun 03 01:06:24.015897 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:24.015863 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:24.016260 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:24.016029 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 01:06:24.016260 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:24.016057 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:24.016260 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:24.016100 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:32.016081152 +0000 UTC m=+118.176305700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : secret "router-metrics-certs-default" not found Jun 03 01:06:24.016260 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:24.016144 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:32.016134379 +0000 UTC m=+118.176358935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : configmap references non-existent config key: service-ca.crt Jun 03 01:06:24.117092 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:24.117053 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:24.117257 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:24.117240 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 01:06:24.117346 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:24.117335 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls podName:a768ace1-39af-4b5e-a3a3-7bef49f33ab3 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:32.117314268 +0000 UTC m=+118.277538818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rp7p4" (UID: "a768ace1-39af-4b5e-a3a3-7bef49f33ab3") : secret "samples-operator-tls" not found Jun 03 01:06:24.155994 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:24.155973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ssbn2_cb5ae05c-160c-4db6-9840-0e49924dca26/node-ca/0.log" Jun 03 01:06:24.721346 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:24.721311 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" event={"ID":"4f67c7d8-fec2-43b8-bdf5-469d67293cb0","Type":"ContainerStarted","Data":"3bab9b2ac54b6d2a20e640bafe67277facc748505060a66e7517b921da1d86f3"} Jun 03 01:06:24.734814 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:24.734764 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" podStartSLOduration=1.63494363 podStartE2EDuration="4.734748176s" podCreationTimestamp="2026-06-03 01:06:20 +0000 UTC" firstStartedPulling="2026-06-03 01:06:20.816759839 +0000 UTC m=+106.976984389" lastFinishedPulling="2026-06-03 01:06:23.916564384 +0000 UTC m=+110.076788935" observedRunningTime="2026-06-03 01:06:24.733541931 +0000 UTC m=+110.893766499" watchObservedRunningTime="2026-06-03 01:06:24.734748176 +0000 UTC m=+110.894972746" Jun 03 01:06:27.919708 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.919671 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-kfgj7"] Jun 03 01:06:27.921679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.921658 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:27.923532 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.923509 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 01:06:27.923727 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.923714 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 01:06:27.923807 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.923787 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 01:06:27.924049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.924036 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 01:06:27.924694 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.924680 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vdgn6\"" Jun 03 01:06:27.931173 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:27.931143 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-kfgj7"] Jun 03 01:06:28.049061 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.049030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1dfad32a-510d-4fb0-bd97-e43933d9123b-signing-key\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.049226 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.049070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1dfad32a-510d-4fb0-bd97-e43933d9123b-signing-cabundle\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.049226 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.049162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwkdh\" (UniqueName: \"kubernetes.io/projected/1dfad32a-510d-4fb0-bd97-e43933d9123b-kube-api-access-hwkdh\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.149867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.149829 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1dfad32a-510d-4fb0-bd97-e43933d9123b-signing-key\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.149867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.149869 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1dfad32a-510d-4fb0-bd97-e43933d9123b-signing-cabundle\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.150073 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.149923 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwkdh\" (UniqueName: \"kubernetes.io/projected/1dfad32a-510d-4fb0-bd97-e43933d9123b-kube-api-access-hwkdh\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.150539 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.150515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1dfad32a-510d-4fb0-bd97-e43933d9123b-signing-cabundle\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.152220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.152201 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1dfad32a-510d-4fb0-bd97-e43933d9123b-signing-key\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.157228 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.157209 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwkdh\" (UniqueName: \"kubernetes.io/projected/1dfad32a-510d-4fb0-bd97-e43933d9123b-kube-api-access-hwkdh\") pod \"service-ca-685df94d57-kfgj7\" (UID: \"1dfad32a-510d-4fb0-bd97-e43933d9123b\") " pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.235503 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.235420 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-kfgj7" Jun 03 01:06:28.353750 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.353721 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-kfgj7"] Jun 03 01:06:28.356871 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:28.356838 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfad32a_510d_4fb0_bd97_e43933d9123b.slice/crio-8ca027c355fdf695558c5a2d6cd87faee8d7d6736f4e8ce0ac51ee35e46af7d0 WatchSource:0}: Error finding container 8ca027c355fdf695558c5a2d6cd87faee8d7d6736f4e8ce0ac51ee35e46af7d0: Status 404 returned error can't find the container with id 8ca027c355fdf695558c5a2d6cd87faee8d7d6736f4e8ce0ac51ee35e46af7d0 Jun 03 01:06:28.729792 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.729757 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-kfgj7" event={"ID":"1dfad32a-510d-4fb0-bd97-e43933d9123b","Type":"ContainerStarted","Data":"2d3f812a4f00441197550e68395c0f266ab1a6489124dee37995957ec336d995"} Jun 03 01:06:28.729792 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.729796 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-kfgj7" event={"ID":"1dfad32a-510d-4fb0-bd97-e43933d9123b","Type":"ContainerStarted","Data":"8ca027c355fdf695558c5a2d6cd87faee8d7d6736f4e8ce0ac51ee35e46af7d0"} Jun 03 01:06:28.746385 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:28.746335 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-kfgj7" podStartSLOduration=1.7463201160000001 podStartE2EDuration="1.746320116s" podCreationTimestamp="2026-06-03 01:06:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:06:28.74561395 +0000 UTC m=+114.905838510" watchObservedRunningTime="2026-06-03 01:06:28.746320116 +0000 UTC m=+114.906544685" Jun 03 01:06:32.082238 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.082202 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:32.082782 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.082263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:32.082782 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:32.082385 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 01:06:32.082782 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:32.082437 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:48.082422795 +0000 UTC m=+134.242647354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : secret "router-metrics-certs-default" not found Jun 03 01:06:32.082782 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:06:32.082450 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle podName:281f53e8-9472-4a9d-84be-19abd23825c4 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:48.082444348 +0000 UTC m=+134.242668895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle") pod "router-default-8499d87b85-4vgzx" (UID: "281f53e8-9472-4a9d-84be-19abd23825c4") : configmap references non-existent config key: service-ca.crt Jun 03 01:06:32.183139 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.183093 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:32.185458 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.185433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a768ace1-39af-4b5e-a3a3-7bef49f33ab3-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rp7p4\" (UID: \"a768ace1-39af-4b5e-a3a3-7bef49f33ab3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:32.301457 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.301424 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" Jun 03 01:06:32.430185 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.430150 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4"] Jun 03 01:06:32.738373 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:32.738276 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" event={"ID":"a768ace1-39af-4b5e-a3a3-7bef49f33ab3","Type":"ContainerStarted","Data":"508a7013c9a4bc1cb705310d60c537b87663ce56426cf1fc09406773fc0cc7a5"} Jun 03 01:06:34.743977 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:34.743940 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" event={"ID":"a768ace1-39af-4b5e-a3a3-7bef49f33ab3","Type":"ContainerStarted","Data":"c94806f04f9180d5f62ec62ec7276faa03ee69d1c358fe2d5e1e6ffea9b942c3"} Jun 03 01:06:34.743977 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:34.743979 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" event={"ID":"a768ace1-39af-4b5e-a3a3-7bef49f33ab3","Type":"ContainerStarted","Data":"8fbb710a03d5de4a0ad6957ca9353c82ad05730d3c479c173338b5bbda82b63a"} Jun 03 01:06:34.757691 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:34.757644 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rp7p4" podStartSLOduration=16.69673646 podStartE2EDuration="18.757627182s" podCreationTimestamp="2026-06-03 01:06:16 +0000 UTC" firstStartedPulling="2026-06-03 01:06:32.468681091 +0000 UTC m=+118.628905637" lastFinishedPulling="2026-06-03 01:06:34.529571808 +0000 UTC m=+120.689796359" observedRunningTime="2026-06-03 01:06:34.757241938 +0000 UTC m=+120.917466506" watchObservedRunningTime="2026-06-03 01:06:34.757627182 +0000 UTC m=+120.917851752" Jun 03 01:06:44.178487 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:44.178442 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:06:44.180730 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:44.180710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbde0f90-b113-483f-994d-ef9b0fd71f67-metrics-certs\") pod \"network-metrics-daemon-xl69t\" (UID: \"bbde0f90-b113-483f-994d-ef9b0fd71f67\") " pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:06:44.232122 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:44.232097 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgszk\"" Jun 03 01:06:44.240403 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:44.240377 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xl69t" Jun 03 01:06:44.356044 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:44.356014 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xl69t"] Jun 03 01:06:44.358855 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:44.358824 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbde0f90_b113_483f_994d_ef9b0fd71f67.slice/crio-548042a9cb25113ebf3ace70224d9692564e65f1ac0ac1d945e213e403f60ac6 WatchSource:0}: Error finding container 548042a9cb25113ebf3ace70224d9692564e65f1ac0ac1d945e213e403f60ac6: Status 404 returned error can't find the container with id 548042a9cb25113ebf3ace70224d9692564e65f1ac0ac1d945e213e403f60ac6 Jun 03 01:06:44.768355 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:44.768315 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xl69t" event={"ID":"bbde0f90-b113-483f-994d-ef9b0fd71f67","Type":"ContainerStarted","Data":"548042a9cb25113ebf3ace70224d9692564e65f1ac0ac1d945e213e403f60ac6"} Jun 03 01:06:46.135927 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.135848 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb"] Jun 03 01:06:46.138377 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.138360 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.141016 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.140984 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 01:06:46.141016 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.140986 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 01:06:46.141178 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.141021 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ssq8m\"" Jun 03 01:06:46.148731 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.148713 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb"] Jun 03 01:06:46.220847 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.220816 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vk6wv"] Jun 03 01:06:46.223707 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.223691 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.226794 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.226753 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 01:06:46.227366 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.227324 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 01:06:46.227666 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.227648 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 01:06:46.227923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.227904 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2788\"" Jun 03 01:06:46.228089 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.228071 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 01:06:46.243399 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.243374 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vk6wv"] Jun 03 01:06:46.253049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.253030 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-dvztg"] Jun 03 01:06:46.255661 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.255644 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:06:46.257498 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.257479 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 01:06:46.257619 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.257528 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rd92t\"" Jun 03 01:06:46.257706 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.257631 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 01:06:46.266233 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.266207 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-dvztg"] Jun 03 01:06:46.287368 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.287344 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d444746fc-tz6hn"] Jun 03 01:06:46.290120 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.290103 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.292268 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.292246 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 01:06:46.292412 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.292292 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 01:06:46.292412 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.292309 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 01:06:46.292634 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.292618 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lxj66\"" Jun 03 01:06:46.293764 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.293745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c712628c-c52d-4fa3-b655-936485d249e3-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sznbb\" (UID: \"c712628c-c52d-4fa3-b655-936485d249e3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.293889 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.293801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c712628c-c52d-4fa3-b655-936485d249e3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sznbb\" (UID: \"c712628c-c52d-4fa3-b655-936485d249e3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.297788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.297753 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 01:06:46.305345 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.305326 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d444746fc-tz6hn"] Jun 03 01:06:46.394211 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/408a1a27-b023-4c4f-9db0-279b0e684217-image-registry-private-configuration\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394211 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-bound-sa-token\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394374 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/408a1a27-b023-4c4f-9db0-279b0e684217-installation-pull-secrets\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394374 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/408a1a27-b023-4c4f-9db0-279b0e684217-trusted-ca\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394374 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/408a1a27-b023-4c4f-9db0-279b0e684217-registry-certificates\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394374 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394340 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c712628c-c52d-4fa3-b655-936485d249e3-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sznbb\" (UID: \"c712628c-c52d-4fa3-b655-936485d249e3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.394496 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7h75\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-kube-api-access-j7h75\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394496 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394477 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c712628c-c52d-4fa3-b655-936485d249e3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sznbb\" (UID: \"c712628c-c52d-4fa3-b655-936485d249e3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.394566 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/671cebe9-b9c4-4b98-a879-9c098e61bcd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.394639 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/671cebe9-b9c4-4b98-a879-9c098e61bcd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.394680 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-registry-tls\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394721 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/671cebe9-b9c4-4b98-a879-9c098e61bcd8-data-volume\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.394751 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/408a1a27-b023-4c4f-9db0-279b0e684217-ca-trust-extracted\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.394800 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvthr\" (UniqueName: \"kubernetes.io/projected/9242b57a-936a-43bb-8c6f-52c8ee7a8b49-kube-api-access-bvthr\") pod \"downloads-c65b8dc4b-dvztg\" (UID: \"9242b57a-936a-43bb-8c6f-52c8ee7a8b49\") " pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:06:46.394861 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/671cebe9-b9c4-4b98-a879-9c098e61bcd8-crio-socket\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.394902 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.394883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szjr6\" (UniqueName: \"kubernetes.io/projected/671cebe9-b9c4-4b98-a879-9c098e61bcd8-kube-api-access-szjr6\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.395033 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.395019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c712628c-c52d-4fa3-b655-936485d249e3-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sznbb\" (UID: \"c712628c-c52d-4fa3-b655-936485d249e3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.396869 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.396852 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c712628c-c52d-4fa3-b655-936485d249e3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sznbb\" (UID: \"c712628c-c52d-4fa3-b655-936485d249e3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.447148 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.447125 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" Jun 03 01:06:46.496211 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496185 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-bound-sa-token\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496319 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496250 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/408a1a27-b023-4c4f-9db0-279b0e684217-installation-pull-secrets\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496319 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496282 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/408a1a27-b023-4c4f-9db0-279b0e684217-trusted-ca\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496413 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496325 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/408a1a27-b023-4c4f-9db0-279b0e684217-registry-certificates\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496413 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7h75\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-kube-api-access-j7h75\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496413 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496388 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/671cebe9-b9c4-4b98-a879-9c098e61bcd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.496542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496429 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/671cebe9-b9c4-4b98-a879-9c098e61bcd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.496795 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-registry-tls\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496856 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496833 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/671cebe9-b9c4-4b98-a879-9c098e61bcd8-data-volume\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.496919 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496859 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/408a1a27-b023-4c4f-9db0-279b0e684217-ca-trust-extracted\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.496919 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.496887 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvthr\" (UniqueName: \"kubernetes.io/projected/9242b57a-936a-43bb-8c6f-52c8ee7a8b49-kube-api-access-bvthr\") pod \"downloads-c65b8dc4b-dvztg\" (UID: \"9242b57a-936a-43bb-8c6f-52c8ee7a8b49\") " pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497117 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/671cebe9-b9c4-4b98-a879-9c098e61bcd8-crio-socket\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497155 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szjr6\" (UniqueName: \"kubernetes.io/projected/671cebe9-b9c4-4b98-a879-9c098e61bcd8-kube-api-access-szjr6\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497153 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/671cebe9-b9c4-4b98-a879-9c098e61bcd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/671cebe9-b9c4-4b98-a879-9c098e61bcd8-data-volume\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497233 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/408a1a27-b023-4c4f-9db0-279b0e684217-image-registry-private-configuration\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/408a1a27-b023-4c4f-9db0-279b0e684217-ca-trust-extracted\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/671cebe9-b9c4-4b98-a879-9c098e61bcd8-crio-socket\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.497594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.497459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/408a1a27-b023-4c4f-9db0-279b0e684217-registry-certificates\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.498085 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.498060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/408a1a27-b023-4c4f-9db0-279b0e684217-trusted-ca\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.499206 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.499185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/408a1a27-b023-4c4f-9db0-279b0e684217-installation-pull-secrets\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.499653 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.499636 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/671cebe9-b9c4-4b98-a879-9c098e61bcd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.499974 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.499954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/408a1a27-b023-4c4f-9db0-279b0e684217-image-registry-private-configuration\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.500372 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.500357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-registry-tls\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.504882 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.504838 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-bound-sa-token\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.505225 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.505206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7h75\" (UniqueName: \"kubernetes.io/projected/408a1a27-b023-4c4f-9db0-279b0e684217-kube-api-access-j7h75\") pod \"image-registry-7d444746fc-tz6hn\" (UID: \"408a1a27-b023-4c4f-9db0-279b0e684217\") " pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.505729 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.505710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szjr6\" (UniqueName: \"kubernetes.io/projected/671cebe9-b9c4-4b98-a879-9c098e61bcd8-kube-api-access-szjr6\") pod \"insights-runtime-extractor-vk6wv\" (UID: \"671cebe9-b9c4-4b98-a879-9c098e61bcd8\") " pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.505877 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.505859 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvthr\" (UniqueName: \"kubernetes.io/projected/9242b57a-936a-43bb-8c6f-52c8ee7a8b49-kube-api-access-bvthr\") pod \"downloads-c65b8dc4b-dvztg\" (UID: \"9242b57a-936a-43bb-8c6f-52c8ee7a8b49\") " pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:06:46.533980 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.533957 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vk6wv" Jun 03 01:06:46.564095 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.564068 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:06:46.571837 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.571807 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb"] Jun 03 01:06:46.573996 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:46.573967 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc712628c_c52d_4fa3_b655_936485d249e3.slice/crio-217f6938060fc46e19a8cddee50786fe11bd2ec496f94074e797f7a9b949a9fd WatchSource:0}: Error finding container 217f6938060fc46e19a8cddee50786fe11bd2ec496f94074e797f7a9b949a9fd: Status 404 returned error can't find the container with id 217f6938060fc46e19a8cddee50786fe11bd2ec496f94074e797f7a9b949a9fd Jun 03 01:06:46.598801 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.598776 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:46.677676 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.676443 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vk6wv"] Jun 03 01:06:46.732139 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.732114 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-dvztg"] Jun 03 01:06:46.734618 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:46.734577 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9242b57a_936a_43bb_8c6f_52c8ee7a8b49.slice/crio-51c1f81d191d223bcfecac04abf3cc09268f4987b6df2d2613e50bea8f722611 WatchSource:0}: Error finding container 51c1f81d191d223bcfecac04abf3cc09268f4987b6df2d2613e50bea8f722611: Status 404 returned error can't find the container with id 51c1f81d191d223bcfecac04abf3cc09268f4987b6df2d2613e50bea8f722611 Jun 03 01:06:46.773882 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.773850 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-dvztg" event={"ID":"9242b57a-936a-43bb-8c6f-52c8ee7a8b49","Type":"ContainerStarted","Data":"51c1f81d191d223bcfecac04abf3cc09268f4987b6df2d2613e50bea8f722611"} Jun 03 01:06:46.774941 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.774918 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" event={"ID":"c712628c-c52d-4fa3-b655-936485d249e3","Type":"ContainerStarted","Data":"217f6938060fc46e19a8cddee50786fe11bd2ec496f94074e797f7a9b949a9fd"} Jun 03 01:06:46.776513 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.776485 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xl69t" event={"ID":"bbde0f90-b113-483f-994d-ef9b0fd71f67","Type":"ContainerStarted","Data":"417de1884402c2de4be01062a70332e24fde947c8e9f59387070df14b9799b8d"} Jun 03 01:06:46.776627 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.776522 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xl69t" event={"ID":"bbde0f90-b113-483f-994d-ef9b0fd71f67","Type":"ContainerStarted","Data":"b47ebb69685e893a99ab47f142fa26bff038f1c33d2caabeb2d4fdf246e92b20"} Jun 03 01:06:46.777764 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.777741 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vk6wv" event={"ID":"671cebe9-b9c4-4b98-a879-9c098e61bcd8","Type":"ContainerStarted","Data":"ee42d63948256e554eb7f6a55646343a271e9ce029b75d00f3afecd0f7ba8745"} Jun 03 01:06:46.777852 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.777769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vk6wv" event={"ID":"671cebe9-b9c4-4b98-a879-9c098e61bcd8","Type":"ContainerStarted","Data":"1512726b9fc621d24351ca9938e4b0760f38baa1ff377184bc9efaa1ddbdc845"} Jun 03 01:06:46.780462 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.780440 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d444746fc-tz6hn"] Jun 03 01:06:46.783724 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:46.783694 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408a1a27_b023_4c4f_9db0_279b0e684217.slice/crio-094afc5cb4d82d70049bfdfb1c2d85e958715d2773c4a314703457b64edb7391 WatchSource:0}: Error finding container 094afc5cb4d82d70049bfdfb1c2d85e958715d2773c4a314703457b64edb7391: Status 404 returned error can't find the container with id 094afc5cb4d82d70049bfdfb1c2d85e958715d2773c4a314703457b64edb7391 Jun 03 01:06:46.802304 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:46.801810 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xl69t" podStartSLOduration=131.347691792 podStartE2EDuration="2m12.801791601s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:06:44.360836513 +0000 UTC m=+130.521061060" lastFinishedPulling="2026-06-03 01:06:45.814936308 +0000 UTC m=+131.975160869" observedRunningTime="2026-06-03 01:06:46.800390079 +0000 UTC m=+132.960614650" watchObservedRunningTime="2026-06-03 01:06:46.801791601 +0000 UTC m=+132.962016173" Jun 03 01:06:47.783075 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:47.783028 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vk6wv" event={"ID":"671cebe9-b9c4-4b98-a879-9c098e61bcd8","Type":"ContainerStarted","Data":"260e1277c5ea14e01d06c14191dbca4dcc82a4042b62a5dede4de6ca6e970ee7"} Jun 03 01:06:47.784979 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:47.784908 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" event={"ID":"408a1a27-b023-4c4f-9db0-279b0e684217","Type":"ContainerStarted","Data":"4425216b641969f4c670f7a49457faa989cd40c480fe85a603828f5bce2bc818"} Jun 03 01:06:47.784979 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:47.784949 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" event={"ID":"408a1a27-b023-4c4f-9db0-279b0e684217","Type":"ContainerStarted","Data":"094afc5cb4d82d70049bfdfb1c2d85e958715d2773c4a314703457b64edb7391"} Jun 03 01:06:47.785174 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:47.785068 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:06:47.802517 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:47.802451 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podStartSLOduration=1.80239487 podStartE2EDuration="1.80239487s" podCreationTimestamp="2026-06-03 01:06:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:06:47.800753673 +0000 UTC m=+133.960978256" watchObservedRunningTime="2026-06-03 01:06:47.80239487 +0000 UTC m=+133.962619442" Jun 03 01:06:48.112436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.112407 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:48.112545 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.112449 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:48.113733 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.113686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/281f53e8-9472-4a9d-84be-19abd23825c4-service-ca-bundle\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:48.115236 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.115210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/281f53e8-9472-4a9d-84be-19abd23825c4-metrics-certs\") pod \"router-default-8499d87b85-4vgzx\" (UID: \"281f53e8-9472-4a9d-84be-19abd23825c4\") " pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:48.396935 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.396857 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jn44l\"" Jun 03 01:06:48.405257 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.405227 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:48.535559 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.535526 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8499d87b85-4vgzx"] Jun 03 01:06:48.538512 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:06:48.538485 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281f53e8_9472_4a9d_84be_19abd23825c4.slice/crio-8e68f3990c4964b8e891bca9808cb72f2cb50fd5f4374fb16db4a731410250ed WatchSource:0}: Error finding container 8e68f3990c4964b8e891bca9808cb72f2cb50fd5f4374fb16db4a731410250ed: Status 404 returned error can't find the container with id 8e68f3990c4964b8e891bca9808cb72f2cb50fd5f4374fb16db4a731410250ed Jun 03 01:06:48.789392 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.789350 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" event={"ID":"c712628c-c52d-4fa3-b655-936485d249e3","Type":"ContainerStarted","Data":"73942ff4903ff6380d6ccc47902ec26e478fd74f68f1282f8303c377bebe1dca"} Jun 03 01:06:48.791251 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.791214 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8499d87b85-4vgzx" event={"ID":"281f53e8-9472-4a9d-84be-19abd23825c4","Type":"ContainerStarted","Data":"e9e429001152f65b058998c6232f75a7b8d1bc81991624fcd728a5f7bcfe802b"} Jun 03 01:06:48.791380 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.791255 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8499d87b85-4vgzx" event={"ID":"281f53e8-9472-4a9d-84be-19abd23825c4","Type":"ContainerStarted","Data":"8e68f3990c4964b8e891bca9808cb72f2cb50fd5f4374fb16db4a731410250ed"} Jun 03 01:06:48.804405 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.804352 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sznbb" podStartSLOduration=1.305057929 podStartE2EDuration="2.804338766s" podCreationTimestamp="2026-06-03 01:06:46 +0000 UTC" firstStartedPulling="2026-06-03 01:06:46.576069895 +0000 UTC m=+132.736294447" lastFinishedPulling="2026-06-03 01:06:48.075350734 +0000 UTC m=+134.235575284" observedRunningTime="2026-06-03 01:06:48.80321164 +0000 UTC m=+134.963436208" watchObservedRunningTime="2026-06-03 01:06:48.804338766 +0000 UTC m=+134.964563335" Jun 03 01:06:48.819522 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:48.819276 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-8499d87b85-4vgzx" podStartSLOduration=32.819265502 podStartE2EDuration="32.819265502s" podCreationTimestamp="2026-06-03 01:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:06:48.81837745 +0000 UTC m=+134.978602022" watchObservedRunningTime="2026-06-03 01:06:48.819265502 +0000 UTC m=+134.979490076" Jun 03 01:06:49.405761 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:49.405719 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:49.408594 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:49.408569 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:49.795630 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:49.795579 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vk6wv" event={"ID":"671cebe9-b9c4-4b98-a879-9c098e61bcd8","Type":"ContainerStarted","Data":"c02198d14d935ad2cea6dcc838e9a180aaac9cadbd272d285cacb2dda2cbb105"} Jun 03 01:06:49.796082 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:49.796062 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:49.797243 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:49.797223 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8499d87b85-4vgzx" Jun 03 01:06:49.811573 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:06:49.811530 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vk6wv" podStartSLOduration=1.008713628 podStartE2EDuration="3.811515927s" podCreationTimestamp="2026-06-03 01:06:46 +0000 UTC" firstStartedPulling="2026-06-03 01:06:46.760707726 +0000 UTC m=+132.920932273" lastFinishedPulling="2026-06-03 01:06:49.563510023 +0000 UTC m=+135.723734572" observedRunningTime="2026-06-03 01:06:49.809503499 +0000 UTC m=+135.969728067" watchObservedRunningTime="2026-06-03 01:06:49.811515927 +0000 UTC m=+135.971740498" Jun 03 01:07:00.294933 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.294895 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lcvqt"] Jun 03 01:07:00.300527 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.300503 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.302564 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.302527 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 01:07:00.302996 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.302978 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 01:07:00.303275 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.303261 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjcbr\"" Jun 03 01:07:00.303481 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.303466 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 01:07:00.303719 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.303704 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 01:07:00.304033 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.304013 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 01:07:00.304201 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.304017 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 01:07:00.413264 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-root\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-tls\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-sys\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-accelerators-collector-config\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413374 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e0121c1-3dc9-4417-978f-f9a7aef16046-metrics-client-ca\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413433 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-textfile\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-wtmp\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-297lh\" (UniqueName: \"kubernetes.io/projected/5e0121c1-3dc9-4417-978f-f9a7aef16046-kube-api-access-297lh\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.413647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.413608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515092 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515049 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-root\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515113 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-tls\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515147 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-sys\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515174 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-accelerators-collector-config\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-root\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515202 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e0121c1-3dc9-4417-978f-f9a7aef16046-metrics-client-ca\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515231 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-textfile\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515277 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515274 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-wtmp\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515625 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515299 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-297lh\" (UniqueName: \"kubernetes.io/projected/5e0121c1-3dc9-4417-978f-f9a7aef16046-kube-api-access-297lh\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515625 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:07:00.515310 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 01:07:00.515625 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515340 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.515625 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:07:00.515369 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-tls podName:5e0121c1-3dc9-4417-978f-f9a7aef16046 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:01.015349109 +0000 UTC m=+147.175573661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-tls") pod "node-exporter-lcvqt" (UID: "5e0121c1-3dc9-4417-978f-f9a7aef16046") : secret "node-exporter-tls" not found Jun 03 01:07:00.515837 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.515748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-sys\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.516458 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.516205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-wtmp\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.516458 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.516265 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e0121c1-3dc9-4417-978f-f9a7aef16046-metrics-client-ca\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.516655 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.516482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-textfile\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.516655 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.516646 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-accelerators-collector-config\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.518099 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.518077 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:00.526247 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:00.526223 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-297lh\" (UniqueName: \"kubernetes.io/projected/5e0121c1-3dc9-4417-978f-f9a7aef16046-kube-api-access-297lh\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:01.019867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:01.019818 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-tls\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:01.022416 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:01.022393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e0121c1-3dc9-4417-978f-f9a7aef16046-node-exporter-tls\") pod \"node-exporter-lcvqt\" (UID: \"5e0121c1-3dc9-4417-978f-f9a7aef16046\") " pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:01.213789 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:01.213754 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lcvqt" Jun 03 01:07:02.223063 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.223026 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7977bd676c-s77c4"] Jun 03 01:07:02.228531 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.228494 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.230976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230783 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 01:07:02.230976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230796 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 01:07:02.230976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230812 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-666m8\"" Jun 03 01:07:02.230976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230860 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 01:07:02.230976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230784 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 01:07:02.230976 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230913 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-84jkk09q5m0l9\"" Jun 03 01:07:02.231340 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.230998 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 01:07:02.237069 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.236988 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7977bd676c-s77c4"] Jun 03 01:07:02.330337 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jz4\" (UniqueName: \"kubernetes.io/projected/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-kube-api-access-p4jz4\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330497 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330497 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330497 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-tls\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330695 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330695 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-metrics-client-ca\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330695 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-grpc-tls\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.330695 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.330641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.431665 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431625 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-tls\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.431836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431692 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.431836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431737 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-metrics-client-ca\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.431836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431759 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-grpc-tls\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.431836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431790 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.431836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431824 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jz4\" (UniqueName: \"kubernetes.io/projected/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-kube-api-access-p4jz4\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.432074 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431851 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.432074 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.431890 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.432883 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.432830 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-metrics-client-ca\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.434736 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.434708 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.434849 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.434830 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-tls\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.435146 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.435124 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.435375 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.435332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-grpc-tls\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.435958 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.435936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.436044 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.435946 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.439279 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.439255 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jz4\" (UniqueName: \"kubernetes.io/projected/7f09b557-a83f-4af2-9d1a-ddd9c559f74d-kube-api-access-p4jz4\") pod \"thanos-querier-7977bd676c-s77c4\" (UID: \"7f09b557-a83f-4af2-9d1a-ddd9c559f74d\") " pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:02.539927 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:02.539890 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:04.559790 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.559758 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5fddbbffbf-lz7x8"] Jun 03 01:07:04.566106 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.566073 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.568574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.568547 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q7bmp\"" Jun 03 01:07:04.569013 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.568981 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 01:07:04.569401 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.569384 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 01:07:04.569505 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.569387 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 01:07:04.569570 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.569410 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 01:07:04.569570 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.569418 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e66p0eobctt6e\"" Jun 03 01:07:04.572129 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.572106 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fddbbffbf-lz7x8"] Jun 03 01:07:04.651189 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-metrics-server-audit-profiles\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.651189 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4m5d\" (UniqueName: \"kubernetes.io/projected/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-kube-api-access-s4m5d\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.651421 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-client-ca-bundle\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.651421 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-audit-log\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.651511 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.651511 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-secret-metrics-server-tls\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.651642 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.651562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-secret-metrics-server-client-certs\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.684199 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:07:04.684168 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0121c1_3dc9_4417_978f_f9a7aef16046.slice/crio-e26daa14b2508316d680cba1ee4836ff36395b376dd73badf741a81d5f994869 WatchSource:0}: Error finding container e26daa14b2508316d680cba1ee4836ff36395b376dd73badf741a81d5f994869: Status 404 returned error can't find the container with id e26daa14b2508316d680cba1ee4836ff36395b376dd73badf741a81d5f994869 Jun 03 01:07:04.753159 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.752963 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-client-ca-bundle\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.753159 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.753044 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-audit-log\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.753159 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.753097 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.753159 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.753125 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-secret-metrics-server-tls\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.753398 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.753191 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-secret-metrics-server-client-certs\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.753398 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.753219 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-metrics-server-audit-profiles\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.753398 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.753250 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4m5d\" (UniqueName: \"kubernetes.io/projected/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-kube-api-access-s4m5d\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.754761 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.754150 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-audit-log\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.754761 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.754586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.755085 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.755053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-metrics-server-audit-profiles\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.757008 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.756970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-secret-metrics-server-client-certs\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.757867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.757807 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-secret-metrics-server-tls\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.758196 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.758151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-client-ca-bundle\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.761685 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.761655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4m5d\" (UniqueName: \"kubernetes.io/projected/841f79bc-dcfd-46a8-b5f6-2a09dff0de12-kube-api-access-s4m5d\") pod \"metrics-server-5fddbbffbf-lz7x8\" (UID: \"841f79bc-dcfd-46a8-b5f6-2a09dff0de12\") " pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:04.807382 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.807360 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7977bd676c-s77c4"] Jun 03 01:07:04.810684 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:07:04.810646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f09b557_a83f_4af2_9d1a_ddd9c559f74d.slice/crio-26395fe03419d28aea285df38b3a21c1467ea7b8cdcf3ad0b06d6132277a6190 WatchSource:0}: Error finding container 26395fe03419d28aea285df38b3a21c1467ea7b8cdcf3ad0b06d6132277a6190: Status 404 returned error can't find the container with id 26395fe03419d28aea285df38b3a21c1467ea7b8cdcf3ad0b06d6132277a6190 Jun 03 01:07:04.844042 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.844014 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"26395fe03419d28aea285df38b3a21c1467ea7b8cdcf3ad0b06d6132277a6190"} Jun 03 01:07:04.845032 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.845009 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lcvqt" event={"ID":"5e0121c1-3dc9-4417-978f-f9a7aef16046","Type":"ContainerStarted","Data":"e26daa14b2508316d680cba1ee4836ff36395b376dd73badf741a81d5f994869"} Jun 03 01:07:04.878824 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:04.878800 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:05.011712 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.011659 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fddbbffbf-lz7x8"] Jun 03 01:07:05.015139 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:07:05.015109 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841f79bc_dcfd_46a8_b5f6_2a09dff0de12.slice/crio-bcbe7854017b04b45922803aa4738ae28f77ccc8db494b6369af162497bb4ad6 WatchSource:0}: Error finding container bcbe7854017b04b45922803aa4738ae28f77ccc8db494b6369af162497bb4ad6: Status 404 returned error can't find the container with id bcbe7854017b04b45922803aa4738ae28f77ccc8db494b6369af162497bb4ad6 Jun 03 01:07:05.037274 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.037250 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb"] Jun 03 01:07:05.040332 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.040167 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:05.042206 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.042025 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 01:07:05.042206 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.042086 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-tp557\"" Jun 03 01:07:05.049015 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.048304 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb"] Jun 03 01:07:05.157145 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.157059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e2a5a61-66db-40bc-ad0c-ccd2b46154b3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ppmrb\" (UID: \"0e2a5a61-66db-40bc-ad0c-ccd2b46154b3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:05.258326 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.258155 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e2a5a61-66db-40bc-ad0c-ccd2b46154b3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ppmrb\" (UID: \"0e2a5a61-66db-40bc-ad0c-ccd2b46154b3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:05.258519 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:07:05.258342 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 01:07:05.258519 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:07:05.258423 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2a5a61-66db-40bc-ad0c-ccd2b46154b3-monitoring-plugin-cert podName:0e2a5a61-66db-40bc-ad0c-ccd2b46154b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:05.758400867 +0000 UTC m=+151.918625432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e2a5a61-66db-40bc-ad0c-ccd2b46154b3-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-ppmrb" (UID: "0e2a5a61-66db-40bc-ad0c-ccd2b46154b3") : secret "monitoring-plugin-cert" not found Jun 03 01:07:05.764221 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.764173 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e2a5a61-66db-40bc-ad0c-ccd2b46154b3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ppmrb\" (UID: \"0e2a5a61-66db-40bc-ad0c-ccd2b46154b3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:05.780240 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.780205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e2a5a61-66db-40bc-ad0c-ccd2b46154b3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ppmrb\" (UID: \"0e2a5a61-66db-40bc-ad0c-ccd2b46154b3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:05.851575 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.851526 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-dvztg" event={"ID":"9242b57a-936a-43bb-8c6f-52c8ee7a8b49","Type":"ContainerStarted","Data":"2257c2a53b74866562698824d2ed7248d2ca7902ac016c6b1e5b7d90db99a317"} Jun 03 01:07:05.852655 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.852627 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:07:05.855826 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.855787 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" event={"ID":"841f79bc-dcfd-46a8-b5f6-2a09dff0de12","Type":"ContainerStarted","Data":"bcbe7854017b04b45922803aa4738ae28f77ccc8db494b6369af162497bb4ad6"} Jun 03 01:07:05.869968 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.868102 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-dvztg" podStartSLOduration=1.8361385559999999 podStartE2EDuration="19.868084782s" podCreationTimestamp="2026-06-03 01:06:46 +0000 UTC" firstStartedPulling="2026-06-03 01:06:46.736676655 +0000 UTC m=+132.896901202" lastFinishedPulling="2026-06-03 01:07:04.768622858 +0000 UTC m=+150.928847428" observedRunningTime="2026-06-03 01:07:05.866274313 +0000 UTC m=+152.026498884" watchObservedRunningTime="2026-06-03 01:07:05.868084782 +0000 UTC m=+152.028309354" Jun 03 01:07:05.869968 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.868658 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-dvztg" Jun 03 01:07:05.952242 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:05.952212 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:06.145494 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.144918 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb"] Jun 03 01:07:06.155223 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:07:06.155186 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2a5a61_66db_40bc_ad0c_ccd2b46154b3.slice/crio-96b24a568bf0192a0661e75664e5d42a6e18df7b5a8fecfb9fccef6aeebf3248 WatchSource:0}: Error finding container 96b24a568bf0192a0661e75664e5d42a6e18df7b5a8fecfb9fccef6aeebf3248: Status 404 returned error can't find the container with id 96b24a568bf0192a0661e75664e5d42a6e18df7b5a8fecfb9fccef6aeebf3248 Jun 03 01:07:06.458363 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.457990 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 01:07:06.475345 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.474736 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.476699 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.476654 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 01:07:06.477051 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.476888 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 01:07:06.477051 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.477008 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 01:07:06.477358 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.476888 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 01:07:06.477509 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.477482 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478048 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478113 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kgpz8\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478251 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478377 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478473 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1j5qhra8hekgj\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478569 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478680 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478780 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 01:07:06.479181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.478983 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 01:07:06.482211 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.481854 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 01:07:06.571950 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.571910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/432386f6-6d4d-455c-8e51-00e82a76f315-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572144 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.571960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572144 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572144 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572144 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572144 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572404 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572404 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/432386f6-6d4d-455c-8e51-00e82a76f315-config-out\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572404 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572404 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-web-config\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-config\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572593 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572901 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572625 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csw74\" (UniqueName: \"kubernetes.io/projected/432386f6-6d4d-455c-8e51-00e82a76f315-kube-api-access-csw74\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.572901 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.572669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.604472 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.604389 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:06.604660 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.604490 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.673950 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674029 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-web-config\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674068 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674103 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674136 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-config\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674216 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674241 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674267 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-csw74\" (UniqueName: \"kubernetes.io/projected/432386f6-6d4d-455c-8e51-00e82a76f315-kube-api-access-csw74\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674337 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/432386f6-6d4d-455c-8e51-00e82a76f315-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674413 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674438 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674465 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674489 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.675923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674521 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.678640 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.674579 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/432386f6-6d4d-455c-8e51-00e82a76f315-config-out\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.678640 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.675775 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.678640 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.676011 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.678640 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.676427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.678640 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.677048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.678640 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.677614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.679215 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.679178 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/432386f6-6d4d-455c-8e51-00e82a76f315-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.684924 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.684869 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.685087 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.685066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.686113 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.686066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-config\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.689428 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.689307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/432386f6-6d4d-455c-8e51-00e82a76f315-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.689428 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.689381 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.689428 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.689420 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-web-config\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.689712 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.689624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.689712 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.689662 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/432386f6-6d4d-455c-8e51-00e82a76f315-config-out\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.689973 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.689948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.690053 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.690036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.691591 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.691560 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/432386f6-6d4d-455c-8e51-00e82a76f315-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.692331 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.692283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csw74\" (UniqueName: \"kubernetes.io/projected/432386f6-6d4d-455c-8e51-00e82a76f315-kube-api-access-csw74\") pod \"prometheus-k8s-0\" (UID: \"432386f6-6d4d-455c-8e51-00e82a76f315\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.791971 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.791846 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:06.860915 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.860857 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" event={"ID":"0e2a5a61-66db-40bc-ad0c-ccd2b46154b3","Type":"ContainerStarted","Data":"96b24a568bf0192a0661e75664e5d42a6e18df7b5a8fecfb9fccef6aeebf3248"} Jun 03 01:07:06.863542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.862858 2566 generic.go:358] "Generic (PLEG): container finished" podID="5e0121c1-3dc9-4417-978f-f9a7aef16046" containerID="221a5cd050024679c9e9e26ac26a0441c1a80b0047263c58c828cbf11d404b43" exitCode=0 Jun 03 01:07:06.863542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:06.863475 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lcvqt" event={"ID":"5e0121c1-3dc9-4417-978f-f9a7aef16046","Type":"ContainerDied","Data":"221a5cd050024679c9e9e26ac26a0441c1a80b0047263c58c828cbf11d404b43"} Jun 03 01:07:08.405240 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.405179 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 01:07:08.797421 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.797065 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:08.797421 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.797131 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:08.870481 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.870444 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"231b157229694556795ba6deb4d03a910563305aa0eae45bf455429bbb304091"} Jun 03 01:07:08.872563 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.872532 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"38161ef718d17080f398b3445c902c0e5f0bc3704bbca8abe4fb155f9e559894"} Jun 03 01:07:08.872714 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.872567 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"a1504891585e0e5d071019302b934c15ddd149e42cf0fd5131b4f908dcaf4e18"} Jun 03 01:07:08.872714 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.872582 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"38e72dfe19ac10a32cd2367645e6c885c25387945cc94a7fe635c31ebb00a393"} Jun 03 01:07:08.874917 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.874857 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lcvqt" event={"ID":"5e0121c1-3dc9-4417-978f-f9a7aef16046","Type":"ContainerStarted","Data":"08b5bd2ff774ef7f0aff674b73672cfd93a86386bd9d2be1fc2d77d4b90a79cc"} Jun 03 01:07:08.874917 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.874892 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lcvqt" event={"ID":"5e0121c1-3dc9-4417-978f-f9a7aef16046","Type":"ContainerStarted","Data":"f2c7dd5fd5cb5093f61d7be3252b134a71d914df99120b0a5ac74b1eed17fea8"} Jun 03 01:07:08.876296 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.876272 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" event={"ID":"841f79bc-dcfd-46a8-b5f6-2a09dff0de12","Type":"ContainerStarted","Data":"faf497132dca5641ecdfc3310a26b16dcf5c35e7e4fe3ed6ab11ea58258333cc"} Jun 03 01:07:08.891659 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.891543 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lcvqt" podStartSLOduration=7.648412523 podStartE2EDuration="8.891528681s" podCreationTimestamp="2026-06-03 01:07:00 +0000 UTC" firstStartedPulling="2026-06-03 01:07:04.685694878 +0000 UTC m=+150.845919425" lastFinishedPulling="2026-06-03 01:07:05.928811017 +0000 UTC m=+152.089035583" observedRunningTime="2026-06-03 01:07:08.889867308 +0000 UTC m=+155.050091878" watchObservedRunningTime="2026-06-03 01:07:08.891528681 +0000 UTC m=+155.051753251" Jun 03 01:07:08.910929 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:08.905763 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" podStartSLOduration=1.7008778850000001 podStartE2EDuration="4.905732174s" podCreationTimestamp="2026-06-03 01:07:04 +0000 UTC" firstStartedPulling="2026-06-03 01:07:05.017408721 +0000 UTC m=+151.177633268" lastFinishedPulling="2026-06-03 01:07:08.222263005 +0000 UTC m=+154.382487557" observedRunningTime="2026-06-03 01:07:08.903266016 +0000 UTC m=+155.063490588" watchObservedRunningTime="2026-06-03 01:07:08.905732174 +0000 UTC m=+155.065956745" Jun 03 01:07:10.883756 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:10.883721 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" event={"ID":"0e2a5a61-66db-40bc-ad0c-ccd2b46154b3","Type":"ContainerStarted","Data":"6118fa4a93fe39f9c0cd68e0717e2e40aad4de871bda4d7bd184c348a19f353f"} Jun 03 01:07:10.884212 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:10.883932 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:10.885433 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:10.885392 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"4787a3c00e19624dce268ab88d0c3d0a338898bc4c8bf5c969b93f658ebc5c64"} Jun 03 01:07:10.889580 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:10.889554 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" Jun 03 01:07:10.896218 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:10.896118 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ppmrb" podStartSLOduration=1.400148267 podStartE2EDuration="5.896102536s" podCreationTimestamp="2026-06-03 01:07:05 +0000 UTC" firstStartedPulling="2026-06-03 01:07:06.158096891 +0000 UTC m=+152.318321438" lastFinishedPulling="2026-06-03 01:07:10.654051142 +0000 UTC m=+156.814275707" observedRunningTime="2026-06-03 01:07:10.895973567 +0000 UTC m=+157.056198137" watchObservedRunningTime="2026-06-03 01:07:10.896102536 +0000 UTC m=+157.056327108" Jun 03 01:07:11.893337 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.891632 2566 generic.go:358] "Generic (PLEG): container finished" podID="432386f6-6d4d-455c-8e51-00e82a76f315" containerID="4787a3c00e19624dce268ab88d0c3d0a338898bc4c8bf5c969b93f658ebc5c64" exitCode=0 Jun 03 01:07:11.893337 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.891747 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerDied","Data":"4787a3c00e19624dce268ab88d0c3d0a338898bc4c8bf5c969b93f658ebc5c64"} Jun 03 01:07:11.896445 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.896370 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"4b9eeb3263788301d19a1b36f8005a2b41fd1d8a1345feff4f54073d1bcf010b"} Jun 03 01:07:11.896445 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.896410 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"5e29849d2c867cb51ad9fcac92ebce36de769533ae6b4fcc23f90f114072ac40"} Jun 03 01:07:11.896445 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.896423 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" event={"ID":"7f09b557-a83f-4af2-9d1a-ddd9c559f74d","Type":"ContainerStarted","Data":"d2651c52fa7cc4c5e9a27dda9aa9f122e251d2acbc8d97701d528cb66bd39901"} Jun 03 01:07:11.896857 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.896833 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:11.932530 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:11.932470 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" podStartSLOduration=3.728959027 podStartE2EDuration="9.932453438s" podCreationTimestamp="2026-06-03 01:07:02 +0000 UTC" firstStartedPulling="2026-06-03 01:07:04.81237878 +0000 UTC m=+150.972603339" lastFinishedPulling="2026-06-03 01:07:11.015873192 +0000 UTC m=+157.176097750" observedRunningTime="2026-06-03 01:07:11.929467432 +0000 UTC m=+158.089692003" watchObservedRunningTime="2026-06-03 01:07:11.932453438 +0000 UTC m=+158.092678008" Jun 03 01:07:14.701568 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:07:14.701481 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mdfhz" podUID="8e5aa1ac-f321-468e-a999-a027c0b6387e" Jun 03 01:07:14.720842 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:07:14.720802 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8fbtj" podUID="de267643-0496-4cfb-a294-5fc62d88d384" Jun 03 01:07:14.904890 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:14.904860 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:07:14.905056 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:14.904868 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mdfhz" Jun 03 01:07:15.910278 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:15.910247 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"b458f84edfa36278be4653f81d33def50f2d1e0a7877850c832e1df367de3ff0"} Jun 03 01:07:15.910278 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:15.910280 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"6c1e26f3e8e41af342bde2e15fd707f5f298c49c88280719d798ac15cc9afcca"} Jun 03 01:07:15.910659 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:15.910290 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"105b29dd5d5b2e5e7e54ae0e995ff4b6cf2a4fa2274bd3f80c0480bf709ff157"} Jun 03 01:07:16.603569 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:16.603538 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:16.603782 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:16.603586 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:16.915992 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:16.915908 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"8ec2be1b129ba83663c04e652ebc76a20cd39d66b050cea3caa297c6b924df78"} Jun 03 01:07:16.915992 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:16.915946 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"122692c9976802c956d12a26fb232893dd311eb68374797983071ed4ed7316a2"} Jun 03 01:07:16.915992 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:16.915957 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"432386f6-6d4d-455c-8e51-00e82a76f315","Type":"ContainerStarted","Data":"efe93c7db29b16af57ce27d3156c6548d26a3062c167203753f6e0bc64462025"} Jun 03 01:07:16.939582 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:16.939528 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.895527936 podStartE2EDuration="10.939514626s" podCreationTimestamp="2026-06-03 01:07:06 +0000 UTC" firstStartedPulling="2026-06-03 01:07:08.413769442 +0000 UTC m=+154.573994008" lastFinishedPulling="2026-06-03 01:07:15.457756148 +0000 UTC m=+161.617980698" observedRunningTime="2026-06-03 01:07:16.937819391 +0000 UTC m=+163.098043961" watchObservedRunningTime="2026-06-03 01:07:16.939514626 +0000 UTC m=+163.099739243" Jun 03 01:07:17.905351 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:17.905322 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7977bd676c-s77c4" Jun 03 01:07:18.794948 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:18.794915 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:18.795332 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:18.794969 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:19.605299 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.605256 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:07:19.605502 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.605316 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:07:19.607615 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.607574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5aa1ac-f321-468e-a999-a027c0b6387e-metrics-tls\") pod \"dns-default-mdfhz\" (UID: \"8e5aa1ac-f321-468e-a999-a027c0b6387e\") " pod="openshift-dns/dns-default-mdfhz" Jun 03 01:07:19.607774 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.607757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de267643-0496-4cfb-a294-5fc62d88d384-cert\") pod \"ingress-canary-8fbtj\" (UID: \"de267643-0496-4cfb-a294-5fc62d88d384\") " pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:07:19.707587 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.707558 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kzjqn\"" Jun 03 01:07:19.707865 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.707851 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tw28v\"" Jun 03 01:07:19.716066 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.716047 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mdfhz" Jun 03 01:07:19.716130 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.716118 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fbtj" Jun 03 01:07:19.861667 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.861575 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fbtj"] Jun 03 01:07:19.865454 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:07:19.865428 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde267643_0496_4cfb_a294_5fc62d88d384.slice/crio-7e1225498692d348f67b9a5931ec9b3d67503888a58a2a7c720fa125e5bd29f6 WatchSource:0}: Error finding container 7e1225498692d348f67b9a5931ec9b3d67503888a58a2a7c720fa125e5bd29f6: Status 404 returned error can't find the container with id 7e1225498692d348f67b9a5931ec9b3d67503888a58a2a7c720fa125e5bd29f6 Jun 03 01:07:19.880009 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.879988 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mdfhz"] Jun 03 01:07:19.882263 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:07:19.882241 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5aa1ac_f321_468e_a999_a027c0b6387e.slice/crio-451b1d22521d1f6faaf54b4b5bb11d3c55b2b12ca02a5f53a9c254030169426b WatchSource:0}: Error finding container 451b1d22521d1f6faaf54b4b5bb11d3c55b2b12ca02a5f53a9c254030169426b: Status 404 returned error can't find the container with id 451b1d22521d1f6faaf54b4b5bb11d3c55b2b12ca02a5f53a9c254030169426b Jun 03 01:07:19.926887 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.926857 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mdfhz" event={"ID":"8e5aa1ac-f321-468e-a999-a027c0b6387e","Type":"ContainerStarted","Data":"451b1d22521d1f6faaf54b4b5bb11d3c55b2b12ca02a5f53a9c254030169426b"} Jun 03 01:07:19.927799 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:19.927777 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fbtj" event={"ID":"de267643-0496-4cfb-a294-5fc62d88d384","Type":"ContainerStarted","Data":"7e1225498692d348f67b9a5931ec9b3d67503888a58a2a7c720fa125e5bd29f6"} Jun 03 01:07:21.792542 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:21.792509 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:07:22.938322 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:22.938284 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fbtj" event={"ID":"de267643-0496-4cfb-a294-5fc62d88d384","Type":"ContainerStarted","Data":"384a2b00c0458822fa93d53c6638fb20a8fa96d99b01703895d60c1acc859d5b"} Jun 03 01:07:22.940023 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:22.939996 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mdfhz" event={"ID":"8e5aa1ac-f321-468e-a999-a027c0b6387e","Type":"ContainerStarted","Data":"e4240f929b4447732177a4916aa8140f6977f33f0407a56deac323d493a6e270"} Jun 03 01:07:22.940132 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:22.940025 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mdfhz" event={"ID":"8e5aa1ac-f321-468e-a999-a027c0b6387e","Type":"ContainerStarted","Data":"b3f050237ad49edca459a29db7b6c42bd9427f40dbac910dd0a37808ed5cf018"} Jun 03 01:07:22.940181 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:22.940124 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mdfhz" Jun 03 01:07:22.957307 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:22.957255 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8fbtj" podStartSLOduration=129.538617082 podStartE2EDuration="2m11.957239252s" podCreationTimestamp="2026-06-03 01:05:11 +0000 UTC" firstStartedPulling="2026-06-03 01:07:19.868132609 +0000 UTC m=+166.028357157" lastFinishedPulling="2026-06-03 01:07:22.28675478 +0000 UTC m=+168.446979327" observedRunningTime="2026-06-03 01:07:22.956490865 +0000 UTC m=+169.116715434" watchObservedRunningTime="2026-06-03 01:07:22.957239252 +0000 UTC m=+169.117463821" Jun 03 01:07:22.970536 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:22.970480 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mdfhz" podStartSLOduration=129.564082418 podStartE2EDuration="2m11.970465392s" podCreationTimestamp="2026-06-03 01:05:11 +0000 UTC" firstStartedPulling="2026-06-03 01:07:19.88400652 +0000 UTC m=+166.044231071" lastFinishedPulling="2026-06-03 01:07:22.290389484 +0000 UTC m=+168.450614045" observedRunningTime="2026-06-03 01:07:22.970141372 +0000 UTC m=+169.130365941" watchObservedRunningTime="2026-06-03 01:07:22.970465392 +0000 UTC m=+169.130689944" Jun 03 01:07:24.878988 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:24.878959 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:24.878988 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:24.878996 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:26.603701 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:26.603663 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:26.604150 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:26.603717 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:26.604150 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:26.603758 2566 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:07:26.604240 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:26.604198 2566 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"4425216b641969f4c670f7a49457faa989cd40c480fe85a603828f5bce2bc818"} pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" containerMessage="Container registry failed liveness probe, will be restarted" Jun 03 01:07:26.607436 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:26.607411 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:26.607558 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:26.607454 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:32.945736 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:32.945703 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mdfhz" Jun 03 01:07:36.608392 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:36.608361 2566 patch_prober.go:28] interesting pod/image-registry-7d444746fc-tz6hn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:36.608763 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:36.608411 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:40.995835 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:40.995800 2566 generic.go:358] "Generic (PLEG): container finished" podID="4f67c7d8-fec2-43b8-bdf5-469d67293cb0" containerID="3bab9b2ac54b6d2a20e640bafe67277facc748505060a66e7517b921da1d86f3" exitCode=0 Jun 03 01:07:40.996294 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:40.995861 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" event={"ID":"4f67c7d8-fec2-43b8-bdf5-469d67293cb0","Type":"ContainerDied","Data":"3bab9b2ac54b6d2a20e640bafe67277facc748505060a66e7517b921da1d86f3"} Jun 03 01:07:40.996294 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:40.996188 2566 scope.go:117] "RemoveContainer" containerID="3bab9b2ac54b6d2a20e640bafe67277facc748505060a66e7517b921da1d86f3" Jun 03 01:07:42.000308 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:42.000273 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6mz5c" event={"ID":"4f67c7d8-fec2-43b8-bdf5-469d67293cb0","Type":"ContainerStarted","Data":"8696831991bddd66ca418f03864c51bbfb49f98b97d48ef924505d03b54458e7"} Jun 03 01:07:44.884862 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:44.884834 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:44.888540 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:44.888514 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5fddbbffbf-lz7x8" Jun 03 01:07:46.608069 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:46.608041 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:07:51.623533 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:51.623490 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" podUID="408a1a27-b023-4c4f-9db0-279b0e684217" containerName="registry" containerID="cri-o://4425216b641969f4c670f7a49457faa989cd40c480fe85a603828f5bce2bc818" gracePeriod=30 Jun 03 01:07:53.035171 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:53.035136 2566 generic.go:358] "Generic (PLEG): container finished" podID="408a1a27-b023-4c4f-9db0-279b0e684217" containerID="4425216b641969f4c670f7a49457faa989cd40c480fe85a603828f5bce2bc818" exitCode=0 Jun 03 01:07:53.035568 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:53.035218 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" event={"ID":"408a1a27-b023-4c4f-9db0-279b0e684217","Type":"ContainerDied","Data":"4425216b641969f4c670f7a49457faa989cd40c480fe85a603828f5bce2bc818"} Jun 03 01:07:53.035568 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:53.035252 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" event={"ID":"408a1a27-b023-4c4f-9db0-279b0e684217","Type":"ContainerStarted","Data":"21134559e72cfff6e5ab16699146717a5d42847d4e7f1da2892ea12e64405762"} Jun 03 01:07:53.035568 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:07:53.035277 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:08:06.792759 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:08:06.792724 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:08:06.808014 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:08:06.807987 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:08:07.095978 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:08:07.095891 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 01:08:14.042140 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:08:14.042113 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d444746fc-tz6hn" Jun 03 01:09:34.344512 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:09:34.344484 2566 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 01:10:25.458022 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.457938 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d"] Jun 03 01:10:25.460146 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.460128 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.462064 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.462035 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 01:10:25.462176 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.462154 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l57z2\"" Jun 03 01:10:25.462247 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.462175 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 01:10:25.462247 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.462155 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 01:10:25.462559 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.462544 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 01:10:25.476030 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.476003 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d"] Jun 03 01:10:25.536890 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.536849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6d5\" (UniqueName: \"kubernetes.io/projected/c9ce3475-8194-4f3a-a307-7b3319563a08-kube-api-access-7t6d5\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.537058 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.536896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ce3475-8194-4f3a-a307-7b3319563a08-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.537058 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.536979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ce3475-8194-4f3a-a307-7b3319563a08-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.537058 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.537036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ce3475-8194-4f3a-a307-7b3319563a08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.537058 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.537054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ce3475-8194-4f3a-a307-7b3319563a08-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.637468 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.637436 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6d5\" (UniqueName: \"kubernetes.io/projected/c9ce3475-8194-4f3a-a307-7b3319563a08-kube-api-access-7t6d5\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.637468 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.637469 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ce3475-8194-4f3a-a307-7b3319563a08-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.637711 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.637511 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ce3475-8194-4f3a-a307-7b3319563a08-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.637711 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.637541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ce3475-8194-4f3a-a307-7b3319563a08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.637711 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.637557 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ce3475-8194-4f3a-a307-7b3319563a08-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.637995 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.637967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ce3475-8194-4f3a-a307-7b3319563a08-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.639922 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.639894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ce3475-8194-4f3a-a307-7b3319563a08-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.640027 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.639966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ce3475-8194-4f3a-a307-7b3319563a08-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.640027 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.639994 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ce3475-8194-4f3a-a307-7b3319563a08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.645273 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.645251 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6d5\" (UniqueName: \"kubernetes.io/projected/c9ce3475-8194-4f3a-a307-7b3319563a08-kube-api-access-7t6d5\") pod \"opendatahub-operator-controller-manager-85b884ccf6-h8k4d\" (UID: \"c9ce3475-8194-4f3a-a307-7b3319563a08\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.770395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.770347 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:25.908659 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.908516 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d"] Jun 03 01:10:25.911483 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:10:25.911454 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ce3475_8194_4f3a_a307_7b3319563a08.slice/crio-5bc2d2b6c642f5cef6409647bfd2991b656c430d8447d03c3f66615297ea0879 WatchSource:0}: Error finding container 5bc2d2b6c642f5cef6409647bfd2991b656c430d8447d03c3f66615297ea0879: Status 404 returned error can't find the container with id 5bc2d2b6c642f5cef6409647bfd2991b656c430d8447d03c3f66615297ea0879 Jun 03 01:10:25.913100 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:25.913078 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:10:26.491312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:26.491264 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" event={"ID":"c9ce3475-8194-4f3a-a307-7b3319563a08","Type":"ContainerStarted","Data":"5bc2d2b6c642f5cef6409647bfd2991b656c430d8447d03c3f66615297ea0879"} Jun 03 01:10:29.503301 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:29.503263 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" event={"ID":"c9ce3475-8194-4f3a-a307-7b3319563a08","Type":"ContainerStarted","Data":"b13e911f7971b4566628e4e730a2cc28e4e9e76ee899c74f3e8be6ca3a1ea8af"} Jun 03 01:10:30.507519 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:30.507479 2566 generic.go:358] "Generic (PLEG): container finished" podID="c9ce3475-8194-4f3a-a307-7b3319563a08" containerID="b13e911f7971b4566628e4e730a2cc28e4e9e76ee899c74f3e8be6ca3a1ea8af" exitCode=0 Jun 03 01:10:30.507932 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:30.507567 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" event={"ID":"c9ce3475-8194-4f3a-a307-7b3319563a08","Type":"ContainerDied","Data":"b13e911f7971b4566628e4e730a2cc28e4e9e76ee899c74f3e8be6ca3a1ea8af"} Jun 03 01:10:31.512422 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:31.512386 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" event={"ID":"c9ce3475-8194-4f3a-a307-7b3319563a08","Type":"ContainerStarted","Data":"794051ccacb379dd188cd0244a561aaf09705949b1c617960adb1a9a97c075a2"} Jun 03 01:10:31.512820 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:31.512499 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:31.531498 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:31.531449 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" podStartSLOduration=1.608458659 podStartE2EDuration="6.531434002s" podCreationTimestamp="2026-06-03 01:10:25 +0000 UTC" firstStartedPulling="2026-06-03 01:10:25.913198223 +0000 UTC m=+352.073422770" lastFinishedPulling="2026-06-03 01:10:30.836173555 +0000 UTC m=+356.996398113" observedRunningTime="2026-06-03 01:10:31.530121569 +0000 UTC m=+357.690346138" watchObservedRunningTime="2026-06-03 01:10:31.531434002 +0000 UTC m=+357.691658572" Jun 03 01:10:42.517574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:42.517542 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-h8k4d" Jun 03 01:10:44.548280 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.548245 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh"] Jun 03 01:10:44.560451 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.560421 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.562856 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.562824 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x2mlx\"" Jun 03 01:10:44.563120 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.563094 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 01:10:44.563234 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.563097 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 01:10:44.566326 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.566303 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh"] Jun 03 01:10:44.587562 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.587543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3484ca-0571-49df-b734-a4151cfa8e73-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.587672 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.587582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpztc\" (UniqueName: \"kubernetes.io/projected/8c3484ca-0571-49df-b734-a4151cfa8e73-kube-api-access-gpztc\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.587672 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.587662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c3484ca-0571-49df-b734-a4151cfa8e73-tmp\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.688337 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.688312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpztc\" (UniqueName: \"kubernetes.io/projected/8c3484ca-0571-49df-b734-a4151cfa8e73-kube-api-access-gpztc\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.688472 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.688357 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c3484ca-0571-49df-b734-a4151cfa8e73-tmp\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.688472 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.688390 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3484ca-0571-49df-b734-a4151cfa8e73-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.688587 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:10:44.688477 2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 03 01:10:44.688587 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:10:44.688534 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3484ca-0571-49df-b734-a4151cfa8e73-tls-certs podName:8c3484ca-0571-49df-b734-a4151cfa8e73 nodeName:}" failed. No retries permitted until 2026-06-03 01:10:45.188519829 +0000 UTC m=+371.348744376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8c3484ca-0571-49df-b734-a4151cfa8e73-tls-certs") pod "kube-auth-proxy-db4bc68bb-7gbrh" (UID: "8c3484ca-0571-49df-b734-a4151cfa8e73") : secret "kube-auth-proxy-tls" not found Jun 03 01:10:44.690639 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.690621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c3484ca-0571-49df-b734-a4151cfa8e73-tmp\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:44.706461 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:44.706439 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpztc\" (UniqueName: \"kubernetes.io/projected/8c3484ca-0571-49df-b734-a4151cfa8e73-kube-api-access-gpztc\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:45.186110 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.186075 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb"] Jun 03 01:10:45.189457 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.189431 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.192647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.192627 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:10:45.192647 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.192637 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 01:10:45.192806 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.192793 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 01:10:45.192866 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.192809 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 01:10:45.192917 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.192873 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 01:10:45.192962 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.192929 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3484ca-0571-49df-b734-a4151cfa8e73-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:45.193226 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.193213 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kxfl9\"" Jun 03 01:10:45.195375 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.195356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3484ca-0571-49df-b734-a4151cfa8e73-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-7gbrh\" (UID: \"8c3484ca-0571-49df-b734-a4151cfa8e73\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:45.199664 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.199644 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb"] Jun 03 01:10:45.293515 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.293489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-cert\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.293737 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.293532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-manager-config\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.293737 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.293553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-metrics-cert\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.293737 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.293668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmlpd\" (UniqueName: \"kubernetes.io/projected/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-kube-api-access-qmlpd\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.394938 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.394903 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmlpd\" (UniqueName: \"kubernetes.io/projected/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-kube-api-access-qmlpd\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.395112 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.395041 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-cert\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.395112 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.395099 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-manager-config\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.395245 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.395224 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-metrics-cert\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.395834 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.395810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-manager-config\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.397611 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.397575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-cert\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.397692 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.397674 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-metrics-cert\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.402225 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.402202 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmlpd\" (UniqueName: \"kubernetes.io/projected/6b2ad00f-fb76-4d59-8464-6384fa22f8ad-kube-api-access-qmlpd\") pod \"lws-controller-manager-65c8c8d4bb-rq9hb\" (UID: \"6b2ad00f-fb76-4d59-8464-6384fa22f8ad\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.471945 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.471862 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" Jun 03 01:10:45.510897 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.510854 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:45.607683 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.607638 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh"] Jun 03 01:10:45.612612 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:10:45.612572 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3484ca_0571_49df_b734_a4151cfa8e73.slice/crio-bcf86143ddd6f59d976b0047ed017a53a36b74b3c8b0bcc30a3f7a5a375e060e WatchSource:0}: Error finding container bcf86143ddd6f59d976b0047ed017a53a36b74b3c8b0bcc30a3f7a5a375e060e: Status 404 returned error can't find the container with id bcf86143ddd6f59d976b0047ed017a53a36b74b3c8b0bcc30a3f7a5a375e060e Jun 03 01:10:45.657772 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:45.657749 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb"] Jun 03 01:10:45.660616 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:10:45.660574 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2ad00f_fb76_4d59_8464_6384fa22f8ad.slice/crio-06a8450ed6001997543f26051547ddc36234673fdbd3d12cb34f8a08f7e61317 WatchSource:0}: Error finding container 06a8450ed6001997543f26051547ddc36234673fdbd3d12cb34f8a08f7e61317: Status 404 returned error can't find the container with id 06a8450ed6001997543f26051547ddc36234673fdbd3d12cb34f8a08f7e61317 Jun 03 01:10:46.564033 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:46.563989 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" event={"ID":"8c3484ca-0571-49df-b734-a4151cfa8e73","Type":"ContainerStarted","Data":"bcf86143ddd6f59d976b0047ed017a53a36b74b3c8b0bcc30a3f7a5a375e060e"} Jun 03 01:10:46.565957 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:46.565917 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" event={"ID":"6b2ad00f-fb76-4d59-8464-6384fa22f8ad","Type":"ContainerStarted","Data":"06a8450ed6001997543f26051547ddc36234673fdbd3d12cb34f8a08f7e61317"} Jun 03 01:10:49.580926 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:49.580884 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" event={"ID":"8c3484ca-0571-49df-b734-a4151cfa8e73","Type":"ContainerStarted","Data":"b109ff0a95e2ef253efe835b6893325d586fec25aef51145292bbcb4da30dd2a"} Jun 03 01:10:49.582283 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:49.582256 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" event={"ID":"6b2ad00f-fb76-4d59-8464-6384fa22f8ad","Type":"ContainerStarted","Data":"bdbffa2019fe9f3eb7bf73bf3bbb0759b3c3b5c2a3006bcb5aa308b84fe32564"} Jun 03 01:10:49.582390 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:49.582373 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:10:49.596352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:49.596306 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-7gbrh" podStartSLOduration=1.7604183359999999 podStartE2EDuration="5.596292703s" podCreationTimestamp="2026-06-03 01:10:44 +0000 UTC" firstStartedPulling="2026-06-03 01:10:45.614616624 +0000 UTC m=+371.774841183" lastFinishedPulling="2026-06-03 01:10:49.450491003 +0000 UTC m=+375.610715550" observedRunningTime="2026-06-03 01:10:49.594751252 +0000 UTC m=+375.754975821" watchObservedRunningTime="2026-06-03 01:10:49.596292703 +0000 UTC m=+375.756517324" Jun 03 01:10:49.609313 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:10:49.609256 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" podStartSLOduration=0.827032285 podStartE2EDuration="4.609244813s" podCreationTimestamp="2026-06-03 01:10:45 +0000 UTC" firstStartedPulling="2026-06-03 01:10:45.662498864 +0000 UTC m=+371.822723416" lastFinishedPulling="2026-06-03 01:10:49.444711384 +0000 UTC m=+375.604935944" observedRunningTime="2026-06-03 01:10:49.608807694 +0000 UTC m=+375.769032262" watchObservedRunningTime="2026-06-03 01:10:49.609244813 +0000 UTC m=+375.769469383" Jun 03 01:11:00.588313 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:11:00.588277 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-rq9hb" Jun 03 01:12:28.310011 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.309979 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc"] Jun 03 01:12:28.313364 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.313348 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.315519 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.315498 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 01:12:28.316086 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.316068 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 01:12:28.316169 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.316081 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 01:12:28.316169 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.316095 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xl8l2\"" Jun 03 01:12:28.316169 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.316068 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 01:12:28.322706 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.322679 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc"] Jun 03 01:12:28.371751 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.371718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0f933702-8cc1-4dbc-a9f4-2ed085d67237-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.371928 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.371836 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f933702-8cc1-4dbc-a9f4-2ed085d67237-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.371928 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.371867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khcvk\" (UniqueName: \"kubernetes.io/projected/0f933702-8cc1-4dbc-a9f4-2ed085d67237-kube-api-access-khcvk\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.473187 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.473141 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f933702-8cc1-4dbc-a9f4-2ed085d67237-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.473418 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.473393 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khcvk\" (UniqueName: \"kubernetes.io/projected/0f933702-8cc1-4dbc-a9f4-2ed085d67237-kube-api-access-khcvk\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.473504 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.473471 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0f933702-8cc1-4dbc-a9f4-2ed085d67237-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.474080 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.474056 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0f933702-8cc1-4dbc-a9f4-2ed085d67237-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.475536 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.475514 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f933702-8cc1-4dbc-a9f4-2ed085d67237-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.480265 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.480247 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khcvk\" (UniqueName: \"kubernetes.io/projected/0f933702-8cc1-4dbc-a9f4-2ed085d67237-kube-api-access-khcvk\") pod \"kuadrant-console-plugin-6cb54b5c86-9zcrc\" (UID: \"0f933702-8cc1-4dbc-a9f4-2ed085d67237\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.640557 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.640475 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" Jun 03 01:12:28.764239 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.764210 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc"] Jun 03 01:12:28.766261 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:12:28.766236 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f933702_8cc1_4dbc_a9f4_2ed085d67237.slice/crio-f3bd2b6c17cc6042bdad6d5a8f2c3eb16ab74f1659af0bf3d1f0e4af562c3768 WatchSource:0}: Error finding container f3bd2b6c17cc6042bdad6d5a8f2c3eb16ab74f1659af0bf3d1f0e4af562c3768: Status 404 returned error can't find the container with id f3bd2b6c17cc6042bdad6d5a8f2c3eb16ab74f1659af0bf3d1f0e4af562c3768 Jun 03 01:12:28.898788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:28.898698 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" event={"ID":"0f933702-8cc1-4dbc-a9f4-2ed085d67237","Type":"ContainerStarted","Data":"f3bd2b6c17cc6042bdad6d5a8f2c3eb16ab74f1659af0bf3d1f0e4af562c3768"} Jun 03 01:12:38.196038 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.196000 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49"] Jun 03 01:12:38.199556 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.199531 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" Jun 03 01:12:38.202344 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.202318 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kcvqf\"" Jun 03 01:12:38.214727 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.214705 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49"] Jun 03 01:12:38.225165 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.225136 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49"] Jun 03 01:12:38.225446 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:12:38.225421 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-nzqr4], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-nzqr4]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" podUID="a441a566-950e-478e-9eea-1f0ff1640899" Jun 03 01:12:38.236139 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.236111 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49"] Jun 03 01:12:38.420205 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.420172 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a441a566-950e-478e-9eea-1f0ff1640899" path="/var/lib/kubelet/pods/a441a566-950e-478e-9eea-1f0ff1640899/volumes" Jun 03 01:12:38.938837 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.938800 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" Jun 03 01:12:38.943851 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.943816 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" Jun 03 01:12:38.945729 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:38.945700 2566 status_manager.go:895] "Failed to get status for pod" podUID="a441a566-950e-478e-9eea-1f0ff1640899" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-cfn49\" is forbidden: User \"system:node:ip-10-0-142-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-91.ec2.internal' and this object" Jun 03 01:12:39.942379 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:39.942342 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" Jun 03 01:12:39.944269 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:39.944232 2566 status_manager.go:895] "Failed to get status for pod" podUID="a441a566-950e-478e-9eea-1f0ff1640899" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-cfn49\" is forbidden: User \"system:node:ip-10-0-142-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-91.ec2.internal' and this object" Jun 03 01:12:39.950853 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:39.950824 2566 status_manager.go:895] "Failed to get status for pod" podUID="a441a566-950e-478e-9eea-1f0ff1640899" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cfn49" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-cfn49\" is forbidden: User \"system:node:ip-10-0-142-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-91.ec2.internal' and this object" Jun 03 01:12:52.990366 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:52.990317 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" event={"ID":"0f933702-8cc1-4dbc-a9f4-2ed085d67237","Type":"ContainerStarted","Data":"b9aadcb6237e812ac01d3cb2806f3c01cdd0aa4961e602e277093adb22a16937"} Jun 03 01:12:53.005011 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:12:53.004965 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9zcrc" podStartSLOduration=0.960120669 podStartE2EDuration="25.004951096s" podCreationTimestamp="2026-06-03 01:12:28 +0000 UTC" firstStartedPulling="2026-06-03 01:12:28.767528925 +0000 UTC m=+474.927753471" lastFinishedPulling="2026-06-03 01:12:52.812359349 +0000 UTC m=+498.972583898" observedRunningTime="2026-06-03 01:12:53.003890893 +0000 UTC m=+499.164115461" watchObservedRunningTime="2026-06-03 01:12:53.004951096 +0000 UTC m=+499.165175665" Jun 03 01:13:10.963687 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:10.963653 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:10.971694 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:10.971663 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:10.973451 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:10.973428 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:10.973554 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:10.973459 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 01:13:11.041931 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.041904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d9703d8-ac5b-4fea-b444-95336d9701d2-config-file\") pod \"limitador-limitador-7d549b5b-qg4q8\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.042055 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.041985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnnl5\" (UniqueName: \"kubernetes.io/projected/8d9703d8-ac5b-4fea-b444-95336d9701d2-kube-api-access-tnnl5\") pod \"limitador-limitador-7d549b5b-qg4q8\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.066121 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.066093 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:11.142968 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.142942 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnnl5\" (UniqueName: \"kubernetes.io/projected/8d9703d8-ac5b-4fea-b444-95336d9701d2-kube-api-access-tnnl5\") pod \"limitador-limitador-7d549b5b-qg4q8\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.143097 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.142982 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d9703d8-ac5b-4fea-b444-95336d9701d2-config-file\") pod \"limitador-limitador-7d549b5b-qg4q8\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.143595 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.143568 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d9703d8-ac5b-4fea-b444-95336d9701d2-config-file\") pod \"limitador-limitador-7d549b5b-qg4q8\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.150251 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.150227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnnl5\" (UniqueName: \"kubernetes.io/projected/8d9703d8-ac5b-4fea-b444-95336d9701d2-kube-api-access-tnnl5\") pod \"limitador-limitador-7d549b5b-qg4q8\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.282231 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.282207 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:11.407874 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.407848 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:11.410457 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:13:11.410433 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9703d8_ac5b_4fea_b444_95336d9701d2.slice/crio-09d7c3627534738f591f25c5cb7069cf3cbe07d531145271721acfb14c8fc3c3 WatchSource:0}: Error finding container 09d7c3627534738f591f25c5cb7069cf3cbe07d531145271721acfb14c8fc3c3: Status 404 returned error can't find the container with id 09d7c3627534738f591f25c5cb7069cf3cbe07d531145271721acfb14c8fc3c3 Jun 03 01:13:11.968690 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.968655 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-fnqcn"] Jun 03 01:13:11.973205 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.973184 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:13:11.974892 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.974875 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hr228\"" Jun 03 01:13:11.978086 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:11.978056 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-fnqcn"] Jun 03 01:13:12.048304 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:12.048279 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" event={"ID":"8d9703d8-ac5b-4fea-b444-95336d9701d2","Type":"ContainerStarted","Data":"09d7c3627534738f591f25c5cb7069cf3cbe07d531145271721acfb14c8fc3c3"} Jun 03 01:13:12.049677 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:12.049657 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zkln\" (UniqueName: \"kubernetes.io/projected/5acfb056-51e2-4c65-bef3-1ef2da00e290-kube-api-access-7zkln\") pod \"authorino-7498df8756-fnqcn\" (UID: \"5acfb056-51e2-4c65-bef3-1ef2da00e290\") " pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:13:12.150719 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:12.150624 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zkln\" (UniqueName: \"kubernetes.io/projected/5acfb056-51e2-4c65-bef3-1ef2da00e290-kube-api-access-7zkln\") pod \"authorino-7498df8756-fnqcn\" (UID: \"5acfb056-51e2-4c65-bef3-1ef2da00e290\") " pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:13:12.158839 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:12.158791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zkln\" (UniqueName: \"kubernetes.io/projected/5acfb056-51e2-4c65-bef3-1ef2da00e290-kube-api-access-7zkln\") pod \"authorino-7498df8756-fnqcn\" (UID: \"5acfb056-51e2-4c65-bef3-1ef2da00e290\") " pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:13:12.284308 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:12.284282 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:13:12.459945 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:12.459916 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-fnqcn"] Jun 03 01:13:12.462875 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:13:12.462847 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5acfb056_51e2_4c65_bef3_1ef2da00e290.slice/crio-2ba693fde5f19213226330ab6c3f4b1f9978f795e930b981e7612d07500c269e WatchSource:0}: Error finding container 2ba693fde5f19213226330ab6c3f4b1f9978f795e930b981e7612d07500c269e: Status 404 returned error can't find the container with id 2ba693fde5f19213226330ab6c3f4b1f9978f795e930b981e7612d07500c269e Jun 03 01:13:13.053887 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:13.053848 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-fnqcn" event={"ID":"5acfb056-51e2-4c65-bef3-1ef2da00e290","Type":"ContainerStarted","Data":"2ba693fde5f19213226330ab6c3f4b1f9978f795e930b981e7612d07500c269e"} Jun 03 01:13:15.064785 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:15.064743 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" event={"ID":"8d9703d8-ac5b-4fea-b444-95336d9701d2","Type":"ContainerStarted","Data":"c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80"} Jun 03 01:13:15.065252 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:15.064859 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:15.080403 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:15.080355 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" podStartSLOduration=2.228251921 podStartE2EDuration="5.080337925s" podCreationTimestamp="2026-06-03 01:13:10 +0000 UTC" firstStartedPulling="2026-06-03 01:13:11.41231081 +0000 UTC m=+517.572535358" lastFinishedPulling="2026-06-03 01:13:14.264396813 +0000 UTC m=+520.424621362" observedRunningTime="2026-06-03 01:13:15.078995635 +0000 UTC m=+521.239220208" watchObservedRunningTime="2026-06-03 01:13:15.080337925 +0000 UTC m=+521.240562497" Jun 03 01:13:17.072945 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:17.072903 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-fnqcn" event={"ID":"5acfb056-51e2-4c65-bef3-1ef2da00e290","Type":"ContainerStarted","Data":"8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5"} Jun 03 01:13:17.086648 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:17.086575 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-fnqcn" podStartSLOduration=1.897552643 podStartE2EDuration="6.086560797s" podCreationTimestamp="2026-06-03 01:13:11 +0000 UTC" firstStartedPulling="2026-06-03 01:13:12.464746828 +0000 UTC m=+518.624971375" lastFinishedPulling="2026-06-03 01:13:16.653754982 +0000 UTC m=+522.813979529" observedRunningTime="2026-06-03 01:13:17.085938858 +0000 UTC m=+523.246163427" watchObservedRunningTime="2026-06-03 01:13:17.086560797 +0000 UTC m=+523.246785366" Jun 03 01:13:25.870088 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:25.869997 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:25.870678 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:25.870317 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" podUID="8d9703d8-ac5b-4fea-b444-95336d9701d2" containerName="limitador" containerID="cri-o://c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80" gracePeriod=30 Jun 03 01:13:25.871028 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:25.870905 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:26.415952 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.415921 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:26.577019 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.576985 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d9703d8-ac5b-4fea-b444-95336d9701d2-config-file\") pod \"8d9703d8-ac5b-4fea-b444-95336d9701d2\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " Jun 03 01:13:26.577183 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.577025 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnnl5\" (UniqueName: \"kubernetes.io/projected/8d9703d8-ac5b-4fea-b444-95336d9701d2-kube-api-access-tnnl5\") pod \"8d9703d8-ac5b-4fea-b444-95336d9701d2\" (UID: \"8d9703d8-ac5b-4fea-b444-95336d9701d2\") " Jun 03 01:13:26.577421 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.577341 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d9703d8-ac5b-4fea-b444-95336d9701d2-config-file" (OuterVolumeSpecName: "config-file") pod "8d9703d8-ac5b-4fea-b444-95336d9701d2" (UID: "8d9703d8-ac5b-4fea-b444-95336d9701d2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:13:26.579352 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.579329 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d9703d8-ac5b-4fea-b444-95336d9701d2-kube-api-access-tnnl5" (OuterVolumeSpecName: "kube-api-access-tnnl5") pod "8d9703d8-ac5b-4fea-b444-95336d9701d2" (UID: "8d9703d8-ac5b-4fea-b444-95336d9701d2"). InnerVolumeSpecName "kube-api-access-tnnl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:13:26.678511 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.678474 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d9703d8-ac5b-4fea-b444-95336d9701d2-config-file\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:13:26.678511 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:26.678505 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnnl5\" (UniqueName: \"kubernetes.io/projected/8d9703d8-ac5b-4fea-b444-95336d9701d2-kube-api-access-tnnl5\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:13:27.109313 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.109282 2566 generic.go:358] "Generic (PLEG): container finished" podID="8d9703d8-ac5b-4fea-b444-95336d9701d2" containerID="c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80" exitCode=0 Jun 03 01:13:27.109754 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.109339 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" Jun 03 01:13:27.109754 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.109364 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" event={"ID":"8d9703d8-ac5b-4fea-b444-95336d9701d2","Type":"ContainerDied","Data":"c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80"} Jun 03 01:13:27.109754 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.109394 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qg4q8" event={"ID":"8d9703d8-ac5b-4fea-b444-95336d9701d2","Type":"ContainerDied","Data":"09d7c3627534738f591f25c5cb7069cf3cbe07d531145271721acfb14c8fc3c3"} Jun 03 01:13:27.109754 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.109409 2566 scope.go:117] "RemoveContainer" containerID="c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80" Jun 03 01:13:27.122886 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.122864 2566 scope.go:117] "RemoveContainer" containerID="c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80" Jun 03 01:13:27.123182 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:13:27.123159 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80\": container with ID starting with c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80 not found: ID does not exist" containerID="c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80" Jun 03 01:13:27.123239 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.123192 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80"} err="failed to get container status \"c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80\": rpc error: code = NotFound desc = could not find container \"c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80\": container with ID starting with c95f4f6ffc169f80d025490efb5d9dbd1f8aa07f3fac3950b73452f50e9ccd80 not found: ID does not exist" Jun 03 01:13:27.136024 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.135995 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:27.142166 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:27.142141 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qg4q8"] Jun 03 01:13:28.419528 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:28.419493 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d9703d8-ac5b-4fea-b444-95336d9701d2" path="/var/lib/kubelet/pods/8d9703d8-ac5b-4fea-b444-95336d9701d2/volumes" Jun 03 01:13:45.469645 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.469586 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-c5blg"] Jun 03 01:13:45.470112 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.469923 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d9703d8-ac5b-4fea-b444-95336d9701d2" containerName="limitador" Jun 03 01:13:45.470112 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.469933 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d9703d8-ac5b-4fea-b444-95336d9701d2" containerName="limitador" Jun 03 01:13:45.470112 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.470005 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d9703d8-ac5b-4fea-b444-95336d9701d2" containerName="limitador" Jun 03 01:13:45.475848 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.475817 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" Jun 03 01:13:45.477833 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.477812 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 01:13:45.478118 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.478101 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-b6sxl\"" Jun 03 01:13:45.478201 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.478128 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 01:13:45.482251 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.482223 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-c5blg"] Jun 03 01:13:45.527860 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.527826 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzkbg\" (UniqueName: \"kubernetes.io/projected/3004b2f8-f64c-4805-9216-d9dd9f20eadd-kube-api-access-lzkbg\") pod \"keycloak-operator-7864d68cbd-c5blg\" (UID: \"3004b2f8-f64c-4805-9216-d9dd9f20eadd\") " pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" Jun 03 01:13:45.629118 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.629089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzkbg\" (UniqueName: \"kubernetes.io/projected/3004b2f8-f64c-4805-9216-d9dd9f20eadd-kube-api-access-lzkbg\") pod \"keycloak-operator-7864d68cbd-c5blg\" (UID: \"3004b2f8-f64c-4805-9216-d9dd9f20eadd\") " pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" Jun 03 01:13:45.636619 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.636569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzkbg\" (UniqueName: \"kubernetes.io/projected/3004b2f8-f64c-4805-9216-d9dd9f20eadd-kube-api-access-lzkbg\") pod \"keycloak-operator-7864d68cbd-c5blg\" (UID: \"3004b2f8-f64c-4805-9216-d9dd9f20eadd\") " pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" Jun 03 01:13:45.786810 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.786781 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" Jun 03 01:13:45.908753 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:45.908727 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-c5blg"] Jun 03 01:13:45.911404 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:13:45.911372 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3004b2f8_f64c_4805_9216_d9dd9f20eadd.slice/crio-5260c43c2d70605a43dbdb0cfb2f749954b6da9eacdc09d2603a673f660372d8 WatchSource:0}: Error finding container 5260c43c2d70605a43dbdb0cfb2f749954b6da9eacdc09d2603a673f660372d8: Status 404 returned error can't find the container with id 5260c43c2d70605a43dbdb0cfb2f749954b6da9eacdc09d2603a673f660372d8 Jun 03 01:13:46.172007 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:46.171925 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" event={"ID":"3004b2f8-f64c-4805-9216-d9dd9f20eadd","Type":"ContainerStarted","Data":"5260c43c2d70605a43dbdb0cfb2f749954b6da9eacdc09d2603a673f660372d8"} Jun 03 01:13:53.199163 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:53.199117 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" event={"ID":"3004b2f8-f64c-4805-9216-d9dd9f20eadd","Type":"ContainerStarted","Data":"646d798245ce79b8ea17e664ea9ae925ddbd93f673cc6f17fb3ad5db3c524e4c"} Jun 03 01:13:53.221318 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:13:53.221174 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-c5blg" podStartSLOduration=1.8605228230000002 podStartE2EDuration="8.22115722s" podCreationTimestamp="2026-06-03 01:13:45 +0000 UTC" firstStartedPulling="2026-06-03 01:13:45.912777942 +0000 UTC m=+552.073002489" lastFinishedPulling="2026-06-03 01:13:52.273412339 +0000 UTC m=+558.433636886" observedRunningTime="2026-06-03 01:13:53.220732714 +0000 UTC m=+559.380957284" watchObservedRunningTime="2026-06-03 01:13:53.22115722 +0000 UTC m=+559.381381790" Jun 03 01:14:32.590930 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.590897 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zfldt"] Jun 03 01:14:32.597383 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.597366 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:32.600625 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.600574 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zfldt"] Jun 03 01:14:32.657345 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.657311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjpg\" (UniqueName: \"kubernetes.io/projected/7ab0f901-b88c-44d0-a1f3-fa34f6533830-kube-api-access-bbjpg\") pod \"authorino-8b475cf9f-zfldt\" (UID: \"7ab0f901-b88c-44d0-a1f3-fa34f6533830\") " pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:32.758191 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.758153 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjpg\" (UniqueName: \"kubernetes.io/projected/7ab0f901-b88c-44d0-a1f3-fa34f6533830-kube-api-access-bbjpg\") pod \"authorino-8b475cf9f-zfldt\" (UID: \"7ab0f901-b88c-44d0-a1f3-fa34f6533830\") " pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:32.770452 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.770428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjpg\" (UniqueName: \"kubernetes.io/projected/7ab0f901-b88c-44d0-a1f3-fa34f6533830-kube-api-access-bbjpg\") pod \"authorino-8b475cf9f-zfldt\" (UID: \"7ab0f901-b88c-44d0-a1f3-fa34f6533830\") " pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:32.782757 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.782731 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zfldt"] Jun 03 01:14:32.782974 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.782963 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:32.810406 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.810375 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-5wlxm"] Jun 03 01:14:32.814231 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.814214 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:32.815948 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.815929 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 01:14:32.823377 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.823348 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-5wlxm"] Jun 03 01:14:32.851883 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.851804 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-5wlxm"] Jun 03 01:14:32.852092 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:14:32.852073 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7pxnn tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-5wlxm" podUID="90178ba4-6c96-4622-89ad-daac955c6e2a" Jun 03 01:14:32.859049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.859026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pxnn\" (UniqueName: \"kubernetes.io/projected/90178ba4-6c96-4622-89ad-daac955c6e2a-kube-api-access-7pxnn\") pod \"authorino-56fdd757f5-5wlxm\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:32.859115 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.859069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90178ba4-6c96-4622-89ad-daac955c6e2a-tls-cert\") pod \"authorino-56fdd757f5-5wlxm\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:32.883220 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.883190 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c57d74ff6-89j66"] Jun 03 01:14:32.886246 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.886225 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:32.893980 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.893895 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c57d74ff6-89j66"] Jun 03 01:14:32.917163 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.917133 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zfldt"] Jun 03 01:14:32.920162 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:14:32.920132 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ab0f901_b88c_44d0_a1f3_fa34f6533830.slice/crio-4ed099015228839c42cfd10700d48c657e54136477c0a803305af0b4b186eeeb WatchSource:0}: Error finding container 4ed099015228839c42cfd10700d48c657e54136477c0a803305af0b4b186eeeb: Status 404 returned error can't find the container with id 4ed099015228839c42cfd10700d48c657e54136477c0a803305af0b4b186eeeb Jun 03 01:14:32.960108 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.960081 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pxnn\" (UniqueName: \"kubernetes.io/projected/90178ba4-6c96-4622-89ad-daac955c6e2a-kube-api-access-7pxnn\") pod \"authorino-56fdd757f5-5wlxm\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:32.960255 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.960125 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90178ba4-6c96-4622-89ad-daac955c6e2a-tls-cert\") pod \"authorino-56fdd757f5-5wlxm\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:32.960255 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.960175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2nw\" (UniqueName: \"kubernetes.io/projected/4e555d99-a3c6-41e3-875b-88fed4920df3-kube-api-access-kd2nw\") pod \"authorino-5c57d74ff6-89j66\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:32.960255 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.960211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e555d99-a3c6-41e3-875b-88fed4920df3-tls-cert\") pod \"authorino-5c57d74ff6-89j66\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:32.962442 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.962425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90178ba4-6c96-4622-89ad-daac955c6e2a-tls-cert\") pod \"authorino-56fdd757f5-5wlxm\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:32.966714 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:32.966692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pxnn\" (UniqueName: \"kubernetes.io/projected/90178ba4-6c96-4622-89ad-daac955c6e2a-kube-api-access-7pxnn\") pod \"authorino-56fdd757f5-5wlxm\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:33.060986 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.060952 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2nw\" (UniqueName: \"kubernetes.io/projected/4e555d99-a3c6-41e3-875b-88fed4920df3-kube-api-access-kd2nw\") pod \"authorino-5c57d74ff6-89j66\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:33.061180 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.061015 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e555d99-a3c6-41e3-875b-88fed4920df3-tls-cert\") pod \"authorino-5c57d74ff6-89j66\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:33.063396 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.063377 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e555d99-a3c6-41e3-875b-88fed4920df3-tls-cert\") pod \"authorino-5c57d74ff6-89j66\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:33.071444 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.071423 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2nw\" (UniqueName: \"kubernetes.io/projected/4e555d99-a3c6-41e3-875b-88fed4920df3-kube-api-access-kd2nw\") pod \"authorino-5c57d74ff6-89j66\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:33.197272 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.197190 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:14:33.324150 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.324091 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c57d74ff6-89j66"] Jun 03 01:14:33.326098 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:14:33.326065 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e555d99_a3c6_41e3_875b_88fed4920df3.slice/crio-419be5a78c1a27614480b4e7267d230cb1860be0cdf309e00bb9e4d056fec4dc WatchSource:0}: Error finding container 419be5a78c1a27614480b4e7267d230cb1860be0cdf309e00bb9e4d056fec4dc: Status 404 returned error can't find the container with id 419be5a78c1a27614480b4e7267d230cb1860be0cdf309e00bb9e4d056fec4dc Jun 03 01:14:33.332850 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.332826 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c57d74ff6-89j66" event={"ID":"4e555d99-a3c6-41e3-875b-88fed4920df3","Type":"ContainerStarted","Data":"419be5a78c1a27614480b4e7267d230cb1860be0cdf309e00bb9e4d056fec4dc"} Jun 03 01:14:33.333821 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.333797 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zfldt" event={"ID":"7ab0f901-b88c-44d0-a1f3-fa34f6533830","Type":"ContainerStarted","Data":"4ed099015228839c42cfd10700d48c657e54136477c0a803305af0b4b186eeeb"} Jun 03 01:14:33.333907 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.333820 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:33.342427 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.342409 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:33.464522 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.464426 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pxnn\" (UniqueName: \"kubernetes.io/projected/90178ba4-6c96-4622-89ad-daac955c6e2a-kube-api-access-7pxnn\") pod \"90178ba4-6c96-4622-89ad-daac955c6e2a\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " Jun 03 01:14:33.464522 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.464480 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90178ba4-6c96-4622-89ad-daac955c6e2a-tls-cert\") pod \"90178ba4-6c96-4622-89ad-daac955c6e2a\" (UID: \"90178ba4-6c96-4622-89ad-daac955c6e2a\") " Jun 03 01:14:33.466628 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.466593 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90178ba4-6c96-4622-89ad-daac955c6e2a-kube-api-access-7pxnn" (OuterVolumeSpecName: "kube-api-access-7pxnn") pod "90178ba4-6c96-4622-89ad-daac955c6e2a" (UID: "90178ba4-6c96-4622-89ad-daac955c6e2a"). InnerVolumeSpecName "kube-api-access-7pxnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:14:33.466716 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.466646 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90178ba4-6c96-4622-89ad-daac955c6e2a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "90178ba4-6c96-4622-89ad-daac955c6e2a" (UID: "90178ba4-6c96-4622-89ad-daac955c6e2a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:14:33.565574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.565548 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pxnn\" (UniqueName: \"kubernetes.io/projected/90178ba4-6c96-4622-89ad-daac955c6e2a-kube-api-access-7pxnn\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:14:33.565574 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:33.565571 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90178ba4-6c96-4622-89ad-daac955c6e2a-tls-cert\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:14:34.338723 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.338677 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zfldt" event={"ID":"7ab0f901-b88c-44d0-a1f3-fa34f6533830","Type":"ContainerStarted","Data":"32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41"} Jun 03 01:14:34.338723 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.338697 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-zfldt" podUID="7ab0f901-b88c-44d0-a1f3-fa34f6533830" containerName="authorino" containerID="cri-o://32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41" gracePeriod=30 Jun 03 01:14:34.340533 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.340510 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-5wlxm" Jun 03 01:14:34.340533 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.340516 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c57d74ff6-89j66" event={"ID":"4e555d99-a3c6-41e3-875b-88fed4920df3","Type":"ContainerStarted","Data":"c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679"} Jun 03 01:14:34.354086 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.351966 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-zfldt" podStartSLOduration=1.963292303 podStartE2EDuration="2.351951889s" podCreationTimestamp="2026-06-03 01:14:32 +0000 UTC" firstStartedPulling="2026-06-03 01:14:32.921284709 +0000 UTC m=+599.081509256" lastFinishedPulling="2026-06-03 01:14:33.30994429 +0000 UTC m=+599.470168842" observedRunningTime="2026-06-03 01:14:34.351413286 +0000 UTC m=+600.511637856" watchObservedRunningTime="2026-06-03 01:14:34.351951889 +0000 UTC m=+600.512176459" Jun 03 01:14:34.372335 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.372288 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5c57d74ff6-89j66" podStartSLOduration=1.888394127 podStartE2EDuration="2.372272061s" podCreationTimestamp="2026-06-03 01:14:32 +0000 UTC" firstStartedPulling="2026-06-03 01:14:33.327544901 +0000 UTC m=+599.487769469" lastFinishedPulling="2026-06-03 01:14:33.81142284 +0000 UTC m=+599.971647403" observedRunningTime="2026-06-03 01:14:34.371931275 +0000 UTC m=+600.532155845" watchObservedRunningTime="2026-06-03 01:14:34.372272061 +0000 UTC m=+600.532496632" Jun 03 01:14:34.397545 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.397515 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-fnqcn"] Jun 03 01:14:34.397730 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.397710 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-fnqcn" podUID="5acfb056-51e2-4c65-bef3-1ef2da00e290" containerName="authorino" containerID="cri-o://8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5" gracePeriod=30 Jun 03 01:14:34.423867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.423842 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-5wlxm"] Jun 03 01:14:34.427527 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.427505 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-5wlxm"] Jun 03 01:14:34.637195 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.637170 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:34.667993 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.667972 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:14:34.675384 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.675360 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbjpg\" (UniqueName: \"kubernetes.io/projected/7ab0f901-b88c-44d0-a1f3-fa34f6533830-kube-api-access-bbjpg\") pod \"7ab0f901-b88c-44d0-a1f3-fa34f6533830\" (UID: \"7ab0f901-b88c-44d0-a1f3-fa34f6533830\") " Jun 03 01:14:34.677275 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.677251 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab0f901-b88c-44d0-a1f3-fa34f6533830-kube-api-access-bbjpg" (OuterVolumeSpecName: "kube-api-access-bbjpg") pod "7ab0f901-b88c-44d0-a1f3-fa34f6533830" (UID: "7ab0f901-b88c-44d0-a1f3-fa34f6533830"). InnerVolumeSpecName "kube-api-access-bbjpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:14:34.776785 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.776754 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zkln\" (UniqueName: \"kubernetes.io/projected/5acfb056-51e2-4c65-bef3-1ef2da00e290-kube-api-access-7zkln\") pod \"5acfb056-51e2-4c65-bef3-1ef2da00e290\" (UID: \"5acfb056-51e2-4c65-bef3-1ef2da00e290\") " Jun 03 01:14:34.777033 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.777015 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbjpg\" (UniqueName: \"kubernetes.io/projected/7ab0f901-b88c-44d0-a1f3-fa34f6533830-kube-api-access-bbjpg\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:14:34.778995 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.778971 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5acfb056-51e2-4c65-bef3-1ef2da00e290-kube-api-access-7zkln" (OuterVolumeSpecName: "kube-api-access-7zkln") pod "5acfb056-51e2-4c65-bef3-1ef2da00e290" (UID: "5acfb056-51e2-4c65-bef3-1ef2da00e290"). InnerVolumeSpecName "kube-api-access-7zkln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:14:34.877911 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:34.877859 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zkln\" (UniqueName: \"kubernetes.io/projected/5acfb056-51e2-4c65-bef3-1ef2da00e290-kube-api-access-7zkln\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:14:35.345705 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.345675 2566 generic.go:358] "Generic (PLEG): container finished" podID="5acfb056-51e2-4c65-bef3-1ef2da00e290" containerID="8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5" exitCode=0 Jun 03 01:14:35.346143 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.345725 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-fnqcn" Jun 03 01:14:35.346143 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.345766 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-fnqcn" event={"ID":"5acfb056-51e2-4c65-bef3-1ef2da00e290","Type":"ContainerDied","Data":"8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5"} Jun 03 01:14:35.346143 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.345802 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-fnqcn" event={"ID":"5acfb056-51e2-4c65-bef3-1ef2da00e290","Type":"ContainerDied","Data":"2ba693fde5f19213226330ab6c3f4b1f9978f795e930b981e7612d07500c269e"} Jun 03 01:14:35.346143 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.345820 2566 scope.go:117] "RemoveContainer" containerID="8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5" Jun 03 01:14:35.347049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.346929 2566 generic.go:358] "Generic (PLEG): container finished" podID="7ab0f901-b88c-44d0-a1f3-fa34f6533830" containerID="32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41" exitCode=0 Jun 03 01:14:35.347049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.346966 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zfldt" Jun 03 01:14:35.347049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.347011 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zfldt" event={"ID":"7ab0f901-b88c-44d0-a1f3-fa34f6533830","Type":"ContainerDied","Data":"32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41"} Jun 03 01:14:35.347049 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.347040 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zfldt" event={"ID":"7ab0f901-b88c-44d0-a1f3-fa34f6533830","Type":"ContainerDied","Data":"4ed099015228839c42cfd10700d48c657e54136477c0a803305af0b4b186eeeb"} Jun 03 01:14:35.353979 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.353954 2566 scope.go:117] "RemoveContainer" containerID="8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5" Jun 03 01:14:35.354245 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:14:35.354223 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5\": container with ID starting with 8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5 not found: ID does not exist" containerID="8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5" Jun 03 01:14:35.354308 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.354251 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5"} err="failed to get container status \"8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5\": rpc error: code = NotFound desc = could not find container \"8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5\": container with ID starting with 8519aa446b90f7cedd2122e1431f09bdbe6177a90f327a3879316889c4b6e6d5 not found: ID does not exist" Jun 03 01:14:35.354308 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.354269 2566 scope.go:117] "RemoveContainer" containerID="32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41" Jun 03 01:14:35.361658 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.361641 2566 scope.go:117] "RemoveContainer" containerID="32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41" Jun 03 01:14:35.362414 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:14:35.362394 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41\": container with ID starting with 32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41 not found: ID does not exist" containerID="32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41" Jun 03 01:14:35.362481 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.362424 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41"} err="failed to get container status \"32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41\": rpc error: code = NotFound desc = could not find container \"32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41\": container with ID starting with 32012bf41797349f3e8b3d9244f796a714edfb52f4fc926f5ecb60bd1481aa41 not found: ID does not exist" Jun 03 01:14:35.367918 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.367895 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zfldt"] Jun 03 01:14:35.371169 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.371149 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zfldt"] Jun 03 01:14:35.379159 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.379133 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-fnqcn"] Jun 03 01:14:35.382766 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:35.382746 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-fnqcn"] Jun 03 01:14:36.418654 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:36.418584 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5acfb056-51e2-4c65-bef3-1ef2da00e290" path="/var/lib/kubelet/pods/5acfb056-51e2-4c65-bef3-1ef2da00e290/volumes" Jun 03 01:14:36.419111 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:36.419069 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab0f901-b88c-44d0-a1f3-fa34f6533830" path="/var/lib/kubelet/pods/7ab0f901-b88c-44d0-a1f3-fa34f6533830/volumes" Jun 03 01:14:36.419439 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:14:36.419421 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90178ba4-6c96-4622-89ad-daac955c6e2a" path="/var/lib/kubelet/pods/90178ba4-6c96-4622-89ad-daac955c6e2a/volumes" Jun 03 01:16:03.443643 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.443591 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fd87df77b-lw76f"] Jun 03 01:16:03.444105 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.443984 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5acfb056-51e2-4c65-bef3-1ef2da00e290" containerName="authorino" Jun 03 01:16:03.444105 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.443996 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5acfb056-51e2-4c65-bef3-1ef2da00e290" containerName="authorino" Jun 03 01:16:03.444105 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.444004 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab0f901-b88c-44d0-a1f3-fa34f6533830" containerName="authorino" Jun 03 01:16:03.444105 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.444010 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab0f901-b88c-44d0-a1f3-fa34f6533830" containerName="authorino" Jun 03 01:16:03.444105 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.444076 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="5acfb056-51e2-4c65-bef3-1ef2da00e290" containerName="authorino" Jun 03 01:16:03.444105 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.444087 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ab0f901-b88c-44d0-a1f3-fa34f6533830" containerName="authorino" Jun 03 01:16:03.447151 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.447133 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.448836 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.448814 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 01:16:03.452872 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.452848 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fd87df77b-lw76f"] Jun 03 01:16:03.542998 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.542961 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-tls-cert\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.543212 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.543041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4dkv\" (UniqueName: \"kubernetes.io/projected/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-kube-api-access-j4dkv\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.543212 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.543118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-oidc-ca\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.643953 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.643915 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4dkv\" (UniqueName: \"kubernetes.io/projected/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-kube-api-access-j4dkv\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.644140 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.643963 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-oidc-ca\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.644140 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.643999 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-tls-cert\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.644738 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.644713 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-oidc-ca\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.646384 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.646366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-tls-cert\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.650167 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.650146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4dkv\" (UniqueName: \"kubernetes.io/projected/a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff-kube-api-access-j4dkv\") pod \"authorino-5fd87df77b-lw76f\" (UID: \"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff\") " pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.756804 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.756772 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fd87df77b-lw76f" Jun 03 01:16:03.874812 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.874776 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fd87df77b-lw76f"] Jun 03 01:16:03.877910 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:16:03.877873 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9cbb701_4911_4bd3_be8b_b27e2dc1a7ff.slice/crio-7f67f2892fa9c6bfe94999e241f780ba08b012e9117c5e908e43f8f31d588e13 WatchSource:0}: Error finding container 7f67f2892fa9c6bfe94999e241f780ba08b012e9117c5e908e43f8f31d588e13: Status 404 returned error can't find the container with id 7f67f2892fa9c6bfe94999e241f780ba08b012e9117c5e908e43f8f31d588e13 Jun 03 01:16:03.879549 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:03.879532 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:16:04.649883 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:04.649798 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fd87df77b-lw76f" event={"ID":"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff","Type":"ContainerStarted","Data":"bea87bfc385337cc047ed27fb950cf46a3c6565c9f6c0b35ade7f377b5f3944d"} Jun 03 01:16:04.649883 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:04.649842 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fd87df77b-lw76f" event={"ID":"a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff","Type":"ContainerStarted","Data":"7f67f2892fa9c6bfe94999e241f780ba08b012e9117c5e908e43f8f31d588e13"} Jun 03 01:16:04.666626 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:04.666549 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5fd87df77b-lw76f" podStartSLOduration=1.211713309 podStartE2EDuration="1.666530233s" podCreationTimestamp="2026-06-03 01:16:03 +0000 UTC" firstStartedPulling="2026-06-03 01:16:03.879676652 +0000 UTC m=+690.039901198" lastFinishedPulling="2026-06-03 01:16:04.334493572 +0000 UTC m=+690.494718122" observedRunningTime="2026-06-03 01:16:04.664094362 +0000 UTC m=+690.824318930" watchObservedRunningTime="2026-06-03 01:16:04.666530233 +0000 UTC m=+690.826754805" Jun 03 01:16:04.697231 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:04.697197 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c57d74ff6-89j66"] Jun 03 01:16:04.697509 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:04.697478 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5c57d74ff6-89j66" podUID="4e555d99-a3c6-41e3-875b-88fed4920df3" containerName="authorino" containerID="cri-o://c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679" gracePeriod=30 Jun 03 01:16:04.949030 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:04.949005 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:16:05.055199 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.055158 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e555d99-a3c6-41e3-875b-88fed4920df3-tls-cert\") pod \"4e555d99-a3c6-41e3-875b-88fed4920df3\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " Jun 03 01:16:05.055413 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.055207 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd2nw\" (UniqueName: \"kubernetes.io/projected/4e555d99-a3c6-41e3-875b-88fed4920df3-kube-api-access-kd2nw\") pod \"4e555d99-a3c6-41e3-875b-88fed4920df3\" (UID: \"4e555d99-a3c6-41e3-875b-88fed4920df3\") " Jun 03 01:16:05.057660 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.057626 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e555d99-a3c6-41e3-875b-88fed4920df3-kube-api-access-kd2nw" (OuterVolumeSpecName: "kube-api-access-kd2nw") pod "4e555d99-a3c6-41e3-875b-88fed4920df3" (UID: "4e555d99-a3c6-41e3-875b-88fed4920df3"). InnerVolumeSpecName "kube-api-access-kd2nw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:16:05.066007 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.065973 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e555d99-a3c6-41e3-875b-88fed4920df3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4e555d99-a3c6-41e3-875b-88fed4920df3" (UID: "4e555d99-a3c6-41e3-875b-88fed4920df3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:16:05.156662 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.156623 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e555d99-a3c6-41e3-875b-88fed4920df3-tls-cert\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:16:05.156662 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.156658 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd2nw\" (UniqueName: \"kubernetes.io/projected/4e555d99-a3c6-41e3-875b-88fed4920df3-kube-api-access-kd2nw\") on node \"ip-10-0-142-91.ec2.internal\" DevicePath \"\"" Jun 03 01:16:05.654560 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.654529 2566 generic.go:358] "Generic (PLEG): container finished" podID="4e555d99-a3c6-41e3-875b-88fed4920df3" containerID="c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679" exitCode=0 Jun 03 01:16:05.654977 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.654574 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c57d74ff6-89j66" Jun 03 01:16:05.654977 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.654632 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c57d74ff6-89j66" event={"ID":"4e555d99-a3c6-41e3-875b-88fed4920df3","Type":"ContainerDied","Data":"c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679"} Jun 03 01:16:05.654977 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.654673 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c57d74ff6-89j66" event={"ID":"4e555d99-a3c6-41e3-875b-88fed4920df3","Type":"ContainerDied","Data":"419be5a78c1a27614480b4e7267d230cb1860be0cdf309e00bb9e4d056fec4dc"} Jun 03 01:16:05.654977 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.654711 2566 scope.go:117] "RemoveContainer" containerID="c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679" Jun 03 01:16:05.668174 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.668152 2566 scope.go:117] "RemoveContainer" containerID="c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679" Jun 03 01:16:05.668431 ip-10-0-142-91 kubenswrapper[2566]: E0603 01:16:05.668411 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679\": container with ID starting with c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679 not found: ID does not exist" containerID="c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679" Jun 03 01:16:05.668491 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.668440 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679"} err="failed to get container status \"c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679\": rpc error: code = NotFound desc = could not find container \"c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679\": container with ID starting with c641f4e32400a1b9887d850e0e0b01bbf45f55747b32f2418ad9e865f97e7679 not found: ID does not exist" Jun 03 01:16:05.677312 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.677287 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c57d74ff6-89j66"] Jun 03 01:16:05.679721 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:05.679700 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c57d74ff6-89j66"] Jun 03 01:16:06.418909 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:16:06.418874 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e555d99-a3c6-41e3-875b-88fed4920df3" path="/var/lib/kubelet/pods/4e555d99-a3c6-41e3-875b-88fed4920df3/volumes" Jun 03 01:22:49.897421 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:49.897391 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fd87df77b-lw76f_a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff/authorino/0.log" Jun 03 01:22:55.662974 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:55.662942 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-h8k4d_c9ce3475-8194-4f3a-a307-7b3319563a08/copy-manifests/0.log" Jun 03 01:22:55.669108 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:55.669086 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-h8k4d_c9ce3475-8194-4f3a-a307-7b3319563a08/manager/0.log" Jun 03 01:22:57.103964 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:57.103935 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fd87df77b-lw76f_a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff/authorino/0.log" Jun 03 01:22:57.455347 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:57.455278 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-9zcrc_0f933702-8cc1-4dbc-a9f4-2ed085d67237/kuadrant-console-plugin/0.log" Jun 03 01:22:58.505869 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:58.505841 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db4bc68bb-7gbrh_8c3484ca-0571-49df-b734-a4151cfa8e73/kube-auth-proxy/0.log" Jun 03 01:22:58.945461 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:22:58.945373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8499d87b85-4vgzx_281f53e8-9472-4a9d-84be-19abd23825c4/router/0.log" Jun 03 01:23:04.369978 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.369945 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d79wk/must-gather-qs2mx"] Jun 03 01:23:04.370373 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.370289 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e555d99-a3c6-41e3-875b-88fed4920df3" containerName="authorino" Jun 03 01:23:04.370373 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.370300 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e555d99-a3c6-41e3-875b-88fed4920df3" containerName="authorino" Jun 03 01:23:04.370373 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.370366 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e555d99-a3c6-41e3-875b-88fed4920df3" containerName="authorino" Jun 03 01:23:04.379877 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.379846 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.381829 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.381806 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79wk\"/\"kube-root-ca.crt\"" Jun 03 01:23:04.381947 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.381836 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79wk\"/\"openshift-service-ca.crt\"" Jun 03 01:23:04.381947 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.381857 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d79wk\"/\"default-dockercfg-9nwgs\"" Jun 03 01:23:04.391838 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.391816 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/must-gather-qs2mx"] Jun 03 01:23:04.420809 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.420790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd2bb0b5-fb96-4f19-92ef-5553beb1a39d-must-gather-output\") pod \"must-gather-qs2mx\" (UID: \"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d\") " pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.420889 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.420839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5s9q\" (UniqueName: \"kubernetes.io/projected/fd2bb0b5-fb96-4f19-92ef-5553beb1a39d-kube-api-access-v5s9q\") pod \"must-gather-qs2mx\" (UID: \"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d\") " pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.521974 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.521941 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5s9q\" (UniqueName: \"kubernetes.io/projected/fd2bb0b5-fb96-4f19-92ef-5553beb1a39d-kube-api-access-v5s9q\") pod \"must-gather-qs2mx\" (UID: \"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d\") " pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.522138 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.522118 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd2bb0b5-fb96-4f19-92ef-5553beb1a39d-must-gather-output\") pod \"must-gather-qs2mx\" (UID: \"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d\") " pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.522671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.522645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd2bb0b5-fb96-4f19-92ef-5553beb1a39d-must-gather-output\") pod \"must-gather-qs2mx\" (UID: \"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d\") " pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.531441 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.531414 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5s9q\" (UniqueName: \"kubernetes.io/projected/fd2bb0b5-fb96-4f19-92ef-5553beb1a39d-kube-api-access-v5s9q\") pod \"must-gather-qs2mx\" (UID: \"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d\") " pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.688236 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.688176 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/must-gather-qs2mx" Jun 03 01:23:04.810476 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.810446 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/must-gather-qs2mx"] Jun 03 01:23:04.812946 ip-10-0-142-91 kubenswrapper[2566]: W0603 01:23:04.812913 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd2bb0b5_fb96_4f19_92ef_5553beb1a39d.slice/crio-16b23c5a85310e5fa9f4b5d92a6310d6833822293a0d6337736e0a5ec9b0536a WatchSource:0}: Error finding container 16b23c5a85310e5fa9f4b5d92a6310d6833822293a0d6337736e0a5ec9b0536a: Status 404 returned error can't find the container with id 16b23c5a85310e5fa9f4b5d92a6310d6833822293a0d6337736e0a5ec9b0536a Jun 03 01:23:04.814675 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:04.814661 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:23:05.019802 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:05.019768 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/must-gather-qs2mx" event={"ID":"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d","Type":"ContainerStarted","Data":"16b23c5a85310e5fa9f4b5d92a6310d6833822293a0d6337736e0a5ec9b0536a"} Jun 03 01:23:06.025540 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:06.025507 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/must-gather-qs2mx" event={"ID":"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d","Type":"ContainerStarted","Data":"a3628f9bbf2dcd52b831d405e8f4576777f7363ef0637002ee1f4295e5f98d41"} Jun 03 01:23:06.025540 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:06.025544 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/must-gather-qs2mx" event={"ID":"fd2bb0b5-fb96-4f19-92ef-5553beb1a39d","Type":"ContainerStarted","Data":"8d31501d28e17b5fda06413f6592cef067cde34a4fcce89e0e963e3912ebe912"} Jun 03 01:23:06.041075 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:06.041019 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d79wk/must-gather-qs2mx" podStartSLOduration=1.303215096 podStartE2EDuration="2.041004249s" podCreationTimestamp="2026-06-03 01:23:04 +0000 UTC" firstStartedPulling="2026-06-03 01:23:04.814785045 +0000 UTC m=+1110.975009591" lastFinishedPulling="2026-06-03 01:23:05.552574198 +0000 UTC m=+1111.712798744" observedRunningTime="2026-06-03 01:23:06.038234585 +0000 UTC m=+1112.198459155" watchObservedRunningTime="2026-06-03 01:23:06.041004249 +0000 UTC m=+1112.201228819" Jun 03 01:23:07.181150 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:07.181117 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g2wt8_a32155b2-feee-446f-9736-2105af7d2972/global-pull-secret-syncer/0.log" Jun 03 01:23:07.341470 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:07.341434 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ccrpj_ac260f96-cf37-4922-996f-ffbdcb1ba2d1/konnectivity-agent/0.log" Jun 03 01:23:07.440154 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:07.440081 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-91.ec2.internal_37f7a2ea0aeb6bfaa54aad3485eb0728/haproxy/0.log" Jun 03 01:23:11.564512 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:11.564473 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fd87df77b-lw76f_a9cbb701-4911-4bd3-be8b-b27e2dc1a7ff/authorino/0.log" Jun 03 01:23:11.657756 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:11.657728 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-9zcrc_0f933702-8cc1-4dbc-a9f4-2ed085d67237/kuadrant-console-plugin/0.log" Jun 03 01:23:13.272311 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.272280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5fddbbffbf-lz7x8_841f79bc-dcfd-46a8-b5f6-2a09dff0de12/metrics-server/0.log" Jun 03 01:23:13.302150 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.302118 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-ppmrb_0e2a5a61-66db-40bc-ad0c-ccd2b46154b3/monitoring-plugin/0.log" Jun 03 01:23:13.345164 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.344510 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lcvqt_5e0121c1-3dc9-4417-978f-f9a7aef16046/node-exporter/0.log" Jun 03 01:23:13.364656 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.364593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lcvqt_5e0121c1-3dc9-4417-978f-f9a7aef16046/kube-rbac-proxy/0.log" Jun 03 01:23:13.392117 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.392091 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lcvqt_5e0121c1-3dc9-4417-978f-f9a7aef16046/init-textfile/0.log" Jun 03 01:23:13.675361 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.675331 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/prometheus/0.log" Jun 03 01:23:13.699464 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.699429 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/config-reloader/0.log" Jun 03 01:23:13.722322 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.722297 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/thanos-sidecar/0.log" Jun 03 01:23:13.742493 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.742468 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/kube-rbac-proxy-web/0.log" Jun 03 01:23:13.765867 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.765833 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/kube-rbac-proxy/0.log" Jun 03 01:23:13.786988 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.786960 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/kube-rbac-proxy-thanos/0.log" Jun 03 01:23:13.810681 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:13.810582 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_432386f6-6d4d-455c-8e51-00e82a76f315/init-config-reloader/0.log" Jun 03 01:23:14.017095 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:14.017057 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7977bd676c-s77c4_7f09b557-a83f-4af2-9d1a-ddd9c559f74d/thanos-query/0.log" Jun 03 01:23:14.036291 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:14.036265 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7977bd676c-s77c4_7f09b557-a83f-4af2-9d1a-ddd9c559f74d/kube-rbac-proxy-web/0.log" Jun 03 01:23:14.055324 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:14.055289 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7977bd676c-s77c4_7f09b557-a83f-4af2-9d1a-ddd9c559f74d/kube-rbac-proxy/0.log" Jun 03 01:23:14.076430 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:14.076342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7977bd676c-s77c4_7f09b557-a83f-4af2-9d1a-ddd9c559f74d/prom-label-proxy/0.log" Jun 03 01:23:14.095705 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:14.095659 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7977bd676c-s77c4_7f09b557-a83f-4af2-9d1a-ddd9c559f74d/kube-rbac-proxy-rules/0.log" Jun 03 01:23:14.116591 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:14.116561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7977bd676c-s77c4_7f09b557-a83f-4af2-9d1a-ddd9c559f74d/kube-rbac-proxy-metrics/0.log" Jun 03 01:23:15.238239 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:15.238210 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-sznbb_c712628c-c52d-4fa3-b655-936485d249e3/networking-console-plugin/0.log" Jun 03 01:23:16.333065 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:16.333032 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-dvztg_9242b57a-936a-43bb-8c6f-52c8ee7a8b49/download-server/0.log" Jun 03 01:23:17.006296 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.006261 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv"] Jun 03 01:23:17.013292 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.013269 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.019332 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.019305 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv"] Jun 03 01:23:17.143873 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.143837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-proc\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.144119 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.144101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-sys\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.144237 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.144222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-lib-modules\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.144353 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.144341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2675\" (UniqueName: \"kubernetes.io/projected/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-kube-api-access-v2675\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.144525 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.144513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-podres\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245219 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245182 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-proc\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245291 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-proc\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-sys\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245341 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-lib-modules\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245395 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245368 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2675\" (UniqueName: \"kubernetes.io/projected/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-kube-api-access-v2675\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245626 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245416 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-sys\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245626 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245455 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-podres\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245626 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-lib-modules\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.245626 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.245572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-podres\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.253390 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.253358 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2675\" (UniqueName: \"kubernetes.io/projected/f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2-kube-api-access-v2675\") pod \"perf-node-gather-daemonset-lf2xv\" (UID: \"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.325671 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.325581 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:17.514331 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.514301 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv"] Jun 03 01:23:17.781788 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.781764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mdfhz_8e5aa1ac-f321-468e-a999-a027c0b6387e/dns/0.log" Jun 03 01:23:17.800431 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.800399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mdfhz_8e5aa1ac-f321-468e-a999-a027c0b6387e/kube-rbac-proxy/0.log" Jun 03 01:23:17.907112 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:17.907049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l22jr_6546c1ff-667d-471a-88fc-513321cd3b50/dns-node-resolver/0.log" Jun 03 01:23:18.091814 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.091779 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" event={"ID":"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2","Type":"ContainerStarted","Data":"7b22f3d20e367d5413b3b1d7dbfc4ff348200233880e17be3676955e8d6d5caa"} Jun 03 01:23:18.091814 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.091824 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" event={"ID":"f711ff5d-3917-4c5d-9b0c-1f1840a7e6d2","Type":"ContainerStarted","Data":"93ff5e7915d1b8313e1b107cc3114402ffb729a58e8cacc829f0054c4087a80e"} Jun 03 01:23:18.092026 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.091844 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:18.105739 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.105689 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" podStartSLOduration=2.105673045 podStartE2EDuration="2.105673045s" podCreationTimestamp="2026-06-03 01:23:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:23:18.104354942 +0000 UTC m=+1124.264579510" watchObservedRunningTime="2026-06-03 01:23:18.105673045 +0000 UTC m=+1124.265897613" Jun 03 01:23:18.441369 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.441336 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d444746fc-tz6hn_408a1a27-b023-4c4f-9db0-279b0e684217/registry/0.log" Jun 03 01:23:18.448910 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.448853 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d444746fc-tz6hn_408a1a27-b023-4c4f-9db0-279b0e684217/registry/1.log" Jun 03 01:23:18.485040 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:18.485018 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ssbn2_cb5ae05c-160c-4db6-9840-0e49924dca26/node-ca/0.log" Jun 03 01:23:19.405679 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:19.405651 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db4bc68bb-7gbrh_8c3484ca-0571-49df-b734-a4151cfa8e73/kube-auth-proxy/0.log" Jun 03 01:23:19.495191 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:19.495163 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8499d87b85-4vgzx_281f53e8-9472-4a9d-84be-19abd23825c4/router/0.log" Jun 03 01:23:20.009784 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:20.009755 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fbtj_de267643-0496-4cfb-a294-5fc62d88d384/serve-healthcheck-canary/0.log" Jun 03 01:23:20.551142 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:20.551117 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vk6wv_671cebe9-b9c4-4b98-a879-9c098e61bcd8/kube-rbac-proxy/0.log" Jun 03 01:23:20.568265 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:20.568246 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vk6wv_671cebe9-b9c4-4b98-a879-9c098e61bcd8/exporter/0.log" Jun 03 01:23:20.587336 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:20.587316 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vk6wv_671cebe9-b9c4-4b98-a879-9c098e61bcd8/extractor/0.log" Jun 03 01:23:23.048059 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:23.048026 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-h8k4d_c9ce3475-8194-4f3a-a307-7b3319563a08/manager/0.log" Jun 03 01:23:23.064923 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:23.064903 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-h8k4d_c9ce3475-8194-4f3a-a307-7b3319563a08/copy-manifests/0.log" Jun 03 01:23:24.105877 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:24.105846 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-lf2xv" Jun 03 01:23:24.353137 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:24.353109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65c8c8d4bb-rq9hb_6b2ad00f-fb76-4d59-8464-6384fa22f8ad/manager/0.log" Jun 03 01:23:30.504068 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.504042 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/kube-multus-additional-cni-plugins/0.log" Jun 03 01:23:30.530198 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.530167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/egress-router-binary-copy/0.log" Jun 03 01:23:30.553570 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.553553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/cni-plugins/0.log" Jun 03 01:23:30.573677 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.573653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/bond-cni-plugin/0.log" Jun 03 01:23:30.595176 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.595154 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/routeoverride-cni/0.log" Jun 03 01:23:30.615153 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.615134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/whereabouts-cni-bincopy/0.log" Jun 03 01:23:30.661967 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:30.661945 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-444b4_2a0e03bc-7a90-467f-a43f-64d20e865cfe/whereabouts-cni/0.log" Jun 03 01:23:31.083582 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:31.083551 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qv8sb_bfd17aba-7ece-4233-8b08-53963e374fde/kube-multus/0.log" Jun 03 01:23:31.185713 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:31.185681 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xl69t_bbde0f90-b113-483f-994d-ef9b0fd71f67/network-metrics-daemon/0.log" Jun 03 01:23:31.203266 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:31.203244 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xl69t_bbde0f90-b113-483f-994d-ef9b0fd71f67/kube-rbac-proxy/0.log" Jun 03 01:23:31.960339 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:31.960312 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/ovn-controller/0.log" Jun 03 01:23:31.986925 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:31.986893 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/ovn-acl-logging/0.log" Jun 03 01:23:32.008141 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:32.008120 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/kube-rbac-proxy-node/0.log" Jun 03 01:23:32.026315 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:32.026280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 01:23:32.040724 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:32.040701 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/northd/0.log" Jun 03 01:23:32.057536 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:32.057515 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/nbdb/0.log" Jun 03 01:23:32.077661 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:32.077638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/sbdb/0.log" Jun 03 01:23:32.303686 ip-10-0-142-91 kubenswrapper[2566]: I0603 01:23:32.303644 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h5mn_083a92af-9f2b-4dad-a5bc-1c60a6470340/ovnkube-controller/0.log"