Jun 05 21:02:36.579396 ip-10-0-128-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 21:02:36.579409 ip-10-0-128-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 21:02:36.579418 ip-10-0-128-37 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 21:02:36.579743 ip-10-0-128-37 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 21:02:46.612380 ip-10-0-128-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 21:02:46.612396 ip-10-0-128-37 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e2331042d9284adda6b7271b526ff418 -- Jun 05 21:05:10.775226 ip-10-0-128-37 systemd[1]: Starting Kubernetes Kubelet... Jun 05 21:05:11.206577 ip-10-0-128-37 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:05:11.206577 ip-10-0-128-37 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 21:05:11.206577 ip-10-0-128-37 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:05:11.206577 ip-10-0-128-37 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 21:05:11.206577 ip-10-0-128-37 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:05:11.208513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.208377 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 21:05:11.212113 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212095 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:11.212113 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212112 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212116 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212120 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212122 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212126 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212129 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212132 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212137 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212147 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212151 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212154 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212163 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212166 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212169 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212172 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212174 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212177 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212180 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212182 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212185 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:11.212200 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212187 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212190 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212192 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212195 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212198 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212201 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212203 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212206 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212209 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212212 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212215 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212218 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212220 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212223 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212226 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212229 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212231 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212234 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212236 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212240 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:11.212674 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212242 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212245 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212249 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212253 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212255 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212258 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212260 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212262 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212265 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212267 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212270 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212272 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212275 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212278 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212282 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212284 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212287 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212292 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:11.213180 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212296 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212299 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212302 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212304 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212307 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212310 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212312 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212315 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212318 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212321 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212323 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212327 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212329 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212333 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212336 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212338 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212341 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212344 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212346 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212349 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:11.213635 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212351 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212354 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212356 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212359 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212362 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212365 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212368 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212370 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212373 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212376 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212378 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212381 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212384 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212386 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212389 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212392 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212394 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212397 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212399 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.212402 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:11.214126 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213133 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213139 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213142 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213145 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213148 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213150 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213153 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213156 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213159 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213161 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213164 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213168 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213171 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213174 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213176 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213179 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213182 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213185 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213188 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:11.214603 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213191 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213194 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213197 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213200 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213202 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213205 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213208 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213210 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213213 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213215 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213218 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213221 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213223 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213226 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213228 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213231 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213233 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213236 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213238 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213241 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:11.215254 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213243 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213246 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213249 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213251 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213253 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213256 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213259 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213262 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213264 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213267 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213269 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213271 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213274 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213278 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213280 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213284 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213286 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213289 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213291 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213294 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:11.215948 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213297 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213301 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213305 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213308 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213311 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213314 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213316 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213319 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213322 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213325 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213328 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213330 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213333 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213335 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213338 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213341 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213343 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213346 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213349 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:11.216450 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213352 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213355 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213358 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213360 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213363 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213366 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213371 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213374 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213377 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213380 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213383 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213386 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213389 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213392 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213395 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213398 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213400 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213403 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213406 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:11.216939 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213408 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213411 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213854 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213860 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213863 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213866 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213868 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213871 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213875 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213878 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213881 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213883 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213890 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213892 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213895 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213898 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213900 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213903 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213906 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213909 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:11.217415 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213911 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213928 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213931 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213933 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213936 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213939 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213942 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213945 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213948 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213951 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213954 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213956 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213959 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213962 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213965 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213967 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213970 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213972 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213975 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213978 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:11.217949 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213980 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213984 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213987 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213990 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213996 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.213999 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214002 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214006 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214009 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214012 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214016 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214019 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214022 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214024 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214027 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214029 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214031 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214034 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214036 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:11.218742 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214039 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214041 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214044 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214046 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214049 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214051 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214054 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214056 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214059 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214061 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214064 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214067 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214069 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214072 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214074 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214079 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214082 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214087 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214089 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:11.219230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214092 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214095 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214097 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214100 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214102 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214105 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214107 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214110 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214112 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214115 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214117 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214120 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214123 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214125 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214128 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214130 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214133 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214135 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214138 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214141 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:11.219803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214144 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214146 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.214149 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214216 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214223 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214228 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214233 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214237 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214241 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214246 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214252 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214255 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214258 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214262 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214265 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214268 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214271 2560 flags.go:64] FLAG: --cgroup-root="" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214274 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214277 2560 flags.go:64] FLAG: --client-ca-file="" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214280 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214283 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214287 2560 flags.go:64] FLAG: --cluster-domain="" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214289 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 21:05:11.220435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214292 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214296 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214299 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214302 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214305 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214309 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214312 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214315 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214318 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214321 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214324 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214327 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214331 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214333 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214336 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214339 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214344 2560 flags.go:64] FLAG: --enable-server="true" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214347 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214351 2560 flags.go:64] FLAG: --event-burst="100" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214356 2560 flags.go:64] FLAG: --event-qps="50" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214359 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214362 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214365 2560 flags.go:64] FLAG: --eviction-hard="" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214369 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 21:05:11.221171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214372 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214375 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214378 2560 flags.go:64] FLAG: --eviction-soft="" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214381 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214383 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214387 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214390 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214392 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214395 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214398 2560 flags.go:64] FLAG: --feature-gates="" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214402 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214405 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214408 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214411 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214414 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214417 2560 flags.go:64] FLAG: --help="false" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214420 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214423 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214426 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214429 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214432 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214435 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214438 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 21:05:11.221786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214441 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214445 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214448 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214451 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214455 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214459 2560 flags.go:64] FLAG: --kube-reserved="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214461 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214464 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214467 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214470 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214473 2560 flags.go:64] FLAG: --lock-file="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214476 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214479 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214482 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214488 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214491 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214493 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214497 2560 flags.go:64] FLAG: --logging-format="text" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214499 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214503 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214505 2560 flags.go:64] FLAG: --manifest-url="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214508 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214512 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214515 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214519 2560 flags.go:64] FLAG: --max-pods="110" Jun 05 21:05:11.222473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214523 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214525 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214528 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214531 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214534 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214537 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214540 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214548 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214553 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214556 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214559 2560 flags.go:64] FLAG: --pod-cidr="" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214563 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214569 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214572 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214576 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214578 2560 flags.go:64] FLAG: --port="10250" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214582 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214585 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a618067f2d4d7569" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214588 2560 flags.go:64] FLAG: --qos-reserved="" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214591 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214594 2560 flags.go:64] FLAG: --register-node="true" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214596 2560 flags.go:64] FLAG: --register-with-taints="" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214600 2560 flags.go:64] FLAG: --registry-burst="10" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214603 2560 flags.go:64] FLAG: --registry-qps="5" Jun 05 21:05:11.223107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214606 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214609 2560 flags.go:64] FLAG: --reserved-memory="" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214613 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214616 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214619 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214622 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214625 2560 flags.go:64] FLAG: --runonce="false" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214628 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214631 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214634 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214637 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214640 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214643 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214646 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214649 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214652 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214656 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214659 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214662 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214665 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214668 2560 flags.go:64] FLAG: --system-cgroups="" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214671 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214682 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214685 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214688 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 21:05:11.223705 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214691 2560 flags.go:64] FLAG: --tls-min-version="" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214694 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214697 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214700 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214702 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214705 2560 flags.go:64] FLAG: --v="2" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214709 2560 flags.go:64] FLAG: --version="false" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214713 2560 flags.go:64] FLAG: --vmodule="" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214717 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.214720 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218027 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218083 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218198 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218205 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218210 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218215 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218219 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218223 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218230 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218235 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218239 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218244 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:11.224427 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218249 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218253 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218257 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218261 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218266 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218270 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218275 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218279 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218284 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218288 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218293 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218298 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218302 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218306 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218310 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218315 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218319 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218324 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218331 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218339 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:11.225057 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218344 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218349 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218354 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218358 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218362 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218367 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218371 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218375 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218379 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218384 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218388 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218393 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218397 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218404 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218411 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218415 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218419 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218424 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218428 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:11.225555 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218432 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218436 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218440 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218445 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218449 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218453 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218458 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218463 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218467 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218471 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218475 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218480 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218484 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218489 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218493 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218497 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218502 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218506 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218511 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:11.226058 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218515 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218519 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218523 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218528 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218532 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218537 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218541 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218545 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218549 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218553 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218557 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218561 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218568 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218574 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218579 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218584 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218589 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218594 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218599 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218608 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:11.226528 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218612 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218617 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218621 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218625 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218629 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218634 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218638 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218643 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.218647 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.219378 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.226419 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.226436 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.226458 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.226464 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 21:05:11.227033 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226524 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226530 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226534 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226537 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226541 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226544 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226547 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226550 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226552 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226555 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226558 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226562 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226565 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226568 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226571 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226574 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226577 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226579 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226582 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:11.227388 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226584 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226587 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226590 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226592 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226595 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226598 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226600 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226603 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226605 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226608 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226611 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226614 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226617 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226620 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226622 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226625 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226628 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226630 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226633 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:11.227845 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226636 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226638 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226641 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226644 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226646 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226649 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226652 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226654 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226657 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226660 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226662 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226665 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226668 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226670 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226673 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226675 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226677 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226680 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226682 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226685 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:11.228373 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226687 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226690 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226692 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226698 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226702 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226705 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226708 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226711 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226714 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226717 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226720 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226722 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226725 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226729 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226732 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226736 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226738 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226741 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226744 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226747 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:11.228848 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226751 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226753 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226756 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226758 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226761 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226763 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226766 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226768 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226771 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226773 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226776 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226779 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226782 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226785 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226787 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226790 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226793 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226796 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226799 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226801 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:11.229352 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226804 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.226810 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226955 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226960 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226963 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226967 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226971 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226974 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226978 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226981 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226983 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226986 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226990 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226993 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226996 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:05:11.229840 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.226999 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227002 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227004 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227007 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227009 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227012 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227015 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227017 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227020 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227022 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227025 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227028 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227031 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227033 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227036 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227038 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227041 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227044 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227047 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227049 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:05:11.230230 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227052 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227054 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227057 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227059 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227062 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227064 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227067 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227069 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227072 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227074 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227080 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227082 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227085 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227087 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227090 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227093 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227095 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227098 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227102 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227104 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:05:11.230708 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227107 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227110 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227112 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227115 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227117 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227120 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227122 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227125 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227128 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227130 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227133 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227135 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227138 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227141 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227145 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227147 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227150 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227152 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227155 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:05:11.231207 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227157 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227160 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227164 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227168 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227172 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227174 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227177 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227180 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227182 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227184 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227187 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227190 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227193 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227195 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227198 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227200 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227203 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227205 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227208 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227211 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:05:11.231670 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227213 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227216 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227218 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227221 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227224 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227227 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:11.227229 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.227234 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.227355 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.229334 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.230798 2560 server.go:1019] "Starting client certificate rotation" Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.230948 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:05:11.232291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.230980 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:05:11.233547 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.233532 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:05:11.234926 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.234895 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:05:11.247889 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.247868 2560 log.go:25] "Validated CRI v1 runtime API" Jun 05 21:05:11.257360 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.257338 2560 log.go:25] "Validated CRI v1 image API" Jun 05 21:05:11.258203 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.258184 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 21:05:11.261008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.260987 2560 fs.go:135] Filesystem UUIDs: map[046468a7-4906-4d0d-b950-b8f9cb05c7e3:/dev/nvme0n1p4 2cd08eca-5d81-44d5-ac14-52be72a2b999:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 05 21:05:11.261081 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.261007 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 21:05:11.262177 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.262157 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:05:11.267321 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.267200 2560 manager.go:216] Machine: {Timestamp:2026-06-05 21:05:11.264816641 +0000 UTC m=+0.356625079 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099934 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a73e4ef24ce19cb8059b1cddcb6dc SystemUUID:ec2a73e4-ef24-ce19-cb80-59b1cddcb6dc BootID:e2331042-d928-4add-a6b7-271b526ff418 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:fb:fb:64:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:fb:fb:64:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:28:bb:46:23:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 21:05:11.267321 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.267311 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 21:05:11.267450 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.267397 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 21:05:11.270944 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.270904 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 21:05:11.271098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.270946 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 21:05:11.271713 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.271704 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 21:05:11.271743 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.271716 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 21:05:11.271743 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.271724 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:05:11.272417 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.272406 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:05:11.273243 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.273232 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 21:05:11.275929 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.275904 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:05:11.276066 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276056 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 21:05:11.276101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276089 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 05 21:05:11.276130 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276104 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 21:05:11.276130 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276115 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 21:05:11.276130 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276124 2560 kubelet.go:398] "Adding apiserver pod source" Jun 05 21:05:11.276225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276132 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 21:05:11.276626 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276603 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:05:11.276679 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.276627 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:05:11.279027 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.279010 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 21:05:11.280439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.280424 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 21:05:11.280492 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.280455 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 21:05:11.281720 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281704 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281731 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281764 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281772 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281782 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281787 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281795 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281801 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281807 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281813 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 21:05:11.281821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281826 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 21:05:11.282095 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.281832 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 21:05:11.283730 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.283719 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 21:05:11.283730 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.283731 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 21:05:11.285426 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.285380 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 21:05:11.285532 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.285388 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 21:05:11.287456 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.287259 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 21:05:11.287456 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.287439 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 21:05:11.287591 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.287382 2560 server.go:1268] "Started kubelet" Jun 05 21:05:11.287591 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.287413 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 21:05:11.287680 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.287648 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 21:05:11.288385 ip-10-0-128-37 systemd[1]: Started Kubernetes Kubelet. Jun 05 21:05:11.289498 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.289471 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 05 21:05:11.292132 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.292113 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 21:05:11.295149 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.295104 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 21:05:11.296609 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.296592 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 21:05:11.296693 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.296593 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 21:05:11.296747 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.296698 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.297091 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.296074 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-37.ec2.internal.18b64b5062202872 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-37.ec2.internal,UID:ip-10-0-128-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-37.ec2.internal,},FirstTimestamp:2026-06-05 21:05:11.28735141 +0000 UTC m=+0.379159850,LastTimestamp:2026-06-05 21:05:11.28735141 +0000 UTC m=+0.379159850,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-37.ec2.internal,}" Jun 05 21:05:11.297208 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297132 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 21:05:11.297208 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297135 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 21:05:11.297208 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297170 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 21:05:11.297391 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297372 2560 factory.go:55] Registering systemd factory Jun 05 21:05:11.297446 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297414 2560 factory.go:223] Registration of the systemd container factory successfully Jun 05 21:05:11.297533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297521 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 05 21:05:11.297533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297533 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 05 21:05:11.297724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297710 2560 factory.go:153] Registering CRI-O factory Jun 05 21:05:11.297792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297728 2560 factory.go:223] Registration of the crio container factory successfully Jun 05 21:05:11.297792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297778 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 21:05:11.297890 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297807 2560 factory.go:103] Registering Raw factory Jun 05 21:05:11.297890 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.297823 2560 manager.go:1196] Started watching for new ooms in manager Jun 05 21:05:11.298228 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.298215 2560 manager.go:349] Starting recovery of all containers Jun 05 21:05:11.300627 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.300600 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 21:05:11.300731 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.300692 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 21:05:11.306669 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.306651 2560 manager.go:354] Recovery completed Jun 05 21:05:11.309168 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.309147 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmj2b" Jun 05 21:05:11.311708 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.311694 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.313893 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.313876 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.313987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.313906 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.314037 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.313995 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.314466 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.314452 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 21:05:11.314510 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.314466 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 21:05:11.314510 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.314480 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:05:11.314573 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.314456 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.315382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.315369 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.315439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.315392 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.315439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.315402 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.315717 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.315704 2560 policy_none.go:49] "None policy: Start" Jun 05 21:05:11.315763 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.315723 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 21:05:11.315763 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.315737 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 21:05:11.315850 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.315727 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-37.ec2.internal.18b64b5063b52768 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-37.ec2.internal,UID:ip-10-0-128-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-37.ec2.internal,},FirstTimestamp:2026-06-05 21:05:11.313893224 +0000 UTC m=+0.405701661,LastTimestamp:2026-06-05 21:05:11.313893224 +0000 UTC m=+0.405701661,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-37.ec2.internal,}" Jun 05 21:05:11.316177 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.316061 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmj2b" Jun 05 21:05:11.317028 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.317016 2560 policy_none.go:47] "Start" Jun 05 21:05:11.352692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.352672 2560 manager.go:337] "Starting Device Plugin manager" Jun 05 21:05:11.352870 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.352757 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 21:05:11.352870 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.352770 2560 server.go:87] "Starting device plugin registration server" Jun 05 21:05:11.353068 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.353056 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 21:05:11.353111 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.353069 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 21:05:11.353374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.353166 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 21:05:11.353374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.353251 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 21:05:11.353374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.353260 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 21:05:11.353859 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.353839 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 21:05:11.353950 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.353892 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.371080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.369236 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 21:05:11.371080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.370330 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 21:05:11.371080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.370361 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 21:05:11.371080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.370380 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 21:05:11.371080 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.370412 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 21:05:11.372617 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.372600 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:11.453844 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.453802 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.454979 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.454961 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.455062 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.454998 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.455062 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.455012 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.455062 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.455036 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.464806 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.464761 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.464806 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.464785 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-37.ec2.internal\": node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.471029 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.471006 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"] Jun 05 21:05:11.471110 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.471071 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.471785 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.471770 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.471846 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.471796 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.471846 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.471805 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.472987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.472974 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.473092 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473078 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.473142 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473106 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.473624 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473610 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.473684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473624 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.473684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473637 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.473684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473645 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.473684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473653 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.473684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.473658 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.474709 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.474696 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.474762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.474721 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:05:11.475352 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.475337 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:05:11.475428 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.475361 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:05:11.475428 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.475374 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:05:11.487058 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.487035 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.498319 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.498296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/886cd1bbe2accfd6caf097fb80ff4fef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"886cd1bbe2accfd6caf097fb80ff4fef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.498400 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.498327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/886cd1bbe2accfd6caf097fb80ff4fef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"886cd1bbe2accfd6caf097fb80ff4fef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.498400 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.498352 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04c5343738b2a5e9259847f1e464ce4d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-37.ec2.internal\" (UID: \"04c5343738b2a5e9259847f1e464ce4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.499602 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.499578 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-37.ec2.internal\" not found" node="ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.504280 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.504262 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-37.ec2.internal\" not found" node="ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.587849 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.587818 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.599204 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.599172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/886cd1bbe2accfd6caf097fb80ff4fef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"886cd1bbe2accfd6caf097fb80ff4fef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.599326 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.599207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/886cd1bbe2accfd6caf097fb80ff4fef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"886cd1bbe2accfd6caf097fb80ff4fef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.599326 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.599231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04c5343738b2a5e9259847f1e464ce4d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-37.ec2.internal\" (UID: \"04c5343738b2a5e9259847f1e464ce4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.599326 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.599272 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/886cd1bbe2accfd6caf097fb80ff4fef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"886cd1bbe2accfd6caf097fb80ff4fef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.599326 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.599282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04c5343738b2a5e9259847f1e464ce4d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-37.ec2.internal\" (UID: \"04c5343738b2a5e9259847f1e464ce4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.599326 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.599294 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/886cd1bbe2accfd6caf097fb80ff4fef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"886cd1bbe2accfd6caf097fb80ff4fef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.688365 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.688328 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.789046 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.788976 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.804485 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.804462 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.808177 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:11.808011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" Jun 05 21:05:11.889740 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.889700 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:11.990263 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:11.990219 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:12.090756 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.090679 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found" Jun 05 21:05:12.114946 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.114906 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:12.197167 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.197140 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" Jun 05 21:05:12.210773 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.210748 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:05:12.212684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.212669 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" Jun 05 21:05:12.222032 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.222010 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:05:12.230130 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.230107 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 21:05:12.230269 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.230245 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 21:05:12.276396 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.276359 2560 apiserver.go:52] "Watching apiserver" Jun 05 21:05:12.286174 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.286148 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 21:05:12.286536 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.286517 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qqkxx","openshift-network-operator/iptables-alerter-m4z6t","openshift-ovn-kubernetes/ovnkube-node-qqkpx","kube-system/konnectivity-agent-hgrh6","kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal","openshift-dns/node-resolver-2rnbd","openshift-image-registry/node-ca-lchd7","openshift-multus/multus-additional-cni-plugins-5frq2","openshift-multus/multus-nqwkk","openshift-network-diagnostics/network-check-target-jrqkw","kube-system/global-pull-secret-syncer-d2wd6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv","openshift-cluster-node-tuning-operator/tuned-xkdrd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"] Jun 05 21:05:12.288185 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.288164 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.289572 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.289545 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.289699 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.289602 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:12.290372 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.290357 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.290464 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.290400 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.290519 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.290359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 21:05:12.290571 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.290520 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hnmwf\"" Jun 05 21:05:12.291101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.291084 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.293827 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.292944 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.293827 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.293112 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c86vp\"" Jun 05 21:05:12.294882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.294171 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.294882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.294204 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 21:05:12.294882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.294283 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 21:05:12.294882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.294497 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.294882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.294617 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 21:05:12.294882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.294812 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 21:05:12.296215 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.296189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.296452 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.296431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 21:05:12.296558 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.296524 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 21:05:12.296746 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.296732 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 21:05:12.296828 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.296732 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hz9f5\"" Jun 05 21:05:12.298358 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298342 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.298471 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298342 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 21:05:12.298614 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298597 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 21:05:12.298690 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.298690 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298614 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 21:05:12.298690 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298664 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ddkjz\"" Jun 05 21:05:12.298856 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.298615 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.299990 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.299973 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.300699 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.300681 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.300972 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.300957 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qbt5\"" Jun 05 21:05:12.301322 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.301310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.301780 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.301765 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.302067 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.302048 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 21:05:12.302157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.302070 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k8cpm\"" Jun 05 21:05:12.303096 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee131199-02c0-49dc-b384-1826bec3c5ff-dbus\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.303163 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-var-lib-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303202 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303161 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.303245 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303245 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.303344 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303254 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.303344 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303271 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-tmp-dir\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.303344 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d77f8c4-33ef-4d38-be34-d75e980a508c-host\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.303344 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303320 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-systemd-units\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-slash\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303392 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-systemd\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303296 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hfsj6\"" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwtjm\" (UniqueName: \"kubernetes.io/projected/27d9d21b-0638-49de-a49f-0b581389c01f-kube-api-access-nwtjm\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-etc-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-log-socket\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7334cf6d-90f0-42dd-bc33-aaa84db972c6-konnectivity-ca\") pod \"konnectivity-agent-hgrh6\" (UID: \"7334cf6d-90f0-42dd-bc33-aaa84db972c6\") " pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303601 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-system-cni-dir\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-kubelet\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-node-log\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-cni-netd\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7334cf6d-90f0-42dd-bc33-aaa84db972c6-agent-certs\") pod \"konnectivity-agent-hgrh6\" (UID: \"7334cf6d-90f0-42dd-bc33-aaa84db972c6\") " pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cnibin\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrl77\" (UniqueName: \"kubernetes.io/projected/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-kube-api-access-mrl77\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-ovn\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.303869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-ovnkube-config\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-env-overrides\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27d9d21b-0638-49de-a49f-0b581389c01f-ovn-node-metrics-cert\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr9zs\" (UniqueName: \"kubernetes.io/projected/34d43d5e-3cf4-429f-a153-92362cdcdaa6-kube-api-access-sr9zs\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.303996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-cni-bin\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-os-release\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cni-binary-copy\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee131199-02c0-49dc-b384-1826bec3c5ff-kubelet-config\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304137 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-run-netns\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-ovnkube-script-lib\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-hosts-file\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d77f8c4-33ef-4d38-be34-d75e980a508c-serviceca\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8ss\" (UniqueName: \"kubernetes.io/projected/6d77f8c4-33ef-4d38-be34-d75e980a508c-kube-api-access-ct8ss\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.304294 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.304227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.305069 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.305051 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 21:05:12.305132 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.305098 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5b5c\"" Jun 05 21:05:12.305205 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.305187 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.305261 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.305196 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.305305 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.305267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:12.305352 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.305315 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:12.305515 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.305501 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:05:12.306899 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.306887 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:12.306961 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.306950 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:12.308513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.308498 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.310903 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.310883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 21:05:12.311015 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.310931 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 21:05:12.311227 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.311211 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 21:05:12.311419 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.311406 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4d2jg\"" Jun 05 21:05:12.318489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.318435 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 21:00:11 +0000 UTC" deadline="2028-01-29 11:42:01.311649499 +0000 UTC" Jun 05 21:05:12.318489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.318486 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14462h36m48.993166173s" Jun 05 21:05:12.327430 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.327412 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kdkrr" Jun 05 21:05:12.335317 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.335289 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kdkrr" Jun 05 21:05:12.349952 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.349881 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886cd1bbe2accfd6caf097fb80ff4fef.slice/crio-25278cce6a7f701d80c69e592d520dd4cf202e85624d3b6e5c720b139baaaf38 WatchSource:0}: Error finding container 25278cce6a7f701d80c69e592d520dd4cf202e85624d3b6e5c720b139baaaf38: Status 404 returned error can't find the container with id 25278cce6a7f701d80c69e592d520dd4cf202e85624d3b6e5c720b139baaaf38 Jun 05 21:05:12.350246 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.350221 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c5343738b2a5e9259847f1e464ce4d.slice/crio-d4bc2e9d98712c2bd5c904f7ef2d5e2b76c8b35e52bba484961532687cedcdd9 WatchSource:0}: Error finding container d4bc2e9d98712c2bd5c904f7ef2d5e2b76c8b35e52bba484961532687cedcdd9: Status 404 returned error can't find the container with id d4bc2e9d98712c2bd5c904f7ef2d5e2b76c8b35e52bba484961532687cedcdd9 Jun 05 21:05:12.356099 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.356084 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:05:12.373433 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.373383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" event={"ID":"04c5343738b2a5e9259847f1e464ce4d","Type":"ContainerStarted","Data":"d4bc2e9d98712c2bd5c904f7ef2d5e2b76c8b35e52bba484961532687cedcdd9"} Jun 05 21:05:12.374616 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.374592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" event={"ID":"886cd1bbe2accfd6caf097fb80ff4fef","Type":"ContainerStarted","Data":"25278cce6a7f701d80c69e592d520dd4cf202e85624d3b6e5c720b139baaaf38"} Jun 05 21:05:12.397878 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.397858 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 21:05:12.404586 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.404654 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-sys\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.404654 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:12.404654 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-var-lib-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.404744 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.404744 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404693 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-var-lib-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.404744 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404718 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-hostroot\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.404832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d77f8c4-33ef-4d38-be34-d75e980a508c-host\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.404832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.404832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404780 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-kubelet\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.404832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404796 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d77f8c4-33ef-4d38-be34-d75e980a508c-host\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.404832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-etc-kubernetes\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.404832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-host\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-tuned\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.404851 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzg7\" (UniqueName: \"kubernetes.io/projected/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-kube-api-access-nbzg7\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-etc-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-log-socket\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.404899 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:05:12.904883594 +0000 UTC m=+1.996692021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404906 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-log-socket\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404931 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-system-cni-dir\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404951 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-os-release\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-cni-bin\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-kubelet\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404980 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-etc-openvswitch\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-node-log\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.404995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-node-log\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-kubelet\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405034 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-system-cni-dir\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.405089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-cni-netd\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405073 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-cni-netd\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7334cf6d-90f0-42dd-bc33-aaa84db972c6-agent-certs\") pod \"konnectivity-agent-hgrh6\" (UID: \"7334cf6d-90f0-42dd-bc33-aaa84db972c6\") " pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cnibin\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-etc-selinux\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnmqz\" (UniqueName: \"kubernetes.io/projected/92c09588-5928-4c1d-bd02-fab0875d1829-kube-api-access-wnmqz\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405190 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cnibin\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-ovnkube-config\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-env-overrides\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr9zs\" (UniqueName: \"kubernetes.io/projected/34d43d5e-3cf4-429f-a153-92362cdcdaa6-kube-api-access-sr9zs\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-cni-multus\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-conf-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37cc2f65-9786-4145-b647-f10c40c73699-host-slash\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-cni-bin\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405378 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-socket-dir-parent\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-k8s-cni-cncf-io\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-run\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.405886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405420 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-cni-bin\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-ovnkube-script-lib\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-cni-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-registration-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-system-cni-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-daemon-config\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhth\" (UniqueName: \"kubernetes.io/projected/034c1644-bd09-4eda-8f05-1e91907cbb39-kube-api-access-cmhth\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysconfig\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee131199-02c0-49dc-b384-1826bec3c5ff-dbus\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-ovnkube-config\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-env-overrides\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405768 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405822 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee131199-02c0-49dc-b384-1826bec3c5ff-dbus\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-tmp-dir\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.406442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405880 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-modprobe-d\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405905 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-systemd-units\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405963 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27d9d21b-0638-49de-a49f-0b581389c01f-ovnkube-script-lib\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405967 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-systemd-units\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405989 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.405992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-slash\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406015 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-slash\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-systemd\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwtjm\" (UniqueName: \"kubernetes.io/projected/27d9d21b-0638-49de-a49f-0b581389c01f-kube-api-access-nwtjm\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-systemd\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f05ae80f-8cea-48fc-b6ad-5c9839a27761-cni-binary-copy\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-netns\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406125 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-tmp-dir\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gkcp\" (UniqueName: \"kubernetes.io/projected/f05ae80f-8cea-48fc-b6ad-5c9839a27761-kube-api-access-8gkcp\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406149 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88lw5\" (UniqueName: \"kubernetes.io/projected/37cc2f65-9786-4145-b647-f10c40c73699-kube-api-access-88lw5\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7334cf6d-90f0-42dd-bc33-aaa84db972c6-konnectivity-ca\") pod \"konnectivity-agent-hgrh6\" (UID: \"7334cf6d-90f0-42dd-bc33-aaa84db972c6\") " pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.407120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-sys-fs\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-kubernetes\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysctl-conf\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-systemd\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-lib-modules\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrl77\" (UniqueName: \"kubernetes.io/projected/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-kube-api-access-mrl77\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysctl-d\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-ovn\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-run-ovn\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27d9d21b-0638-49de-a49f-0b581389c01f-ovn-node-metrics-cert\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-multus-certs\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-socket-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-tmp\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7334cf6d-90f0-42dd-bc33-aaa84db972c6-konnectivity-ca\") pod \"konnectivity-agent-hgrh6\" (UID: \"7334cf6d-90f0-42dd-bc33-aaa84db972c6\") " pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.407724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-os-release\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cni-binary-copy\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-cnibin\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406765 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34d43d5e-3cf4-429f-a153-92362cdcdaa6-os-release\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-var-lib-kubelet\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee131199-02c0-49dc-b384-1826bec3c5ff-kubelet-config\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406879 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-run-netns\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406907 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee131199-02c0-49dc-b384-1826bec3c5ff-kubelet-config\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406910 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-hosts-file\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37cc2f65-9786-4145-b647-f10c40c73699-iptables-alerter-script\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406976 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-hosts-file\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.406995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-device-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d77f8c4-33ef-4d38-be34-d75e980a508c-serviceca\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407143 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27d9d21b-0638-49de-a49f-0b581389c01f-host-run-netns\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407184 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cni-binary-copy\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.408458 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8ss\" (UniqueName: \"kubernetes.io/projected/6d77f8c4-33ef-4d38-be34-d75e980a508c-kube-api-access-ct8ss\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.409416 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407317 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.409416 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407424 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34d43d5e-3cf4-429f-a153-92362cdcdaa6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.409416 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.407577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d77f8c4-33ef-4d38-be34-d75e980a508c-serviceca\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.409416 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.408334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7334cf6d-90f0-42dd-bc33-aaa84db972c6-agent-certs\") pod \"konnectivity-agent-hgrh6\" (UID: \"7334cf6d-90f0-42dd-bc33-aaa84db972c6\") " pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.409416 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.408525 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27d9d21b-0638-49de-a49f-0b581389c01f-ovn-node-metrics-cert\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.413870 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.413842 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr9zs\" (UniqueName: \"kubernetes.io/projected/34d43d5e-3cf4-429f-a153-92362cdcdaa6-kube-api-access-sr9zs\") pod \"multus-additional-cni-plugins-5frq2\" (UID: \"34d43d5e-3cf4-429f-a153-92362cdcdaa6\") " pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.414442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.414427 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrl77\" (UniqueName: \"kubernetes.io/projected/4adaeb64-a7e4-4f77-9df0-6c56ce5909a2-kube-api-access-mrl77\") pod \"node-resolver-2rnbd\" (UID: \"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2\") " pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.414521 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.414504 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwtjm\" (UniqueName: \"kubernetes.io/projected/27d9d21b-0638-49de-a49f-0b581389c01f-kube-api-access-nwtjm\") pod \"ovnkube-node-qqkpx\" (UID: \"27d9d21b-0638-49de-a49f-0b581389c01f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.415318 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.415298 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8ss\" (UniqueName: \"kubernetes.io/projected/6d77f8c4-33ef-4d38-be34-d75e980a508c-kube-api-access-ct8ss\") pod \"node-ca-lchd7\" (UID: \"6d77f8c4-33ef-4d38-be34-d75e980a508c\") " pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.508120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-kubelet\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-etc-kubernetes\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-host\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508235 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-host\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508235 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-kubelet\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-tuned\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-etc-kubernetes\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508290 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzg7\" (UniqueName: \"kubernetes.io/projected/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-kube-api-access-nbzg7\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.508332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-os-release\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-cni-bin\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-etc-selinux\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnmqz\" (UniqueName: \"kubernetes.io/projected/92c09588-5928-4c1d-bd02-fab0875d1829-kube-api-access-wnmqz\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-os-release\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508465 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-cni-bin\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508489 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-etc-selinux\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-cni-multus\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508564 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-conf-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-var-lib-cni-multus\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.508606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37cc2f65-9786-4145-b647-f10c40c73699-host-slash\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-socket-dir-parent\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508618 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-conf-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37cc2f65-9786-4145-b647-f10c40c73699-host-slash\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-k8s-cni-cncf-io\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-socket-dir-parent\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508673 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-k8s-cni-cncf-io\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-run\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-cni-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508712 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-run\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-registration-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-system-cni-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508772 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-registration-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-daemon-config\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhth\" (UniqueName: \"kubernetes.io/projected/034c1644-bd09-4eda-8f05-1e91907cbb39-kube-api-access-cmhth\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-cni-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508822 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-system-cni-dir\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysconfig\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysconfig\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-modprobe-d\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f05ae80f-8cea-48fc-b6ad-5c9839a27761-cni-binary-copy\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-netns\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gkcp\" (UniqueName: \"kubernetes.io/projected/f05ae80f-8cea-48fc-b6ad-5c9839a27761-kube-api-access-8gkcp\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lw5\" (UniqueName: \"kubernetes.io/projected/37cc2f65-9786-4145-b647-f10c40c73699-kube-api-access-88lw5\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509000 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-netns\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-sys-fs\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-kubernetes\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-sys-fs\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.508937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-modprobe-d\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysctl-conf\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-systemd\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-kubernetes\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-lib-modules\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.509901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509138 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysctl-d\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-multus-certs\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-socket-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysctl-conf\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-tmp\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-cnibin\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509272 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-lib-modules\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f05ae80f-8cea-48fc-b6ad-5c9839a27761-multus-daemon-config\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.509301 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-var-lib-kubelet\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509342 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-cnibin\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-host-run-multus-certs\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.509367 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:13.009348464 +0000 UTC m=+2.101156905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-var-lib-kubelet\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-systemd\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37cc2f65-9786-4145-b647-f10c40c73699-iptables-alerter-script\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.510384 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509403 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-sysctl-d\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-device-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-sys\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-socket-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-hostroot\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f05ae80f-8cea-48fc-b6ad-5c9839a27761-cni-binary-copy\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f05ae80f-8cea-48fc-b6ad-5c9839a27761-hostroot\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509593 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/034c1644-bd09-4eda-8f05-1e91907cbb39-device-dir\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-sys\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.510862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.509851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37cc2f65-9786-4145-b647-f10c40c73699-iptables-alerter-script\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.511159 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.511024 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-etc-tuned\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.511447 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.511433 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-tmp\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.515617 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.515590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzg7\" (UniqueName: \"kubernetes.io/projected/c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98-kube-api-access-nbzg7\") pod \"tuned-xkdrd\" (UID: \"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98\") " pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.515850 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.515835 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnmqz\" (UniqueName: \"kubernetes.io/projected/92c09588-5928-4c1d-bd02-fab0875d1829-kube-api-access-wnmqz\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:12.518693 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.518678 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhth\" (UniqueName: \"kubernetes.io/projected/034c1644-bd09-4eda-8f05-1e91907cbb39-kube-api-access-cmhth\") pod \"aws-ebs-csi-driver-node-96zpv\" (UID: \"034c1644-bd09-4eda-8f05-1e91907cbb39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.519931 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.519904 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:12.520025 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.519934 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:12.520025 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.519947 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:12.520025 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.520022 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:05:13.020004814 +0000 UTC m=+2.111813240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:12.522702 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.522682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gkcp\" (UniqueName: \"kubernetes.io/projected/f05ae80f-8cea-48fc-b6ad-5c9839a27761-kube-api-access-8gkcp\") pod \"multus-nqwkk\" (UID: \"f05ae80f-8cea-48fc-b6ad-5c9839a27761\") " pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.522778 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.522709 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88lw5\" (UniqueName: \"kubernetes.io/projected/37cc2f65-9786-4145-b647-f10c40c73699-kube-api-access-88lw5\") pod \"iptables-alerter-m4z6t\" (UID: \"37cc2f65-9786-4145-b647-f10c40c73699\") " pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.618016 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.617943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lchd7" Jun 05 21:05:12.623589 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.623563 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:12.623860 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.623829 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:12.630689 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.630664 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d9d21b_0638_49de_a49f_0b581389c01f.slice/crio-d733b3557f2577766b249a18e4ab1bf8fa42e0f789b44b9e7de324df115a132d WatchSource:0}: Error finding container d733b3557f2577766b249a18e4ab1bf8fa42e0f789b44b9e7de324df115a132d: Status 404 returned error can't find the container with id d733b3557f2577766b249a18e4ab1bf8fa42e0f789b44b9e7de324df115a132d Jun 05 21:05:12.650718 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.650694 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:12.655545 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.655527 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:12.659699 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.659685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5frq2" Jun 05 21:05:12.663039 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.663008 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7334cf6d_90f0_42dd_bc33_aaa84db972c6.slice/crio-94a6157696b1f5bfdef9f6183dcceb287670e0233bd9985153c45ef33b0692dc WatchSource:0}: Error finding container 94a6157696b1f5bfdef9f6183dcceb287670e0233bd9985153c45ef33b0692dc: Status 404 returned error can't find the container with id 94a6157696b1f5bfdef9f6183dcceb287670e0233bd9985153c45ef33b0692dc Jun 05 21:05:12.666926 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.666891 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d43d5e_3cf4_429f_a153_92362cdcdaa6.slice/crio-907f513603f542252cee8d39648af15b6e8a930abcc59bca1512bd74d168f821 WatchSource:0}: Error finding container 907f513603f542252cee8d39648af15b6e8a930abcc59bca1512bd74d168f821: Status 404 returned error can't find the container with id 907f513603f542252cee8d39648af15b6e8a930abcc59bca1512bd74d168f821 Jun 05 21:05:12.670892 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.670875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2rnbd" Jun 05 21:05:12.677555 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.677521 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nqwkk" Jun 05 21:05:12.678228 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.678203 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adaeb64_a7e4_4f77_9df0_6c56ce5909a2.slice/crio-79352db46cdc114624608bb9aa7fec6c3c983a6a015921e3ec82a1d0183917e8 WatchSource:0}: Error finding container 79352db46cdc114624608bb9aa7fec6c3c983a6a015921e3ec82a1d0183917e8: Status 404 returned error can't find the container with id 79352db46cdc114624608bb9aa7fec6c3c983a6a015921e3ec82a1d0183917e8 Jun 05 21:05:12.682723 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.682688 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" Jun 05 21:05:12.685306 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.685289 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05ae80f_8cea_48fc_b6ad_5c9839a27761.slice/crio-916f73bcd1bcfa2b6f1ff31ea665819bb6524a66978b02ffe284e61a032030c3 WatchSource:0}: Error finding container 916f73bcd1bcfa2b6f1ff31ea665819bb6524a66978b02ffe284e61a032030c3: Status 404 returned error can't find the container with id 916f73bcd1bcfa2b6f1ff31ea665819bb6524a66978b02ffe284e61a032030c3 Jun 05 21:05:12.688716 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.688700 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4z6t" Jun 05 21:05:12.690982 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.690956 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71fa1c7_1bd5_4b4f_96f7_e72a14d03a98.slice/crio-8a808bdb05b06dc18af1d9f68410a6a41143e360f2f901de6c9aa311b402084a WatchSource:0}: Error finding container 8a808bdb05b06dc18af1d9f68410a6a41143e360f2f901de6c9aa311b402084a: Status 404 returned error can't find the container with id 8a808bdb05b06dc18af1d9f68410a6a41143e360f2f901de6c9aa311b402084a Jun 05 21:05:12.692480 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.692464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" Jun 05 21:05:12.698049 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.698029 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cc2f65_9786_4145_b647_f10c40c73699.slice/crio-8147a9e350ed20f93438ff76ef9e2e652df08ab81ed59aa05bd5c0a980957905 WatchSource:0}: Error finding container 8147a9e350ed20f93438ff76ef9e2e652df08ab81ed59aa05bd5c0a980957905: Status 404 returned error can't find the container with id 8147a9e350ed20f93438ff76ef9e2e652df08ab81ed59aa05bd5c0a980957905 Jun 05 21:05:12.701794 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:12.701766 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034c1644_bd09_4eda_8f05_1e91907cbb39.slice/crio-81e45fd8f2cf71ac7c267881fdcc7e5cf8873e68ea9f213160110641fa741816 WatchSource:0}: Error finding container 81e45fd8f2cf71ac7c267881fdcc7e5cf8873e68ea9f213160110641fa741816: Status 404 returned error can't find the container with id 81e45fd8f2cf71ac7c267881fdcc7e5cf8873e68ea9f213160110641fa741816 Jun 05 21:05:12.912119 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:12.912087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:12.912290 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.912232 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:12.912350 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:12.912292 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:05:13.91227506 +0000 UTC m=+3.004083493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:13.012644 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.012607 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:13.012799 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.012782 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:13.012880 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.012854 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:14.012832648 +0000 UTC m=+3.104641096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:13.113635 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.113603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:13.113867 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.113848 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:13.114051 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.113873 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:13.114051 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.113886 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:13.114051 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.113961 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:05:14.113942311 +0000 UTC m=+3.205750750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:13.220642 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.220539 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:05:13.339324 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.338862 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:00:12 +0000 UTC" deadline="2027-11-14 15:17:17.426034834 +0000 UTC" Jun 05 21:05:13.339324 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.338936 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12642h12m4.087103599s" Jun 05 21:05:13.374144 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.373353 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:13.374144 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.373482 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:13.374144 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.373904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:13.374144 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.374030 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:13.414250 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.414130 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" event={"ID":"034c1644-bd09-4eda-8f05-1e91907cbb39","Type":"ContainerStarted","Data":"81e45fd8f2cf71ac7c267881fdcc7e5cf8873e68ea9f213160110641fa741816"} Jun 05 21:05:13.437618 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.437579 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4z6t" event={"ID":"37cc2f65-9786-4145-b647-f10c40c73699","Type":"ContainerStarted","Data":"8147a9e350ed20f93438ff76ef9e2e652df08ab81ed59aa05bd5c0a980957905"} Jun 05 21:05:13.454353 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.454305 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" event={"ID":"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98","Type":"ContainerStarted","Data":"8a808bdb05b06dc18af1d9f68410a6a41143e360f2f901de6c9aa311b402084a"} Jun 05 21:05:13.481762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.481624 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nqwkk" event={"ID":"f05ae80f-8cea-48fc-b6ad-5c9839a27761","Type":"ContainerStarted","Data":"916f73bcd1bcfa2b6f1ff31ea665819bb6524a66978b02ffe284e61a032030c3"} Jun 05 21:05:13.495086 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.495047 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2rnbd" event={"ID":"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2","Type":"ContainerStarted","Data":"79352db46cdc114624608bb9aa7fec6c3c983a6a015921e3ec82a1d0183917e8"} Jun 05 21:05:13.513025 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.512991 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerStarted","Data":"907f513603f542252cee8d39648af15b6e8a930abcc59bca1512bd74d168f821"} Jun 05 21:05:13.525353 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.525257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lchd7" event={"ID":"6d77f8c4-33ef-4d38-be34-d75e980a508c","Type":"ContainerStarted","Data":"e8828f2aa9b0ad173b587c5165a27dad7402bf103030f9d165ba867cbde726ac"} Jun 05 21:05:13.547481 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.547412 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgrh6" event={"ID":"7334cf6d-90f0-42dd-bc33-aaa84db972c6","Type":"ContainerStarted","Data":"94a6157696b1f5bfdef9f6183dcceb287670e0233bd9985153c45ef33b0692dc"} Jun 05 21:05:13.556581 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.556459 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"d733b3557f2577766b249a18e4ab1bf8fa42e0f789b44b9e7de324df115a132d"} Jun 05 21:05:13.921954 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:13.921850 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:13.922125 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.922066 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:13.922189 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:13.922131 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:05:15.92211338 +0000 UTC m=+5.013921807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:14.022956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:14.022903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:14.023164 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.023125 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:14.023243 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.023195 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:16.023173811 +0000 UTC m=+5.114982250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:14.123905 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:14.123856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:14.124126 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.124107 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:14.124195 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.124134 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:14.124195 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.124148 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:14.124317 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.124213 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:05:16.124194688 +0000 UTC m=+5.216003125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:14.339256 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:14.339137 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:00:12 +0000 UTC" deadline="2028-01-16 10:31:39.25747843 +0000 UTC" Jun 05 21:05:14.339256 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:14.339200 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14149h26m24.918282311s" Jun 05 21:05:14.371091 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:14.371059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:14.371268 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:14.371197 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:15.371541 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:15.371027 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:15.371541 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:15.371051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:15.371541 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:15.371154 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:15.371541 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:15.371292 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:15.938490 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:15.937967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:15.938490 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:15.938100 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:15.938490 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:15.938161 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:05:19.938142003 +0000 UTC m=+9.029950452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:16.038785 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:16.038722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:16.038971 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.038874 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:16.038971 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.038963 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:20.038942414 +0000 UTC m=+9.130750846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:16.141235 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:16.140546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:16.141235 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.140745 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:16.141235 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.140768 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:16.141235 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.140783 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:16.141235 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.140846 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:05:20.140825365 +0000 UTC m=+9.232633806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:16.371230 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:16.371157 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:16.371392 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:16.371296 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:17.373457 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:17.373302 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:17.373457 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:17.373308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:17.373457 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:17.373450 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:17.374544 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:17.374506 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:18.371391 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:18.371361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:18.371551 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:18.371496 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:19.371216 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:19.371182 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:19.371677 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:19.371305 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:19.371677 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:19.371191 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:19.371782 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:19.371728 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:19.970783 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:19.970737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:19.970958 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:19.970871 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:19.970958 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:19.970957 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:05:27.970936528 +0000 UTC m=+17.062744956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:20.071130 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:20.071086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:20.071313 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.071286 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:20.071387 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.071353 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:28.071333669 +0000 UTC m=+17.163142095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:20.172033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:20.171978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:20.172304 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.172219 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:20.172304 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.172242 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:20.172304 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.172257 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:20.172503 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.172322 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:05:28.17230415 +0000 UTC m=+17.264112575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:20.371253 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:20.371175 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:20.371645 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:20.371335 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:21.374342 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:21.372012 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:21.374342 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:21.372282 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:21.374871 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:21.374693 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:21.374946 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:21.374876 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:22.370807 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:22.370763 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:22.370997 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:22.370902 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:23.370898 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:23.370861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:23.371375 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:23.371036 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:23.371375 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:23.371123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:23.371375 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:23.371242 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:24.371026 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:24.370994 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:24.371466 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:24.371112 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:25.371766 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:25.371588 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:25.371766 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:25.371738 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:25.372259 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:25.371787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:25.372259 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:25.371927 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:26.371729 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:26.371519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:26.371729 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:26.371644 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:27.371694 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:27.371661 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:27.371889 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:27.371670 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:27.371889 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:27.371769 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:27.371889 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:27.371876 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:28.037324 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:28.037287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:28.037529 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.037408 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:28.037529 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.037478 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:05:44.037459235 +0000 UTC m=+33.129267664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:28.137945 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:28.137865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:28.138108 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.138050 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:28.138170 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.138125 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:44.138104645 +0000 UTC m=+33.229913070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:28.238599 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:28.238566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:28.238753 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.238735 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:28.238820 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.238762 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:28.238820 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.238777 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:28.238978 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.238838 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:05:44.238820783 +0000 UTC m=+33.330629215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:28.371008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:28.370980 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:28.371165 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:28.371087 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:29.371347 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:29.371317 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:29.371735 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:29.371438 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:29.371735 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:29.371519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:29.371735 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:29.371618 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:30.370741 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:30.370704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:30.370955 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:30.370830 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:31.371649 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:31.371252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:31.371649 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:31.371352 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:31.371649 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:31.371400 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:31.371649 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:31.371528 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:32.371013 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:32.370987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:32.371148 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:32.371080 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:33.371569 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.370938 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:33.371569 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:33.371245 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:33.372260 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.371678 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:33.372260 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:33.371775 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:33.598414 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.597526 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" event={"ID":"04c5343738b2a5e9259847f1e464ce4d","Type":"ContainerStarted","Data":"7023b6fd1bb4b7ff04cf4a8e12f8349f5a1599fc5ca66a027a2f76c972135163"} Jun 05 21:05:33.599553 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.599507 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" event={"ID":"c71fa1c7-1bd5-4b4f-96f7-e72a14d03a98","Type":"ContainerStarted","Data":"aad9d0acd2dc69491e650c6e11cd3c706941738f2f82223883440d740a44d8a0"} Jun 05 21:05:33.601446 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.601423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nqwkk" event={"ID":"f05ae80f-8cea-48fc-b6ad-5c9839a27761","Type":"ContainerStarted","Data":"f0bada68595cc0a39fb54684342712ff3e5f0ba3b5c67a5f564a29154fece09d"} Jun 05 21:05:33.603567 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.603551 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:05:33.603888 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.603869 2560 generic.go:356] "Generic (PLEG): container finished" podID="27d9d21b-0638-49de-a49f-0b581389c01f" containerID="3fffd1fad6194063114b8db4b53e7e692afb715ea5c3862354bc3b286ab400a7" exitCode=1 Jun 05 21:05:33.604046 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.603899 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"bd551212457344d40d9aa17c74a85556d3d60842461637808df2839a05b22a62"} Jun 05 21:05:33.604046 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.603985 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerDied","Data":"3fffd1fad6194063114b8db4b53e7e692afb715ea5c3862354bc3b286ab400a7"} Jun 05 21:05:33.604046 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.604039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"23f0e783586b916a4dfb56e36157ddbfc4baf0039a05fad3fb6da6659de83187"} Jun 05 21:05:33.611092 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.610856 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" podStartSLOduration=21.610839882 podStartE2EDuration="21.610839882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:33.609828077 +0000 UTC m=+22.701636525" watchObservedRunningTime="2026-06-05 21:05:33.610839882 +0000 UTC m=+22.702648328" Jun 05 21:05:33.625286 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.623952 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nqwkk" podStartSLOduration=2.813087327 podStartE2EDuration="22.623907136s" totalImagesPullingTime="19.810819809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:33.623886516 +0000 UTC m=+22.715694964" watchObservedRunningTime="2026-06-05 21:05:33.623907136 +0000 UTC m=+22.715715582" Jun 05 21:05:33.637735 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:33.637695 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xkdrd" podStartSLOduration=2.866500052 podStartE2EDuration="22.637681975s" totalImagesPullingTime="19.771181923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:33.637607336 +0000 UTC m=+22.729415797" watchObservedRunningTime="2026-06-05 21:05:33.637681975 +0000 UTC m=+22.729490422" Jun 05 21:05:34.370956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.370784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:34.371135 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:34.371031 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:34.606876 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.606841 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" event={"ID":"034c1644-bd09-4eda-8f05-1e91907cbb39","Type":"ContainerStarted","Data":"8618992b77248e8484a7caa284ac3849ae96b3a7998a8700b0e406731b374547"} Jun 05 21:05:34.608243 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.608221 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4z6t" event={"ID":"37cc2f65-9786-4145-b647-f10c40c73699","Type":"ContainerStarted","Data":"786416fc33cdfb05aa486d8f35ea08e6d4b51704819e8641207b3e146981e83c"} Jun 05 21:05:34.609494 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.609474 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2rnbd" event={"ID":"4adaeb64-a7e4-4f77-9df0-6c56ce5909a2","Type":"ContainerStarted","Data":"1c7199b113dc3c10c7a3a879f481be02f88c8aee271b1d2b9c41dc24c59ccd58"} Jun 05 21:05:34.610905 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.610883 2560 generic.go:356] "Generic (PLEG): container finished" podID="34d43d5e-3cf4-429f-a153-92362cdcdaa6" containerID="96e27dc0aab262da993a9caec775988f8c634ad61bd32301ce8922df7b4d70d9" exitCode=0 Jun 05 21:05:34.611016 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.610952 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerDied","Data":"96e27dc0aab262da993a9caec775988f8c634ad61bd32301ce8922df7b4d70d9"} Jun 05 21:05:34.612375 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.612350 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lchd7" event={"ID":"6d77f8c4-33ef-4d38-be34-d75e980a508c","Type":"ContainerStarted","Data":"60af87a66750c8ee00f3a476c99d7d2e20cb5f478f790c62497dc0dd2a44f7b4"} Jun 05 21:05:34.613894 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.613876 2560 generic.go:356] "Generic (PLEG): container finished" podID="886cd1bbe2accfd6caf097fb80ff4fef" containerID="2c35f2ccfe7011ebd43866bd338419364bd3a70ccad192fec66a64d159a19399" exitCode=0 Jun 05 21:05:34.613989 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.613948 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" event={"ID":"886cd1bbe2accfd6caf097fb80ff4fef","Type":"ContainerDied","Data":"2c35f2ccfe7011ebd43866bd338419364bd3a70ccad192fec66a64d159a19399"} Jun 05 21:05:34.615322 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.615277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgrh6" event={"ID":"7334cf6d-90f0-42dd-bc33-aaa84db972c6","Type":"ContainerStarted","Data":"f971843c1a63c1931cff70a62c4b4b95dbd31ad0620aca63538db2eff4c4f163"} Jun 05 21:05:34.618016 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.617999 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:05:34.618408 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.618391 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"8dd94e9c572518a723846d6dbd680a846dacf24b8ed5db0bbe4efc96a55963f3"} Jun 05 21:05:34.618467 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.618446 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"4aa130a19c9cb6a43594025398160c5a2bcf89a2e52c18ac3d04a19901b83f88"} Jun 05 21:05:34.618502 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.618476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"264e0cebafffd1e638841db84c34cb1810096a5cc14ca3c130bed2eb2e465508"} Jun 05 21:05:34.621402 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.621332 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m4z6t" podStartSLOduration=3.826287842 podStartE2EDuration="23.621321703s" totalImagesPullingTime="19.795033861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:34.621291751 +0000 UTC m=+23.713100199" watchObservedRunningTime="2026-06-05 21:05:34.621321703 +0000 UTC m=+23.713130150" Jun 05 21:05:34.645805 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.645766 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hgrh6" podStartSLOduration=4.189241406 podStartE2EDuration="23.645757939s" totalImagesPullingTime="19.456516533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:34.645662541 +0000 UTC m=+23.737470987" watchObservedRunningTime="2026-06-05 21:05:34.645757939 +0000 UTC m=+23.737566385" Jun 05 21:05:34.670539 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.670371 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2rnbd" podStartSLOduration=4.229093736 podStartE2EDuration="23.670358005s" totalImagesPullingTime="19.441264269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:34.657866385 +0000 UTC m=+23.749674835" watchObservedRunningTime="2026-06-05 21:05:34.670358005 +0000 UTC m=+23.762166452" Jun 05 21:05:34.670539 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.670486 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lchd7" podStartSLOduration=4.177512007 podStartE2EDuration="23.670474686s" totalImagesPullingTime="19.492962679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:34.669949375 +0000 UTC m=+23.761757818" watchObservedRunningTime="2026-06-05 21:05:34.670474686 +0000 UTC m=+23.762283134" Jun 05 21:05:34.945142 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:34.945122 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 21:05:35.224017 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.223948 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:35.224426 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.224410 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:35.365596 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.365506 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T21:05:34.945138664Z","UUID":"3f7e3a54-3f3f-459c-a54f-3cd3ff10cdf6","Handler":null,"Name":"","Endpoint":""} Jun 05 21:05:35.366888 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.366856 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 21:05:35.366888 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.366891 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 21:05:35.371245 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.371223 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:35.371347 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:35.371318 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:35.371434 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.371417 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:35.371547 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:35.371529 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:35.623081 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.623050 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" event={"ID":"034c1644-bd09-4eda-8f05-1e91907cbb39","Type":"ContainerStarted","Data":"508040ee2951c4a8a70ff75ee25b562f60a377f86e15b7c63c7e9b1acb186883"} Jun 05 21:05:35.625126 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.625093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" event={"ID":"886cd1bbe2accfd6caf097fb80ff4fef","Type":"ContainerStarted","Data":"715d445aa1e22cc3d59591668e96f893082e103ebc7a09547e48e4c256778867"} Jun 05 21:05:35.625749 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.625724 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:35.626225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.626207 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hgrh6" Jun 05 21:05:35.644473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:35.644420 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" podStartSLOduration=23.644401761 podStartE2EDuration="23.644401761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:35.643255109 +0000 UTC m=+24.735063559" watchObservedRunningTime="2026-06-05 21:05:35.644401761 +0000 UTC m=+24.736210211" Jun 05 21:05:36.370743 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:36.370668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:36.370891 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:36.370810 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:36.630365 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:36.630267 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" event={"ID":"034c1644-bd09-4eda-8f05-1e91907cbb39","Type":"ContainerStarted","Data":"54f7d421d76df695a70b1bd7e4fd162ecd8c44cf1730925bf5e9ef7798bf74b0"} Jun 05 21:05:36.633859 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:36.633828 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:05:36.634206 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:36.634184 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"a0b5d6f0bb7371b03d17b931e6d1adc3300a9a30fc018fceda46840d1b70c910"} Jun 05 21:05:36.646343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:36.646302 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96zpv" podStartSLOduration=3.634790385 podStartE2EDuration="25.646289863s" totalImagesPullingTime="22.011499478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:36.646038792 +0000 UTC m=+25.737847239" watchObservedRunningTime="2026-06-05 21:05:36.646289863 +0000 UTC m=+25.738098310" Jun 05 21:05:37.371489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:37.371272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:37.371666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:37.371272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:37.371666 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:37.371617 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:37.371788 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:37.371734 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:38.370644 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:38.370618 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:38.371041 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:38.370715 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:39.370537 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.370514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:39.370646 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.370514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:39.370646 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:39.370617 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:39.370979 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:39.370735 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:39.643276 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.643237 2560 generic.go:356] "Generic (PLEG): container finished" podID="34d43d5e-3cf4-429f-a153-92362cdcdaa6" containerID="f8baca815a6baf17abfc481847adfe79be0b380a90334ff38310dd358f938eae" exitCode=0 Jun 05 21:05:39.643418 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.643323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerDied","Data":"f8baca815a6baf17abfc481847adfe79be0b380a90334ff38310dd358f938eae"} Jun 05 21:05:39.646847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.646832 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:05:39.647202 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.647180 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"88e574e12195b7ec2a3240ddb35c222356368b101c413aedcbb21568c3e4c215"} Jun 05 21:05:39.647492 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.647474 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:39.647560 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.647535 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:39.647607 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.647584 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:39.647672 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.647651 2560 scope.go:117] "RemoveContainer" containerID="3fffd1fad6194063114b8db4b53e7e692afb715ea5c3862354bc3b286ab400a7" Jun 05 21:05:39.664430 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.664413 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:39.664596 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:39.664578 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:05:40.371167 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:40.371003 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:40.371627 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:40.371245 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:40.653192 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:40.653125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:05:40.653474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:40.653450 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" event={"ID":"27d9d21b-0638-49de-a49f-0b581389c01f","Type":"ContainerStarted","Data":"bde962f2e802a4a692b12b5331111e4004fae8c67e6c84acadb9a77e475e7789"} Jun 05 21:05:40.679440 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:40.679388 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" podStartSLOduration=9.202607889 podStartE2EDuration="29.679373067s" totalImagesPullingTime="20.476765178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:40.679174752 +0000 UTC m=+29.770983215" watchObservedRunningTime="2026-06-05 21:05:40.679373067 +0000 UTC m=+29.771181514" Jun 05 21:05:41.218957 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.218865 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2wd6"] Jun 05 21:05:41.219080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.218969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:41.219080 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:41.219047 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:41.223801 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.223769 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrqkw"] Jun 05 21:05:41.223938 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.223880 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:41.224041 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:41.224018 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:41.224433 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.224410 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqkxx"] Jun 05 21:05:41.224527 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.224518 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:41.224641 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:41.224624 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:41.657592 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.657555 2560 generic.go:356] "Generic (PLEG): container finished" podID="34d43d5e-3cf4-429f-a153-92362cdcdaa6" containerID="1588f215df0342654ea5d08faee76b7c7239dbc64103509e0f103a11e8f6e27e" exitCode=0 Jun 05 21:05:41.658257 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:41.657640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerDied","Data":"1588f215df0342654ea5d08faee76b7c7239dbc64103509e0f103a11e8f6e27e"} Jun 05 21:05:42.370556 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:42.370528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:42.370690 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:42.370632 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:42.665715 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:42.665685 2560 generic.go:356] "Generic (PLEG): container finished" podID="34d43d5e-3cf4-429f-a153-92362cdcdaa6" containerID="e93e2dedc7b8201a21b39fdce2da976a6121b6494a471c4a25ae2117e5554d05" exitCode=0 Jun 05 21:05:42.666273 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:42.665739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerDied","Data":"e93e2dedc7b8201a21b39fdce2da976a6121b6494a471c4a25ae2117e5554d05"} Jun 05 21:05:43.371605 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:43.371533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:43.371741 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:43.371533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:43.371741 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:43.371642 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:43.371741 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:43.371705 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:44.059095 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:44.058868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:44.059492 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.059010 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:44.059492 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.059174 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret podName:ee131199-02c0-49dc-b384-1826bec3c5ff nodeName:}" failed. No retries permitted until 2026-06-05 21:06:16.05915739 +0000 UTC m=+65.150965815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret") pod "global-pull-secret-syncer-d2wd6" (UID: "ee131199-02c0-49dc-b384-1826bec3c5ff") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:05:44.159702 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:44.159667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:44.159994 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.159974 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:44.160150 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.160131 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:06:16.160107186 +0000 UTC m=+65.251915624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:05:44.260429 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:44.260393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:44.260671 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.260523 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:05:44.260671 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.260540 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:05:44.260671 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.260551 2560 projected.go:196] Error preparing data for projected volume kube-api-access-cz74w for pod openshift-network-diagnostics/network-check-target-jrqkw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:44.260671 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.260606 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w podName:c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b nodeName:}" failed. No retries permitted until 2026-06-05 21:06:16.260589337 +0000 UTC m=+65.352397779 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cz74w" (UniqueName: "kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w") pod "network-check-target-jrqkw" (UID: "c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:05:44.371589 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:44.371514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:44.371740 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:44.371618 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:45.371614 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:45.371579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:45.371614 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:45.371606 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:45.372251 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:45.371720 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2wd6" podUID="ee131199-02c0-49dc-b384-1826bec3c5ff" Jun 05 21:05:45.372251 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:45.371858 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:05:46.370743 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.370713 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:46.370875 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:46.370851 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrqkw" podUID="c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b" Jun 05 21:05:46.695435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.695354 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeReady" Jun 05 21:05:46.695829 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.695526 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 21:05:46.726169 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.726124 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b57f48f6-qzfgx"] Jun 05 21:05:46.747209 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.747184 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b57f48f6-qzfgx"] Jun 05 21:05:46.747209 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.747219 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hrh6l"] Jun 05 21:05:46.747399 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.747310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.750669 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.749723 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 21:05:46.750937 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.750900 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 21:05:46.751031 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.751007 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v8s2r\"" Jun 05 21:05:46.751764 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.751744 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 21:05:46.756857 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.756834 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 21:05:46.767308 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.767287 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6h5db"] Jun 05 21:05:46.767431 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.767405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.769720 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.769701 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 21:05:46.769912 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.769880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 21:05:46.769912 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.769948 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zr9h5\"" Jun 05 21:05:46.791630 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.791605 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6h5db"] Jun 05 21:05:46.791630 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.791634 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hrh6l"] Jun 05 21:05:46.791802 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.791743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:46.794179 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.794153 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 21:05:46.794266 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.794208 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 21:05:46.794266 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.794216 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6g4pq\"" Jun 05 21:05:46.794454 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.794442 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 21:05:46.878703 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9168ed4-c7e2-450f-ae4f-d059945630bc-cert\") pod \"ingress-canary-6h5db\" (UID: \"f9168ed4-c7e2-450f-ae4f-d059945630bc\") " pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:46.878871 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878709 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.878871 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-tmp-dir\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.878871 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchll\" (UniqueName: \"kubernetes.io/projected/f9168ed4-c7e2-450f-ae4f-d059945630bc-kube-api-access-hchll\") pod \"ingress-canary-6h5db\" (UID: \"f9168ed4-c7e2-450f-ae4f-d059945630bc\") " pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:46.878871 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-image-registry-private-configuration\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878940 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860b2e64-1542-40fb-b601-3961f176532a-ca-trust-extracted\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-registry-certificates\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-config-volume\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.878994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-bound-sa-token\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.879010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk28x\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-kube-api-access-sk28x\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.879028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49tdz\" (UniqueName: \"kubernetes.io/projected/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-kube-api-access-49tdz\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.879291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.879091 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-trusted-ca\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.879291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.879112 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-installation-pull-secrets\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.881943 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.881908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:46.962335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.962262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:46.979756 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.979731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860b2e64-1542-40fb-b601-3961f176532a-ca-trust-extracted\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.979756 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.979761 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-registry-certificates\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.979980 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.979785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-config-volume\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.979980 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.979803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-bound-sa-token\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.979980 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.979819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk28x\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-kube-api-access-sk28x\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.979980 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.979839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49tdz\" (UniqueName: \"kubernetes.io/projected/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-kube-api-access-49tdz\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.980189 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-trusted-ca\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980189 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-installation-pull-secrets\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980189 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980138 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9168ed4-c7e2-450f-ae4f-d059945630bc-cert\") pod \"ingress-canary-6h5db\" (UID: \"f9168ed4-c7e2-450f-ae4f-d059945630bc\") " pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:46.980189 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.980380 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980189 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860b2e64-1542-40fb-b601-3961f176532a-ca-trust-extracted\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980380 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-tmp-dir\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.980380 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hchll\" (UniqueName: \"kubernetes.io/projected/f9168ed4-c7e2-450f-ae4f-d059945630bc-kube-api-access-hchll\") pod \"ingress-canary-6h5db\" (UID: \"f9168ed4-c7e2-450f-ae4f-d059945630bc\") " pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:46.980380 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980380 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-image-registry-private-configuration\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-registry-certificates\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-config-volume\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.980666 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:46.980532 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:05:46.980666 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:46.980615 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:47.480598819 +0000 UTC m=+36.572407258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:05:46.980666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-tmp-dir\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.980906 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:46.980834 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:05:46.980906 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.980860 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-trusted-ca\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.980906 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:46.980871 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:05:46.981044 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:46.980943 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:05:47.480906819 +0000 UTC m=+36.572715245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:05:46.984298 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.984274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-image-registry-private-configuration\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.984552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.984531 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-installation-pull-secrets\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.984552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.984541 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9168ed4-c7e2-450f-ae4f-d059945630bc-cert\") pod \"ingress-canary-6h5db\" (UID: \"f9168ed4-c7e2-450f-ae4f-d059945630bc\") " pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:46.990975 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.990950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49tdz\" (UniqueName: \"kubernetes.io/projected/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-kube-api-access-49tdz\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:46.991128 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.991110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk28x\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-kube-api-access-sk28x\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.991342 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.991325 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-bound-sa-token\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:46.991342 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:46.991333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchll\" (UniqueName: \"kubernetes.io/projected/f9168ed4-c7e2-450f-ae4f-d059945630bc-kube-api-access-hchll\") pod \"ingress-canary-6h5db\" (UID: \"f9168ed4-c7e2-450f-ae4f-d059945630bc\") " pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:47.099908 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.099872 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6h5db" Jun 05 21:05:47.298396 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.298363 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6h5db"] Jun 05 21:05:47.301717 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:05:47.301694 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9168ed4_c7e2_450f_ae4f_d059945630bc.slice/crio-357a4ec64c3c4be662e3244cc52f188737c95945ac5cd022953a33e99457484d WatchSource:0}: Error finding container 357a4ec64c3c4be662e3244cc52f188737c95945ac5cd022953a33e99457484d: Status 404 returned error can't find the container with id 357a4ec64c3c4be662e3244cc52f188737c95945ac5cd022953a33e99457484d Jun 05 21:05:47.371293 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.371128 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:05:47.371420 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.371204 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:05:47.373728 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.373706 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nklfc\"" Jun 05 21:05:47.373855 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.373749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:05:47.373855 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.373760 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:05:47.483437 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.483357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:47.483437 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.483393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:47.483609 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:47.483511 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:05:47.483609 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:47.483522 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:05:47.483609 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:47.483564 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:05:48.483551846 +0000 UTC m=+37.575360283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:05:47.483609 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:47.483601 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:05:47.483769 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:47.483664 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:48.48364803 +0000 UTC m=+37.575456456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:05:47.681607 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.681572 2560 generic.go:356] "Generic (PLEG): container finished" podID="34d43d5e-3cf4-429f-a153-92362cdcdaa6" containerID="faa8dac5e613204aebd45bf271de920b44db2f2d146bfdf61ba44fecb947ccc7" exitCode=0 Jun 05 21:05:47.681759 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.681654 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerDied","Data":"faa8dac5e613204aebd45bf271de920b44db2f2d146bfdf61ba44fecb947ccc7"} Jun 05 21:05:47.682627 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:47.682610 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6h5db" event={"ID":"f9168ed4-c7e2-450f-ae4f-d059945630bc","Type":"ContainerStarted","Data":"357a4ec64c3c4be662e3244cc52f188737c95945ac5cd022953a33e99457484d"} Jun 05 21:05:48.371580 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.371553 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:05:48.374082 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.374059 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:05:48.374849 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.374826 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrxkp\"" Jun 05 21:05:48.375001 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.374827 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:05:48.491358 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.491329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:48.491531 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.491371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:48.491531 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:48.491501 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:05:48.491642 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:48.491580 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:50.491559871 +0000 UTC m=+39.583368311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:05:48.491642 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:48.491506 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:05:48.491642 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:48.491615 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:05:48.491793 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:48.491693 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:05:50.491674177 +0000 UTC m=+39.583482603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:05:48.687422 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.687337 2560 generic.go:356] "Generic (PLEG): container finished" podID="34d43d5e-3cf4-429f-a153-92362cdcdaa6" containerID="d7a104d98d5cacc24278bf5134e03e0aa94b9baf8aeadc5a7a2e23605b48916d" exitCode=0 Jun 05 21:05:48.687422 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:48.687390 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerDied","Data":"d7a104d98d5cacc24278bf5134e03e0aa94b9baf8aeadc5a7a2e23605b48916d"} Jun 05 21:05:49.692988 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:49.692954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5frq2" event={"ID":"34d43d5e-3cf4-429f-a153-92362cdcdaa6","Type":"ContainerStarted","Data":"c46b98dbd5c59594b7894a77112aabbc4921037e042eacda8b130b021fbf12f6"} Jun 05 21:05:49.694497 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:49.694476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6h5db" event={"ID":"f9168ed4-c7e2-450f-ae4f-d059945630bc","Type":"ContainerStarted","Data":"c56756a3c9de40312e55c861499577e3677abad7e8d80fed6cf67bcc128fa19b"} Jun 05 21:05:49.714141 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:49.714096 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5frq2" podStartSLOduration=8.077496865 podStartE2EDuration="38.714081988s" totalImagesPullingTime="30.636585123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:49.713076008 +0000 UTC m=+38.804884454" watchObservedRunningTime="2026-06-05 21:05:49.714081988 +0000 UTC m=+38.805890435" Jun 05 21:05:49.727039 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:49.726987 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6h5db" podStartSLOduration=1.499964509 podStartE2EDuration="3.726968887s" totalImagesPullingTime="2.227004378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:05:49.726434681 +0000 UTC m=+38.818243129" watchObservedRunningTime="2026-06-05 21:05:49.726968887 +0000 UTC m=+38.818777334" Jun 05 21:05:49.839051 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:49.838965 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:49.894564 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:49.894534 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:50.508997 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:50.508959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:50.508997 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:50.509001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:50.509207 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:50.509104 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:05:50.509207 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:50.509117 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:05:50.509207 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:50.509163 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:05:54.509148948 +0000 UTC m=+43.600957386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:05:50.509207 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:50.509104 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:05:50.509339 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:50.509245 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:05:54.509229612 +0000 UTC m=+43.601038036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:05:50.806252 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:50.806038 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:50.856629 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:50.856596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:53.576821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:53.576790 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:53.627544 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:53.627515 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:54.535502 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:54.535463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:05:54.535502 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:54.535505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:05:54.535750 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:54.535629 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:05:54.535750 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:54.535640 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:05:54.535750 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:54.535663 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:05:54.535750 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:54.535692 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:02.535678417 +0000 UTC m=+51.627486842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:05:54.535750 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:05:54.535726 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:06:02.535707246 +0000 UTC m=+51.627515689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:05:56.770581 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:56.770546 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:56.870305 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:56.870268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.476559 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:57.476527 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.576799 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:57.576763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.718665 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:57.718631 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.819334 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:57.819303 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.920443 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:57.920406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:58.020697 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:58.020664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:58.333213 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:58.333180 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:58.762953 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:58.762849 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:58.810897 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:05:58.810867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:00.700973 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:00.700942 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:02.591595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:02.591556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:06:02.591595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:02.591598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:06:02.592094 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:02.591694 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:02.592094 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:02.591705 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:06:02.592094 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:02.591721 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:06:02.592094 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:02.591749 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:06:18.59173589 +0000 UTC m=+67.683544315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:06:02.592094 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:02.591769 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:18.591755157 +0000 UTC m=+67.683563591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:06:10.039831 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:10.039796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:10.087168 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:10.087136 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:11.672451 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:11.672423 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqkpx" Jun 05 21:06:11.819708 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:11.819669 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:11.920096 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:11.920062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:12.020817 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:12.020746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:12.076737 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:12.076707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:15.045182 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:15.045151 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:15.093872 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:15.093847 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:16.086606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.086550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:06:16.089449 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.089432 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:06:16.100355 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.100332 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee131199-02c0-49dc-b384-1826bec3c5ff-original-pull-secret\") pod \"global-pull-secret-syncer-d2wd6\" (UID: \"ee131199-02c0-49dc-b384-1826bec3c5ff\") " pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:06:16.181735 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.181692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2wd6" Jun 05 21:06:16.187546 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.187522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:06:16.189904 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.189885 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:06:16.198753 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:16.198733 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:06:16.198846 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:16.198797 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:07:20.198778302 +0000 UTC m=+129.290586730 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : secret "metrics-daemon-secret" not found Jun 05 21:06:16.288801 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.288769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:06:16.290933 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.290902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:06:16.308692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.308624 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2wd6"] Jun 05 21:06:16.308692 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:06:16.308635 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee131199_02c0_49dc_b384_1826bec3c5ff.slice/crio-9dfca72419dc69a5b3d8c74b9fbef793e050c4747f9b2e8445a0f1e52ba49eb3 WatchSource:0}: Error finding container 9dfca72419dc69a5b3d8c74b9fbef793e050c4747f9b2e8445a0f1e52ba49eb3: Status 404 returned error can't find the container with id 9dfca72419dc69a5b3d8c74b9fbef793e050c4747f9b2e8445a0f1e52ba49eb3 Jun 05 21:06:16.320036 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.320010 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:06:16.331322 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.331302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz74w\" (UniqueName: \"kubernetes.io/projected/c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b-kube-api-access-cz74w\") pod \"network-check-target-jrqkw\" (UID: \"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b\") " pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:06:16.584696 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.584672 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrxkp\"" Jun 05 21:06:16.592552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.592528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:06:16.705824 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.705795 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrqkw"] Jun 05 21:06:16.709143 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:06:16.709117 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f76c9d_bc0f_4e4b_9c2a_7cb6a973ce2b.slice/crio-fe750be21527e790d549d7ff1a4d6bca73985d938ac8f506209166e31a8f00d5 WatchSource:0}: Error finding container fe750be21527e790d549d7ff1a4d6bca73985d938ac8f506209166e31a8f00d5: Status 404 returned error can't find the container with id fe750be21527e790d549d7ff1a4d6bca73985d938ac8f506209166e31a8f00d5 Jun 05 21:06:16.759126 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.759100 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2wd6" event={"ID":"ee131199-02c0-49dc-b384-1826bec3c5ff","Type":"ContainerStarted","Data":"9dfca72419dc69a5b3d8c74b9fbef793e050c4747f9b2e8445a0f1e52ba49eb3"} Jun 05 21:06:16.760098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:16.760073 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrqkw" event={"ID":"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b","Type":"ContainerStarted","Data":"fe750be21527e790d549d7ff1a4d6bca73985d938ac8f506209166e31a8f00d5"} Jun 05 21:06:18.604867 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:18.604826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:06:18.605343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:18.604893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:06:18.605343 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:18.604974 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:18.605343 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:18.605048 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:06:50.605026025 +0000 UTC m=+99.696834452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:06:18.605343 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:18.605084 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:06:18.605343 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:18.605099 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:06:18.605343 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:18.605147 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:06:50.605132509 +0000 UTC m=+99.696940954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:06:19.359936 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:19.359892 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:19.407640 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:19.407604 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:21.776603 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:21.776568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrqkw" event={"ID":"c2f76c9d-bc0f-4e4b-9c2a-7cb6a973ce2b","Type":"ContainerStarted","Data":"3f116537a52d72c46c3da73a1d09bd2b04affb0e44ca6ac5fa595086a16c1876"} Jun 05 21:06:21.777064 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:21.776681 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:06:21.778048 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:21.778028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2wd6" event={"ID":"ee131199-02c0-49dc-b384-1826bec3c5ff","Type":"ContainerStarted","Data":"736e3834e7ddb280105d9c0a1d9d2dc71ae447c19e29a567fc74a0916f868144"} Jun 05 21:06:21.790165 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:21.790125 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jrqkw" podStartSLOduration=66.282344723 podStartE2EDuration="1m10.790112933s" totalImagesPullingTime="4.50776821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:21.789734686 +0000 UTC m=+70.881543131" watchObservedRunningTime="2026-06-05 21:06:21.790112933 +0000 UTC m=+70.881921401" Jun 05 21:06:21.802556 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:21.802518 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d2wd6" podStartSLOduration=65.902279708 podStartE2EDuration="1m10.802509669s" totalImagesPullingTime="4.900229961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:06:21.801964257 +0000 UTC m=+70.893772702" watchObservedRunningTime="2026-06-05 21:06:21.802509669 +0000 UTC m=+70.894318109" Jun 05 21:06:36.790794 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:36.790633 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:36.891959 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:36.891911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:36.961613 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:36.961582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:50.635465 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:50.635428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:06:50.635791 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:50.635474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:06:50.635791 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:50.635593 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:06:50.635791 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:50.635606 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:06:50.635791 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:50.635618 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:06:50.635791 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:50.635666 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:07:54.635645442 +0000 UTC m=+163.727453893 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:06:50.635791 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:06:50.635682 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:07:54.635675574 +0000 UTC m=+163.727484002 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:06:52.782630 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:06:52.782600 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jrqkw" Jun 05 21:07:20.245582 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:07:20.245537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:07:20.246106 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:20.245695 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:07:20.246106 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:20.245763 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs podName:92c09588-5928-4c1d-bd02-fab0875d1829 nodeName:}" failed. No retries permitted until 2026-06-05 21:09:22.245747653 +0000 UTC m=+251.337556079 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs") pod "network-metrics-daemon-qqkxx" (UID: "92c09588-5928-4c1d-bd02-fab0875d1829") : secret "metrics-daemon-secret" not found Jun 05 21:07:49.760803 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:49.760753 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" podUID="860b2e64-1542-40fb-b601-3961f176532a" Jun 05 21:07:49.775990 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:49.775954 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hrh6l" podUID="dc1f1707-6f58-4b7f-a6cd-adc845cbb816" Jun 05 21:07:49.987564 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:07:49.987533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hrh6l" Jun 05 21:07:50.386724 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:50.386688 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qqkxx" podUID="92c09588-5928-4c1d-bd02-fab0875d1829" Jun 05 21:07:54.683578 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:07:54.683526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:07:54.683578 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:07:54.683578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:07:54.684110 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:54.683681 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:07:54.684110 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:54.683696 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b57f48f6-qzfgx: secret "image-registry-tls" not found Jun 05 21:07:54.684110 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:54.683680 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:07:54.684110 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:54.683758 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls podName:860b2e64-1542-40fb-b601-3961f176532a nodeName:}" failed. No retries permitted until 2026-06-05 21:09:56.683741196 +0000 UTC m=+285.775549621 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls") pod "image-registry-64b57f48f6-qzfgx" (UID: "860b2e64-1542-40fb-b601-3961f176532a") : secret "image-registry-tls" not found Jun 05 21:07:54.684110 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:07:54.683770 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls podName:dc1f1707-6f58-4b7f-a6cd-adc845cbb816 nodeName:}" failed. No retries permitted until 2026-06-05 21:09:56.683764583 +0000 UTC m=+285.775573008 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls") pod "dns-default-hrh6l" (UID: "dc1f1707-6f58-4b7f-a6cd-adc845cbb816") : secret "dns-default-metrics-tls" not found Jun 05 21:08:00.371014 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:00.370960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:08:01.371931 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:01.371888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:08:05.445245 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:05.445209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:25.615330 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.615289 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q"] Jun 05 21:08:25.617610 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.617586 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.618641 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.618615 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf"] Jun 05 21:08:25.620237 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620214 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 21:08:25.620353 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620253 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.620498 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 21:08:25.620706 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620686 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6x4x2\"" Jun 05 21:08:25.620754 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620715 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.620797 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620771 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-t8dcs"] Jun 05 21:08:25.620932 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.620903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:25.622324 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.622306 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-fd8545cc7-6dt76"] Jun 05 21:08:25.622503 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.622485 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.623870 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.623840 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.624787 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.624770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 05 21:08:25.624908 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.624891 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 21:08:25.624996 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.624981 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.625079 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.625058 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 05 21:08:25.625227 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.625148 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 21:08:25.625299 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.625255 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-26x2j\"" Jun 05 21:08:25.625299 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.625290 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.625409 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.625351 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rs7cg\"" Jun 05 21:08:25.626206 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.626173 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 21:08:25.626424 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.626408 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 21:08:25.626485 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.626433 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zknj7\"" Jun 05 21:08:25.626485 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.626475 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.627053 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.627032 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 21:08:25.627123 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.627078 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.627123 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.627089 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 21:08:25.629432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.629414 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q"] Jun 05 21:08:25.632177 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.632065 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf"] Jun 05 21:08:25.632773 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.632751 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 21:08:25.635362 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.635341 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-t8dcs"] Jun 05 21:08:25.638233 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.638213 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-fd8545cc7-6dt76"] Jun 05 21:08:25.701262 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17165a00-98d1-4e26-afbc-23a11c66479c-serving-cert\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.701262 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701266 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-default-certificate\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.701513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:25.701513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.701513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ae32549-40e3-4f29-9ffb-414cfca77b6c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:25.701513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-config\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.701513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-stats-auth\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.701513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17165a00-98d1-4e26-afbc-23a11c66479c-config\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.701762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17165a00-98d1-4e26-afbc-23a11c66479c-trusted-ca\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.701762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.701762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvn4q\" (UniqueName: \"kubernetes.io/projected/43014c37-8528-499d-abf3-105d6a0d6f0f-kube-api-access-qvn4q\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.701762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwcl\" (UniqueName: \"kubernetes.io/projected/17165a00-98d1-4e26-afbc-23a11c66479c-kube-api-access-ddwcl\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.701762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrdpj\" (UniqueName: \"kubernetes.io/projected/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-kube-api-access-xrdpj\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.701762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.701723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.711332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.711309 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr"] Jun 05 21:08:25.713151 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.713138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" Jun 05 21:08:25.715197 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.715176 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9"] Jun 05 21:08:25.715315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.715273 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kknnq\"" Jun 05 21:08:25.720690 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.720670 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h"] Jun 05 21:08:25.720813 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.720797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.722593 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.722573 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.723120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.723096 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.723223 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.723128 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9sg84\"" Jun 05 21:08:25.723223 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.723167 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 21:08:25.723311 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.723248 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 21:08:25.723389 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.723374 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.724938 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.724906 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 21:08:25.725050 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.724911 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 21:08:25.725169 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.725149 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hvgqj\"" Jun 05 21:08:25.725366 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.725347 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr"] Jun 05 21:08:25.726131 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.726111 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 21:08:25.726226 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.726145 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 21:08:25.729756 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.729707 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h"] Jun 05 21:08:25.731039 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.730876 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9"] Jun 05 21:08:25.802481 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.802687 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9brkc\" (UniqueName: \"kubernetes.io/projected/2a927a74-d42b-4b94-ba6e-6088830250b5-kube-api-access-9brkc\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.802687 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17165a00-98d1-4e26-afbc-23a11c66479c-config\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.802687 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17165a00-98d1-4e26-afbc-23a11c66479c-trusted-ca\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.802687 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwhlt\" (UniqueName: \"kubernetes.io/projected/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-kube-api-access-kwhlt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.802735 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:26.302721171 +0000 UTC m=+195.394529596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : configmap references non-existent config key: service-ca.crt Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvn4q\" (UniqueName: \"kubernetes.io/projected/43014c37-8528-499d-abf3-105d6a0d6f0f-kube-api-access-qvn4q\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a927a74-d42b-4b94-ba6e-6088830250b5-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwcl\" (UniqueName: \"kubernetes.io/projected/17165a00-98d1-4e26-afbc-23a11c66479c-kube-api-access-ddwcl\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrdpj\" (UniqueName: \"kubernetes.io/projected/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-kube-api-access-xrdpj\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.802999 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.802998 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17165a00-98d1-4e26-afbc-23a11c66479c-serving-cert\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-default-certificate\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ae32549-40e3-4f29-9ffb-414cfca77b6c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803229 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-config\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-stats-auth\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdtc\" (UniqueName: \"kubernetes.io/projected/116b5b21-f7b2-46a7-855d-ba61b4a18ec7-kube-api-access-dsdtc\") pod \"network-check-source-dbd9cf844-c4qhr\" (UID: \"116b5b21-f7b2-46a7-855d-ba61b4a18ec7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" Jun 05 21:08:25.803439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17165a00-98d1-4e26-afbc-23a11c66479c-config\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.803944 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.803543 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:08:25.803944 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.803612 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:26.30359429 +0000 UTC m=+195.395402734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : secret "router-metrics-certs-default" not found Jun 05 21:08:25.803944 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803614 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17165a00-98d1-4e26-afbc-23a11c66479c-trusted-ca\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.803944 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.803709 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:08:25.803944 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.803797 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert podName:4ae32549-40e3-4f29-9ffb-414cfca77b6c nodeName:}" failed. No retries permitted until 2026-06-05 21:08:26.303780179 +0000 UTC m=+195.395588613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2sklf" (UID: "4ae32549-40e3-4f29-9ffb-414cfca77b6c") : secret "networking-console-plugin-cert" not found Jun 05 21:08:25.804166 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.803969 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-config\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.804319 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.804300 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ae32549-40e3-4f29-9ffb-414cfca77b6c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:25.806135 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.806115 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.806291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.806268 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17165a00-98d1-4e26-afbc-23a11c66479c-serving-cert\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.806482 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.806467 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-stats-auth\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.806528 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.806475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-default-certificate\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.815560 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.815526 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrdpj\" (UniqueName: \"kubernetes.io/projected/8ea9d83c-60ef-405c-8b19-f72f2172dfd8-kube-api-access-xrdpj\") pod \"service-ca-operator-6bc5ff68f5-b6h2q\" (UID: \"8ea9d83c-60ef-405c-8b19-f72f2172dfd8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.816570 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.816547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwcl\" (UniqueName: \"kubernetes.io/projected/17165a00-98d1-4e26-afbc-23a11c66479c-kube-api-access-ddwcl\") pod \"console-operator-668fdbf85c-t8dcs\" (UID: \"17165a00-98d1-4e26-afbc-23a11c66479c\") " pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.816890 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.816870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvn4q\" (UniqueName: \"kubernetes.io/projected/43014c37-8528-499d-abf3-105d6a0d6f0f-kube-api-access-qvn4q\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:25.850818 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.850788 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:25.904210 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.904210 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9brkc\" (UniqueName: \"kubernetes.io/projected/2a927a74-d42b-4b94-ba6e-6088830250b5-kube-api-access-9brkc\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.904343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwhlt\" (UniqueName: \"kubernetes.io/projected/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-kube-api-access-kwhlt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.904343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.904343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a927a74-d42b-4b94-ba6e-6088830250b5-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.904343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.904580 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdtc\" (UniqueName: \"kubernetes.io/projected/116b5b21-f7b2-46a7-855d-ba61b4a18ec7-kube-api-access-dsdtc\") pod \"network-check-source-dbd9cf844-c4qhr\" (UID: \"116b5b21-f7b2-46a7-855d-ba61b4a18ec7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" Jun 05 21:08:25.904580 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.904365 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:25.904580 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:25.904442 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls podName:2a927a74-d42b-4b94-ba6e-6088830250b5 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:26.404421099 +0000 UTC m=+195.496229544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qxm4h" (UID: "2a927a74-d42b-4b94-ba6e-6088830250b5") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:25.904848 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.904828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.905028 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.905009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a927a74-d42b-4b94-ba6e-6088830250b5-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.906588 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.906570 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.912883 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.912852 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9brkc\" (UniqueName: \"kubernetes.io/projected/2a927a74-d42b-4b94-ba6e-6088830250b5-kube-api-access-9brkc\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:25.912883 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.912878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdtc\" (UniqueName: \"kubernetes.io/projected/116b5b21-f7b2-46a7-855d-ba61b4a18ec7-kube-api-access-dsdtc\") pod \"network-check-source-dbd9cf844-c4qhr\" (UID: \"116b5b21-f7b2-46a7-855d-ba61b4a18ec7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" Jun 05 21:08:25.913072 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.912852 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwhlt\" (UniqueName: \"kubernetes.io/projected/f93ecaf5-1f73-41b5-9d7d-3646022ff30a-kube-api-access-kwhlt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gm4n9\" (UID: \"f93ecaf5-1f73-41b5-9d7d-3646022ff30a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:25.929692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.929660 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" Jun 05 21:08:25.945511 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.945478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:25.950890 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:25.950833 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:26.024451 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.024186 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" Jun 05 21:08:26.033580 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.033541 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" Jun 05 21:08:26.070951 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.070818 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q"] Jun 05 21:08:26.075353 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:26.075310 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea9d83c_60ef_405c_8b19_f72f2172dfd8.slice/crio-c9eba70298fbfc4b2983bbf953918babec1ae85b9acb683ce39cddafd6a7f072 WatchSource:0}: Error finding container c9eba70298fbfc4b2983bbf953918babec1ae85b9acb683ce39cddafd6a7f072: Status 404 returned error can't find the container with id c9eba70298fbfc4b2983bbf953918babec1ae85b9acb683ce39cddafd6a7f072 Jun 05 21:08:26.093842 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.093765 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-t8dcs"] Jun 05 21:08:26.099311 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:26.098517 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17165a00_98d1_4e26_afbc_23a11c66479c.slice/crio-27186089fdc8ac677381c95badd0f386f5c6cd57f48bcb6cb43820bff1fc697a WatchSource:0}: Error finding container 27186089fdc8ac677381c95badd0f386f5c6cd57f48bcb6cb43820bff1fc697a: Status 404 returned error can't find the container with id 27186089fdc8ac677381c95badd0f386f5c6cd57f48bcb6cb43820bff1fc697a Jun 05 21:08:26.171222 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.171039 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr"] Jun 05 21:08:26.173744 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:26.173716 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116b5b21_f7b2_46a7_855d_ba61b4a18ec7.slice/crio-9f3c02d9f77587f1833de2d6db916ffe3cb31da689d993aa6265ddf2559ca715 WatchSource:0}: Error finding container 9f3c02d9f77587f1833de2d6db916ffe3cb31da689d993aa6265ddf2559ca715: Status 404 returned error can't find the container with id 9f3c02d9f77587f1833de2d6db916ffe3cb31da689d993aa6265ddf2559ca715 Jun 05 21:08:26.190336 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.190273 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9"] Jun 05 21:08:26.197902 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:26.197878 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93ecaf5_1f73_41b5_9d7d_3646022ff30a.slice/crio-c8fa12e6d51f0c1cb3bf763b55d004e713cda201249b0a8f60afcb1679b508f7 WatchSource:0}: Error finding container c8fa12e6d51f0c1cb3bf763b55d004e713cda201249b0a8f60afcb1679b508f7: Status 404 returned error can't find the container with id c8fa12e6d51f0c1cb3bf763b55d004e713cda201249b0a8f60afcb1679b508f7 Jun 05 21:08:26.309136 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.309095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:26.309357 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.309183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:26.309357 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.309223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:26.309357 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.309290 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:27.309267831 +0000 UTC m=+196.401076262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : configmap references non-existent config key: service-ca.crt Jun 05 21:08:26.309357 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.309348 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:08:26.309536 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.309395 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert podName:4ae32549-40e3-4f29-9ffb-414cfca77b6c nodeName:}" failed. No retries permitted until 2026-06-05 21:08:27.309383953 +0000 UTC m=+196.401192378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2sklf" (UID: "4ae32549-40e3-4f29-9ffb-414cfca77b6c") : secret "networking-console-plugin-cert" not found Jun 05 21:08:26.309536 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.309348 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:08:26.309536 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.309429 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:27.309416302 +0000 UTC m=+196.401224726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : secret "router-metrics-certs-default" not found Jun 05 21:08:26.410545 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:26.410508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:26.410726 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.410628 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:26.410726 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:26.410684 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls podName:2a927a74-d42b-4b94-ba6e-6088830250b5 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:27.41066968 +0000 UTC m=+196.502478106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qxm4h" (UID: "2a927a74-d42b-4b94-ba6e-6088830250b5") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:27.076833 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.076743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" event={"ID":"f93ecaf5-1f73-41b5-9d7d-3646022ff30a","Type":"ContainerStarted","Data":"c8fa12e6d51f0c1cb3bf763b55d004e713cda201249b0a8f60afcb1679b508f7"} Jun 05 21:08:27.079162 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.078466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" event={"ID":"116b5b21-f7b2-46a7-855d-ba61b4a18ec7","Type":"ContainerStarted","Data":"e1b1246e3454d3cc06502301a5b69cf45ea88e4c60ad2dce38be861d0c3fad68"} Jun 05 21:08:27.079162 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.078511 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" event={"ID":"116b5b21-f7b2-46a7-855d-ba61b4a18ec7","Type":"ContainerStarted","Data":"9f3c02d9f77587f1833de2d6db916ffe3cb31da689d993aa6265ddf2559ca715"} Jun 05 21:08:27.080684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.080630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" event={"ID":"17165a00-98d1-4e26-afbc-23a11c66479c","Type":"ContainerStarted","Data":"27186089fdc8ac677381c95badd0f386f5c6cd57f48bcb6cb43820bff1fc697a"} Jun 05 21:08:27.082055 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.082002 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" event={"ID":"8ea9d83c-60ef-405c-8b19-f72f2172dfd8","Type":"ContainerStarted","Data":"c9eba70298fbfc4b2983bbf953918babec1ae85b9acb683ce39cddafd6a7f072"} Jun 05 21:08:27.321437 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.321397 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:27.321582 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.321488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:27.321582 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.321527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:27.321682 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.321648 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:08:27.321732 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.321717 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert podName:4ae32549-40e3-4f29-9ffb-414cfca77b6c nodeName:}" failed. No retries permitted until 2026-06-05 21:08:29.321695414 +0000 UTC m=+198.413503862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2sklf" (UID: "4ae32549-40e3-4f29-9ffb-414cfca77b6c") : secret "networking-console-plugin-cert" not found Jun 05 21:08:27.322119 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.322018 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:08:27.322119 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.322071 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:29.3220567 +0000 UTC m=+198.413865130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : secret "router-metrics-certs-default" not found Jun 05 21:08:27.322119 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.322089 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:29.3220808 +0000 UTC m=+198.413889232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : configmap references non-existent config key: service-ca.crt Jun 05 21:08:27.422635 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:27.422459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:27.422635 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.422574 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:27.422896 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:27.422642 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls podName:2a927a74-d42b-4b94-ba6e-6088830250b5 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:29.422623425 +0000 UTC m=+198.514431866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qxm4h" (UID: "2a927a74-d42b-4b94-ba6e-6088830250b5") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:28.175116 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:28.175080 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.226606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:28.226576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.091217 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.091173 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" event={"ID":"8ea9d83c-60ef-405c-8b19-f72f2172dfd8","Type":"ContainerStarted","Data":"13c7bb546140138f0ad2ec02c79eb690b8d9fb5e6c38d00e525b7f29b6fb763a"} Jun 05 21:08:29.093555 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.093522 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" event={"ID":"f93ecaf5-1f73-41b5-9d7d-3646022ff30a","Type":"ContainerStarted","Data":"2e97213a4f56c9b86bc50f3cb95c2dbf2c08b0b94a03825f3f81a48b3965f7b6"} Jun 05 21:08:29.095222 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.095197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" event={"ID":"17165a00-98d1-4e26-afbc-23a11c66479c","Type":"ContainerStarted","Data":"3b622d0b94912c3d1ff6213b38f7466ed5d65062181b9f04bb72d6a65bc38da9"} Jun 05 21:08:29.095442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.095425 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:29.096939 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.096897 2560 patch_prober.go:28] interesting pod/console-operator-668fdbf85c-t8dcs container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Jun 05 21:08:29.097109 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.097081 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" podUID="17165a00-98d1-4e26-afbc-23a11c66479c" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Jun 05 21:08:29.115605 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.115553 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" podStartSLOduration=1.223426438 podStartE2EDuration="4.115533789s" totalImagesPullingTime="2.892107351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:29.114593804 +0000 UTC m=+198.206402252" watchObservedRunningTime="2026-06-05 21:08:29.115533789 +0000 UTC m=+198.207342237" Jun 05 21:08:29.115761 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.115736 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c4qhr" podStartSLOduration=4.115729787 podStartE2EDuration="4.115729787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:27.093787608 +0000 UTC m=+196.185596053" watchObservedRunningTime="2026-06-05 21:08:29.115729787 +0000 UTC m=+198.207538241" Jun 05 21:08:29.132180 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.132135 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" podStartSLOduration=1.356948595 podStartE2EDuration="4.13211666s" totalImagesPullingTime="2.775168065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:29.131059372 +0000 UTC m=+198.222867820" watchObservedRunningTime="2026-06-05 21:08:29.13211666 +0000 UTC m=+198.223925105" Jun 05 21:08:29.149008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.148945 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" podStartSLOduration=1.2776243520000001 podStartE2EDuration="4.148909371s" totalImagesPullingTime="2.871285019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:29.14859716 +0000 UTC m=+198.240405610" watchObservedRunningTime="2026-06-05 21:08:29.148909371 +0000 UTC m=+198.240717822" Jun 05 21:08:29.152489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.152461 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.202829 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.202751 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.340760 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.340724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.340782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.340807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.340902 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.340939 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:33.340896323 +0000 UTC m=+202.432704760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : configmap references non-existent config key: service-ca.crt Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.340973 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:33.340960473 +0000 UTC m=+202.432768901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : secret "router-metrics-certs-default" not found Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.340908 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:08:29.341078 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.341005 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert podName:4ae32549-40e3-4f29-9ffb-414cfca77b6c nodeName:}" failed. No retries permitted until 2026-06-05 21:08:33.340995802 +0000 UTC m=+202.432804259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2sklf" (UID: "4ae32549-40e3-4f29-9ffb-414cfca77b6c") : secret "networking-console-plugin-cert" not found Jun 05 21:08:29.442010 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.441974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:29.442177 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.442134 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:29.442236 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:29.442213 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls podName:2a927a74-d42b-4b94-ba6e-6088830250b5 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:33.44219237 +0000 UTC m=+202.534000809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qxm4h" (UID: "2a927a74-d42b-4b94-ba6e-6088830250b5") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:29.881868 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.881820 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.977687 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:29.977658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:30.080382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.080345 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:30.099689 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.099666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/0.log" Jun 05 21:08:30.099833 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.099700 2560 generic.go:356] "Generic (PLEG): container finished" podID="17165a00-98d1-4e26-afbc-23a11c66479c" containerID="3b622d0b94912c3d1ff6213b38f7466ed5d65062181b9f04bb72d6a65bc38da9" exitCode=255 Jun 05 21:08:30.099833 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.099787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" event={"ID":"17165a00-98d1-4e26-afbc-23a11c66479c","Type":"ContainerDied","Data":"3b622d0b94912c3d1ff6213b38f7466ed5d65062181b9f04bb72d6a65bc38da9"} Jun 05 21:08:30.100023 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.100001 2560 scope.go:117] "RemoveContainer" containerID="3b622d0b94912c3d1ff6213b38f7466ed5d65062181b9f04bb72d6a65bc38da9" Jun 05 21:08:30.211878 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.211853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:30.312161 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.312129 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:30.893491 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.893465 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rnbd_4adaeb64-a7e4-4f77-9df0-6c56ce5909a2/dns-node-resolver/0.log" Jun 05 21:08:30.957658 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:30.957612 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:31.040357 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.040325 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:31.104848 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.104822 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:08:31.105249 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.105234 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/0.log" Jun 05 21:08:31.105303 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.105268 2560 generic.go:356] "Generic (PLEG): container finished" podID="17165a00-98d1-4e26-afbc-23a11c66479c" containerID="d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9" exitCode=255 Jun 05 21:08:31.105303 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.105293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" event={"ID":"17165a00-98d1-4e26-afbc-23a11c66479c","Type":"ContainerDied","Data":"d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9"} Jun 05 21:08:31.105370 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.105336 2560 scope.go:117] "RemoveContainer" containerID="3b622d0b94912c3d1ff6213b38f7466ed5d65062181b9f04bb72d6a65bc38da9" Jun 05 21:08:31.105600 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:31.105582 2560 scope.go:117] "RemoveContainer" containerID="d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9" Jun 05 21:08:31.105830 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:31.105795 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-t8dcs_openshift-console-operator(17165a00-98d1-4e26-afbc-23a11c66479c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" podUID="17165a00-98d1-4e26-afbc-23a11c66479c" Jun 05 21:08:32.093346 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.093314 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lchd7_6d77f8c4-33ef-4d38-be34-d75e980a508c/node-ca/0.log" Jun 05 21:08:32.109353 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.109328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:08:32.109696 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.109681 2560 scope.go:117] "RemoveContainer" containerID="d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9" Jun 05 21:08:32.109846 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:32.109826 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-t8dcs_openshift-console-operator(17165a00-98d1-4e26-afbc-23a11c66479c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" podUID="17165a00-98d1-4e26-afbc-23a11c66479c" Jun 05 21:08:32.189031 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.188996 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:32.517529 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.517457 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rngnb"] Jun 05 21:08:32.521474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.521456 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.523695 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.523673 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 21:08:32.523793 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.523733 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-q88k9\"" Jun 05 21:08:32.523793 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.523736 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 21:08:32.524570 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.524553 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 21:08:32.524669 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.524594 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 21:08:32.529037 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.529017 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rngnb"] Jun 05 21:08:32.549790 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.549763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:32.598289 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.598260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:32.670538 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.670507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-signing-key\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.670656 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.670554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvjgp\" (UniqueName: \"kubernetes.io/projected/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-kube-api-access-bvjgp\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.670743 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.670721 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-signing-cabundle\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.693021 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.692998 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6h5db_f9168ed4-c7e2-450f-ae4f-d059945630bc/serve-healthcheck-canary/0.log" Jun 05 21:08:32.771666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.771577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-signing-cabundle\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.771666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.771637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-signing-key\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.771870 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.771679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvjgp\" (UniqueName: \"kubernetes.io/projected/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-kube-api-access-bvjgp\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.772296 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.772274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-signing-cabundle\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.774003 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.773988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-signing-key\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.779779 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.779756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvjgp\" (UniqueName: \"kubernetes.io/projected/7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0-kube-api-access-bvjgp\") pod \"service-ca-7d74d578b8-rngnb\" (UID: \"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0\") " pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.830226 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.830174 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" Jun 05 21:08:32.954822 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:32.954790 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rngnb"] Jun 05 21:08:32.957606 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:32.957579 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be75f8c_cf6a_442a_9a5c_3ada0fe6d7f0.slice/crio-506669c55dd755bf3718e002bbf5ba43c6177bff3cfda525c7379b1b29f113a2 WatchSource:0}: Error finding container 506669c55dd755bf3718e002bbf5ba43c6177bff3cfda525c7379b1b29f113a2: Status 404 returned error can't find the container with id 506669c55dd755bf3718e002bbf5ba43c6177bff3cfda525c7379b1b29f113a2 Jun 05 21:08:33.113752 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.113715 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" event={"ID":"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0","Type":"ContainerStarted","Data":"d407af717706783848f38930fd194391134992e152f3b07906440a93a3785c52"} Jun 05 21:08:33.114157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.113766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" event={"ID":"7be75f8c-cf6a-442a-9a5c-3ada0fe6d7f0","Type":"ContainerStarted","Data":"506669c55dd755bf3718e002bbf5ba43c6177bff3cfda525c7379b1b29f113a2"} Jun 05 21:08:33.129172 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.129118 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-rngnb" podStartSLOduration=1.1291013030000001 podStartE2EDuration="1.129101303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:33.127691677 +0000 UTC m=+202.219500123" watchObservedRunningTime="2026-06-05 21:08:33.129101303 +0000 UTC m=+202.220909780" Jun 05 21:08:33.376592 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.376565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:33.376792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.376623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:33.376792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.376658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:33.376792 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.376729 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:41.376709512 +0000 UTC m=+210.468517938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : configmap references non-existent config key: service-ca.crt Jun 05 21:08:33.376792 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.376775 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:08:33.377040 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.376811 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert podName:4ae32549-40e3-4f29-9ffb-414cfca77b6c nodeName:}" failed. No retries permitted until 2026-06-05 21:08:41.376800333 +0000 UTC m=+210.468608764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2sklf" (UID: "4ae32549-40e3-4f29-9ffb-414cfca77b6c") : secret "networking-console-plugin-cert" not found Jun 05 21:08:33.377040 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.376863 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:08:33.377040 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.376894 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs podName:43014c37-8528-499d-abf3-105d6a0d6f0f nodeName:}" failed. No retries permitted until 2026-06-05 21:08:41.376883945 +0000 UTC m=+210.468692388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs") pod "router-default-fd8545cc7-6dt76" (UID: "43014c37-8528-499d-abf3-105d6a0d6f0f") : secret "router-metrics-certs-default" not found Jun 05 21:08:33.377040 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.377015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:33.477899 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:33.477865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:33.478088 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.478040 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:33.478157 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:33.478129 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls podName:2a927a74-d42b-4b94-ba6e-6088830250b5 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:41.478108659 +0000 UTC m=+210.569917086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qxm4h" (UID: "2a927a74-d42b-4b94-ba6e-6088830250b5") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:08:34.411215 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:34.411178 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:34.572661 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:34.572628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:34.704372 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:34.704282 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:34.824390 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:34.824353 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:34.994607 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:34.994492 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:35.095292 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:35.095237 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:35.195830 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:35.195788 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:35.539105 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:35.539071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:35.946232 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:35.946144 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:35.946541 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:35.946528 2560 scope.go:117] "RemoveContainer" containerID="d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9" Jun 05 21:08:35.946703 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:35.946683 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-t8dcs_openshift-console-operator(17165a00-98d1-4e26-afbc-23a11c66479c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" podUID="17165a00-98d1-4e26-afbc-23a11c66479c" Jun 05 21:08:36.307536 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:36.307499 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:36.512752 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:36.512720 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:36.708960 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:36.708862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:36.915932 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:36.915876 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:37.119106 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:37.119072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:37.907315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:37.907283 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:38.308355 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:38.308325 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:38.361134 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:38.361107 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:38.505475 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:38.505442 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:38.708094 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:38.708009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:38.905607 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:38.905575 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:39.095610 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:39.095574 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:39.096104 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:39.095954 2560 scope.go:117] "RemoveContainer" containerID="d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9" Jun 05 21:08:39.096165 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:39.096119 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-t8dcs_openshift-console-operator(17165a00-98d1-4e26-afbc-23a11c66479c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" podUID="17165a00-98d1-4e26-afbc-23a11c66479c" Jun 05 21:08:39.311395 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:39.311365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:39.878586 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:39.878553 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:39.975934 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:39.975885 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:40.308726 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:40.308693 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:40.715883 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:40.715805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:40.911751 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:40.911695 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:41.080182 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.080152 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:41.454382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.454293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:41.454382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.454358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:41.454797 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.454386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:41.454797 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:41.454503 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:08:41.454797 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:41.454574 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert podName:4ae32549-40e3-4f29-9ffb-414cfca77b6c nodeName:}" failed. No retries permitted until 2026-06-05 21:08:57.454557861 +0000 UTC m=+226.546366302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2sklf" (UID: "4ae32549-40e3-4f29-9ffb-414cfca77b6c") : secret "networking-console-plugin-cert" not found Jun 05 21:08:41.455067 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.455046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43014c37-8528-499d-abf3-105d6a0d6f0f-service-ca-bundle\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:41.456791 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.456771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43014c37-8528-499d-abf3-105d6a0d6f0f-metrics-certs\") pod \"router-default-fd8545cc7-6dt76\" (UID: \"43014c37-8528-499d-abf3-105d6a0d6f0f\") " pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:41.507864 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.507830 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:41.550030 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.549998 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:41.555625 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.555315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:41.557864 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.557841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a927a74-d42b-4b94-ba6e-6088830250b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qxm4h\" (UID: \"2a927a74-d42b-4b94-ba6e-6088830250b5\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:41.639626 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.639431 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" Jun 05 21:08:41.695113 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.694949 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-fd8545cc7-6dt76"] Jun 05 21:08:41.699150 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:41.699084 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43014c37_8528_499d_abf3_105d6a0d6f0f.slice/crio-d099e85245341bf7e63b852a3131dc4cf574515d1457139c9db490bfc3aa2d4d WatchSource:0}: Error finding container d099e85245341bf7e63b852a3131dc4cf574515d1457139c9db490bfc3aa2d4d: Status 404 returned error can't find the container with id d099e85245341bf7e63b852a3131dc4cf574515d1457139c9db490bfc3aa2d4d Jun 05 21:08:41.779983 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:41.779946 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h"] Jun 05 21:08:41.784303 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:41.784278 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a927a74_d42b_4b94_ba6e_6088830250b5.slice/crio-34a1453d412d4231738aabd56fbed6df711d8c520fa0ad8c4c3ab753e1c9a2ee WatchSource:0}: Error finding container 34a1453d412d4231738aabd56fbed6df711d8c520fa0ad8c4c3ab753e1c9a2ee: Status 404 returned error can't find the container with id 34a1453d412d4231738aabd56fbed6df711d8c520fa0ad8c4c3ab753e1c9a2ee Jun 05 21:08:42.107913 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.107877 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:42.146254 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.146217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" event={"ID":"2a927a74-d42b-4b94-ba6e-6088830250b5","Type":"ContainerStarted","Data":"34a1453d412d4231738aabd56fbed6df711d8c520fa0ad8c4c3ab753e1c9a2ee"} Jun 05 21:08:42.147681 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.147657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-fd8545cc7-6dt76" event={"ID":"43014c37-8528-499d-abf3-105d6a0d6f0f","Type":"ContainerStarted","Data":"69bb65faaf4422688377162b48849b181c4e79124e8e18cf1fab808f39446eda"} Jun 05 21:08:42.147794 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.147698 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-fd8545cc7-6dt76" event={"ID":"43014c37-8528-499d-abf3-105d6a0d6f0f","Type":"ContainerStarted","Data":"d099e85245341bf7e63b852a3131dc4cf574515d1457139c9db490bfc3aa2d4d"} Jun 05 21:08:42.167449 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.167395 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-fd8545cc7-6dt76" podStartSLOduration=17.16737829 podStartE2EDuration="17.16737829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:42.166360746 +0000 UTC m=+211.258169215" watchObservedRunningTime="2026-06-05 21:08:42.16737829 +0000 UTC m=+211.259186738" Jun 05 21:08:42.249114 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.249064 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:42.351669 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.351634 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:42.507495 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.507415 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:42.550265 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.550227 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:42.553171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.553141 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:42.708185 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:42.708122 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:43.152055 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:43.152019 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:43.153491 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:43.153465 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-fd8545cc7-6dt76" Jun 05 21:08:43.510249 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:43.510222 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:43.712695 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:43.712621 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:43.812676 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:43.812638 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:43.912769 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:43.912739 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:44.108603 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:44.108572 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:44.156766 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:44.156737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" event={"ID":"2a927a74-d42b-4b94-ba6e-6088830250b5","Type":"ContainerStarted","Data":"67205bfacf5990304d3cbb873c029f10b2daf0e4c342e5bc1da749a252a9db8b"} Jun 05 21:08:44.172042 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:44.171987 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qxm4h" podStartSLOduration=17.501931333 podStartE2EDuration="19.171971026s" totalImagesPullingTime="1.670039693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:44.170547151 +0000 UTC m=+213.262355599" watchObservedRunningTime="2026-06-05 21:08:44.171971026 +0000 UTC m=+213.263779479" Jun 05 21:08:44.708754 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:44.708717 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:45.105619 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:45.105590 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:45.307367 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:45.307337 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:45.509774 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:45.509690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:53.371568 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.371532 2560 scope.go:117] "RemoveContainer" containerID="d6d0e256b3aa519b059d2ab88daa987c4b2d303bff73976d8bf8672b3c9e0cf9" Jun 05 21:08:53.639083 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.639005 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7ldwh"] Jun 05 21:08:53.642275 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.642258 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.645039 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.645015 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 21:08:53.645176 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.645020 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 21:08:53.645885 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.645858 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gfwsm\"" Jun 05 21:08:53.645885 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.645882 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 21:08:53.646053 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.645860 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 21:08:53.648577 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.648557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00297e7e-5ad3-4a4b-9f34-962d9170f97f-data-volume\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.648679 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.648588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00297e7e-5ad3-4a4b-9f34-962d9170f97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.648679 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.648631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00297e7e-5ad3-4a4b-9f34-962d9170f97f-crio-socket\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.648794 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.648728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00297e7e-5ad3-4a4b-9f34-962d9170f97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.648794 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.648773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s756\" (UniqueName: \"kubernetes.io/projected/00297e7e-5ad3-4a4b-9f34-962d9170f97f-kube-api-access-2s756\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.654260 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.654240 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7ldwh"] Jun 05 21:08:53.695510 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.695456 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5"] Jun 05 21:08:53.698613 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.698592 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:53.701188 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.701164 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 21:08:53.701402 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.701385 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qm7n7\"" Jun 05 21:08:53.709637 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.709609 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5"] Jun 05 21:08:53.749792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.749766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00297e7e-5ad3-4a4b-9f34-962d9170f97f-crio-socket\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.749906 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.749852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00297e7e-5ad3-4a4b-9f34-962d9170f97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.749906 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.749890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s756\" (UniqueName: \"kubernetes.io/projected/00297e7e-5ad3-4a4b-9f34-962d9170f97f-kube-api-access-2s756\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.749989 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.749855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00297e7e-5ad3-4a4b-9f34-962d9170f97f-crio-socket\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.750109 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.750092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00297e7e-5ad3-4a4b-9f34-962d9170f97f-data-volume\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.750156 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.750130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/30d8877d-9f22-419b-9e43-878a8027a61e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-wdjv5\" (UID: \"30d8877d-9f22-419b-9e43-878a8027a61e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:53.750190 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.750170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00297e7e-5ad3-4a4b-9f34-962d9170f97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.750459 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.750433 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00297e7e-5ad3-4a4b-9f34-962d9170f97f-data-volume\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.750818 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.750795 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00297e7e-5ad3-4a4b-9f34-962d9170f97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.752121 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.752100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00297e7e-5ad3-4a4b-9f34-962d9170f97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.761006 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.760982 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s756\" (UniqueName: \"kubernetes.io/projected/00297e7e-5ad3-4a4b-9f34-962d9170f97f-kube-api-access-2s756\") pod \"insights-runtime-extractor-7ldwh\" (UID: \"00297e7e-5ad3-4a4b-9f34-962d9170f97f\") " pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:53.814593 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.814560 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:53.851232 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.851194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/30d8877d-9f22-419b-9e43-878a8027a61e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-wdjv5\" (UID: \"30d8877d-9f22-419b-9e43-878a8027a61e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:53.853615 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.853593 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/30d8877d-9f22-419b-9e43-878a8027a61e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-wdjv5\" (UID: \"30d8877d-9f22-419b-9e43-878a8027a61e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:53.917600 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.917514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:53.951624 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:53.951590 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7ldwh" Jun 05 21:08:54.010349 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.010314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:54.084878 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.084113 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-mzx7s"] Jun 05 21:08:54.089546 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.089479 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:08:54.092217 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.092193 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:08:54.092446 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.092431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ttsm7\"" Jun 05 21:08:54.092678 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.092663 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:08:54.101081 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.099577 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-mzx7s"] Jun 05 21:08:54.103695 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.103104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:54.107993 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.107895 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7ldwh"] Jun 05 21:08:54.111792 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:54.111751 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00297e7e_5ad3_4a4b_9f34_962d9170f97f.slice/crio-938ea6035429070a8a2f393b05435f37071e0d4ec841b7ff7c0b47e260b6a098 WatchSource:0}: Error finding container 938ea6035429070a8a2f393b05435f37071e0d4ec841b7ff7c0b47e260b6a098: Status 404 returned error can't find the container with id 938ea6035429070a8a2f393b05435f37071e0d4ec841b7ff7c0b47e260b6a098 Jun 05 21:08:54.154398 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.154177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc2nd\" (UniqueName: \"kubernetes.io/projected/256fadf1-27d4-42e8-a7f2-c232fa5f7b14-kube-api-access-mc2nd\") pod \"downloads-6657875f97-mzx7s\" (UID: \"256fadf1-27d4-42e8-a7f2-c232fa5f7b14\") " pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:08:54.171063 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.170992 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5"] Jun 05 21:08:54.173189 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.173159 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:54.175855 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:54.175831 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d8877d_9f22_419b_9e43_878a8027a61e.slice/crio-5456db01476c236b2f5f7ff11e92f4ff9a16072077e783839da6bb78fd3ef8ab WatchSource:0}: Error finding container 5456db01476c236b2f5f7ff11e92f4ff9a16072077e783839da6bb78fd3ef8ab: Status 404 returned error can't find the container with id 5456db01476c236b2f5f7ff11e92f4ff9a16072077e783839da6bb78fd3ef8ab Jun 05 21:08:54.189552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.189534 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:08:54.189646 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.189612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" event={"ID":"17165a00-98d1-4e26-afbc-23a11c66479c","Type":"ContainerStarted","Data":"00d7257d31144e5564c4c983a1f039d61ab9a52e75ab21fcf10ae27efa7e18cc"} Jun 05 21:08:54.189966 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.189937 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:54.191609 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.191575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ldwh" event={"ID":"00297e7e-5ad3-4a4b-9f34-962d9170f97f","Type":"ContainerStarted","Data":"938ea6035429070a8a2f393b05435f37071e0d4ec841b7ff7c0b47e260b6a098"} Jun 05 21:08:54.193456 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.193433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" event={"ID":"30d8877d-9f22-419b-9e43-878a8027a61e","Type":"ContainerStarted","Data":"5456db01476c236b2f5f7ff11e92f4ff9a16072077e783839da6bb78fd3ef8ab"} Jun 05 21:08:54.195498 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.195478 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-t8dcs" Jun 05 21:08:54.236426 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.236393 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:54.255849 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.255817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc2nd\" (UniqueName: \"kubernetes.io/projected/256fadf1-27d4-42e8-a7f2-c232fa5f7b14-kube-api-access-mc2nd\") pod \"downloads-6657875f97-mzx7s\" (UID: \"256fadf1-27d4-42e8-a7f2-c232fa5f7b14\") " pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:08:54.264715 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.264686 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc2nd\" (UniqueName: \"kubernetes.io/projected/256fadf1-27d4-42e8-a7f2-c232fa5f7b14-kube-api-access-mc2nd\") pod \"downloads-6657875f97-mzx7s\" (UID: \"256fadf1-27d4-42e8-a7f2-c232fa5f7b14\") " pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:08:54.380735 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.380698 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:54.408750 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.407005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:08:54.535240 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.535217 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-mzx7s"] Jun 05 21:08:54.537426 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:54.537379 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256fadf1_27d4_42e8_a7f2_c232fa5f7b14.slice/crio-99946a880fef803621d0314ef3db2db796126a8a118f6df5c69153e577700dfb WatchSource:0}: Error finding container 99946a880fef803621d0314ef3db2db796126a8a118f6df5c69153e577700dfb: Status 404 returned error can't find the container with id 99946a880fef803621d0314ef3db2db796126a8a118f6df5c69153e577700dfb Jun 05 21:08:54.793160 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.793132 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:54.843414 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:54.843384 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.161991 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.161817 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.204445 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.204402 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-mzx7s" event={"ID":"256fadf1-27d4-42e8-a7f2-c232fa5f7b14","Type":"ContainerStarted","Data":"99946a880fef803621d0314ef3db2db796126a8a118f6df5c69153e577700dfb"} Jun 05 21:08:55.206886 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.206849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ldwh" event={"ID":"00297e7e-5ad3-4a4b-9f34-962d9170f97f","Type":"ContainerStarted","Data":"a27dc139475df338f4ac17cff4adb54e38409cc0fd8f3c87e6c67c19a630728f"} Jun 05 21:08:55.207037 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.206955 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ldwh" event={"ID":"00297e7e-5ad3-4a4b-9f34-962d9170f97f","Type":"ContainerStarted","Data":"41095ad4b4e2b6f5aa6e6c3ef3ea99d6f87e96b45b3b9faaa400f4cbc0300e2e"} Jun 05 21:08:55.216210 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.216170 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.591993 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.591955 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.638144 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.638097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.772335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.772201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.970376 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:55.970287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:56.070719 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:56.070679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:56.214725 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:56.214644 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" event={"ID":"30d8877d-9f22-419b-9e43-878a8027a61e","Type":"ContainerStarted","Data":"a2943af7f8b7852288ddbfce9ffb9ee974102e2241622db81fbdb02bcd0bfdce"} Jun 05 21:08:56.230144 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:56.230080 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" podStartSLOduration=1.937347338 podStartE2EDuration="3.230057667s" totalImagesPullingTime="1.292710329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:56.228588506 +0000 UTC m=+225.320396967" watchObservedRunningTime="2026-06-05 21:08:56.230057667 +0000 UTC m=+225.321866129" Jun 05 21:08:56.771130 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:56.771101 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:56.871971 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:56.871941 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:57.221147 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.221110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ldwh" event={"ID":"00297e7e-5ad3-4a4b-9f34-962d9170f97f","Type":"ContainerStarted","Data":"66da60639230fd8dd2e1729b59565efb63dd71b68267f1b3f6cac03b69057676"} Jun 05 21:08:57.221446 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.221414 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:57.226474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.226449 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-wdjv5" Jun 05 21:08:57.241389 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.241302 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7ldwh" podStartSLOduration=1.8464392969999999 podStartE2EDuration="4.241286376s" totalImagesPullingTime="2.394847079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:08:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:57.239300494 +0000 UTC m=+226.331108941" watchObservedRunningTime="2026-06-05 21:08:57.241286376 +0000 UTC m=+226.333094823" Jun 05 21:08:57.487974 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.487874 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:57.490951 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.490900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ae32549-40e3-4f29-9ffb-414cfca77b6c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2sklf\" (UID: \"4ae32549-40e3-4f29-9ffb-414cfca77b6c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:57.737806 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.737768 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" Jun 05 21:08:57.877824 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.877795 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf"] Jun 05 21:08:57.881591 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:57.881564 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae32549_40e3_4f29_9ffb_414cfca77b6c.slice/crio-eb42b7a4d7604f56462bb8c87e8368905461065ab6f03d0821e7b5bc341c5158 WatchSource:0}: Error finding container eb42b7a4d7604f56462bb8c87e8368905461065ab6f03d0821e7b5bc341c5158: Status 404 returned error can't find the container with id eb42b7a4d7604f56462bb8c87e8368905461065ab6f03d0821e7b5bc341c5158 Jun 05 21:08:57.939204 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.939154 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:57.970777 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.970749 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d"] Jun 05 21:08:57.975799 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.975777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:57.978398 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.978304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 21:08:57.978398 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.978338 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 21:08:57.979410 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.979390 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 21:08:57.979502 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.979484 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6b9n6\"" Jun 05 21:08:57.981967 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.981946 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d"] Jun 05 21:08:57.999582 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:57.999522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:58.097780 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.097742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78s8b\" (UniqueName: \"kubernetes.io/projected/c246e39b-d98e-4bf4-856c-c513eefca57b-kube-api-access-78s8b\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.097780 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.097786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.098009 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.097875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.098009 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.097902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c246e39b-d98e-4bf4-856c-c513eefca57b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.199039 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.199001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78s8b\" (UniqueName: \"kubernetes.io/projected/c246e39b-d98e-4bf4-856c-c513eefca57b-kube-api-access-78s8b\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.199231 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.199054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.199231 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.199156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.199231 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.199184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c246e39b-d98e-4bf4-856c-c513eefca57b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.199394 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:58.199226 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 21:08:58.199394 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:08:58.199299 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-tls podName:c246e39b-d98e-4bf4-856c-c513eefca57b nodeName:}" failed. No retries permitted until 2026-06-05 21:08:58.699277104 +0000 UTC m=+227.791085535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-9dp4d" (UID: "c246e39b-d98e-4bf4-856c-c513eefca57b") : secret "prometheus-operator-tls" not found Jun 05 21:08:58.200030 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.200005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c246e39b-d98e-4bf4-856c-c513eefca57b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.201869 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.201851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.210304 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.210280 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78s8b\" (UniqueName: \"kubernetes.io/projected/c246e39b-d98e-4bf4-856c-c513eefca57b-kube-api-access-78s8b\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.226616 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.226581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" event={"ID":"4ae32549-40e3-4f29-9ffb-414cfca77b6c","Type":"ContainerStarted","Data":"eb42b7a4d7604f56462bb8c87e8368905461065ab6f03d0821e7b5bc341c5158"} Jun 05 21:08:58.296852 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.296818 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:58.702366 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.702283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.705692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.705657 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c246e39b-d98e-4bf4-856c-c513eefca57b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9dp4d\" (UID: \"c246e39b-d98e-4bf4-856c-c513eefca57b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:58.889315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:58.889070 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" Jun 05 21:08:59.357590 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:59.357554 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d"] Jun 05 21:08:59.362215 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:08:59.362190 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc246e39b_d98e_4bf4_856c_c513eefca57b.slice/crio-e51547106884b2432983e32073f8ef7ca9c476a46f4497e4b60aee656933d0c0 WatchSource:0}: Error finding container e51547106884b2432983e32073f8ef7ca9c476a46f4497e4b60aee656933d0c0: Status 404 returned error can't find the container with id e51547106884b2432983e32073f8ef7ca9c476a46f4497e4b60aee656933d0c0 Jun 05 21:08:59.998260 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:08:59.998227 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:00.046071 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:00.046028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:00.236602 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:00.236556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" event={"ID":"4ae32549-40e3-4f29-9ffb-414cfca77b6c","Type":"ContainerStarted","Data":"f84c4baff8f0ab684148486a15db0cae82906e5db40602e6a7d626b298182d2f"} Jun 05 21:09:00.237873 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:00.237839 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" event={"ID":"c246e39b-d98e-4bf4-856c-c513eefca57b","Type":"ContainerStarted","Data":"e51547106884b2432983e32073f8ef7ca9c476a46f4497e4b60aee656933d0c0"} Jun 05 21:09:00.252225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:00.252138 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2sklf" podStartSLOduration=33.879868712 podStartE2EDuration="35.252120217s" totalImagesPullingTime="1.372251505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:00.250321888 +0000 UTC m=+229.342130335" watchObservedRunningTime="2026-06-05 21:09:00.252120217 +0000 UTC m=+229.343928663" Jun 05 21:09:00.334824 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:00.334783 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:00.387599 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:00.387563 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:01.059480 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:01.059397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:01.244099 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:01.244055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" event={"ID":"c246e39b-d98e-4bf4-856c-c513eefca57b","Type":"ContainerStarted","Data":"858c166710896f67e52eedacfa542cd5337cc576e203725e10e0590d4a89480a"} Jun 05 21:09:01.244282 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:01.244127 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" event={"ID":"c246e39b-d98e-4bf4-856c-c513eefca57b","Type":"ContainerStarted","Data":"03e6f0a6737a7762bccf36f682e8fb8fe6388342ef102c13747c71ab1d86fa2d"} Jun 05 21:09:01.260841 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:01.260781 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9dp4d" podStartSLOduration=2.841429196 podStartE2EDuration="4.260760997s" totalImagesPullingTime="1.419331801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:01.258465218 +0000 UTC m=+230.350273679" watchObservedRunningTime="2026-06-05 21:09:01.260760997 +0000 UTC m=+230.352569544" Jun 05 21:09:03.073906 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.073875 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.286209 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.286149 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.338531 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.338380 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p55vj"] Jun 05 21:09:03.342689 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.342663 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5"] Jun 05 21:09:03.342852 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.342761 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.345727 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.345694 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-464xt\"" Jun 05 21:09:03.345933 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.345902 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 21:09:03.346179 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.346163 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 21:09:03.346360 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.346346 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 21:09:03.346460 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.346442 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.349101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.348483 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 21:09:03.349101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.348524 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 21:09:03.349101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.348733 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 21:09:03.349101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.348945 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9kpvs\"" Jun 05 21:09:03.358202 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.357559 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5"] Jun 05 21:09:03.379968 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.379878 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.438346 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.438308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.449608 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449575 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.449763 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.449763 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.449763 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-textfile\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.449956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7af742e2-eeeb-45a2-8068-6740eb29f050-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.449956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-root\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.449956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbhxp\" (UniqueName: \"kubernetes.io/projected/6cf2e250-532b-4771-90e2-3ea21993512e-kube-api-access-mbhxp\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.449956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cf2e250-532b-4771-90e2-3ea21993512e-metrics-client-ca\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.450161 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.449951 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.450161 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.450021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-wtmp\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.450161 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.450068 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.450161 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.450107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.450161 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.450138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-sys\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.450411 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.450192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af742e2-eeeb-45a2-8068-6740eb29f050-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.450411 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.450228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkbl\" (UniqueName: \"kubernetes.io/projected/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-api-access-4jkbl\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.537970 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.537935 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.551279 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cf2e250-532b-4771-90e2-3ea21993512e-metrics-client-ca\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.551442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.551442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551389 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-wtmp\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.551442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.551574 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.551574 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-sys\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.551574 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:09:03.551503 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 21:09:03.551574 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af742e2-eeeb-45a2-8068-6740eb29f050-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.551574 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551563 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkbl\" (UniqueName: \"kubernetes.io/projected/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-api-access-4jkbl\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.551765 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:09:03.551576 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls podName:6cf2e250-532b-4771-90e2-3ea21993512e nodeName:}" failed. No retries permitted until 2026-06-05 21:09:04.051555691 +0000 UTC m=+233.143364120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls") pod "node-exporter-p55vj" (UID: "6cf2e250-532b-4771-90e2-3ea21993512e") : secret "node-exporter-tls" not found Jun 05 21:09:03.551765 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.551765 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.551765 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.551765 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-textfile\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7af742e2-eeeb-45a2-8068-6740eb29f050-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.552057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551805 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-root\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbhxp\" (UniqueName: \"kubernetes.io/projected/6cf2e250-532b-4771-90e2-3ea21993512e-kube-api-access-mbhxp\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.551898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cf2e250-532b-4771-90e2-3ea21993512e-metrics-client-ca\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.552007 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-wtmp\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.552057 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-sys\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552344 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.552329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cf2e250-532b-4771-90e2-3ea21993512e-root\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552450 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.552427 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552586 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.552564 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-textfile\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.552791 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.552750 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af742e2-eeeb-45a2-8068-6740eb29f050-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.553338 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.553276 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7af742e2-eeeb-45a2-8068-6740eb29f050-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.553338 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.553282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.555414 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.555393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.555690 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.555667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.555841 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.555821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.560367 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.560343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkbl\" (UniqueName: \"kubernetes.io/projected/7af742e2-eeeb-45a2-8068-6740eb29f050-kube-api-access-4jkbl\") pod \"kube-state-metrics-57bbf8bfb5-8kxd5\" (UID: \"7af742e2-eeeb-45a2-8068-6740eb29f050\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.560491 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.560413 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbhxp\" (UniqueName: \"kubernetes.io/projected/6cf2e250-532b-4771-90e2-3ea21993512e-kube-api-access-mbhxp\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:03.669207 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.669120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" Jun 05 21:09:03.681702 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.681670 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.785645 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.785613 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:03.831495 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:03.831405 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5"] Jun 05 21:09:03.835828 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:09:03.835788 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af742e2_eeeb_45a2_8068_6740eb29f050.slice/crio-e6d0f5df9b343e1141a8428e627b7df6e40466bed07a7855eb5cb5c42dfd0b8a WatchSource:0}: Error finding container e6d0f5df9b343e1141a8428e627b7df6e40466bed07a7855eb5cb5c42dfd0b8a: Status 404 returned error can't find the container with id e6d0f5df9b343e1141a8428e627b7df6e40466bed07a7855eb5cb5c42dfd0b8a Jun 05 21:09:04.058315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:04.058278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:04.058511 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:09:04.058451 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 21:09:04.058584 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:09:04.058530 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls podName:6cf2e250-532b-4771-90e2-3ea21993512e nodeName:}" failed. No retries permitted until 2026-06-05 21:09:05.058509386 +0000 UTC m=+234.150317814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls") pod "node-exporter-p55vj" (UID: "6cf2e250-532b-4771-90e2-3ea21993512e") : secret "node-exporter-tls" not found Jun 05 21:09:04.111603 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:04.111571 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:04.211594 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:04.211554 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:04.258559 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:04.258520 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" event={"ID":"7af742e2-eeeb-45a2-8068-6740eb29f050","Type":"ContainerStarted","Data":"e6d0f5df9b343e1141a8428e627b7df6e40466bed07a7855eb5cb5c42dfd0b8a"} Jun 05 21:09:04.323069 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:04.322998 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:04.390188 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:04.390150 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:05.070101 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:05.070048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:05.072966 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:05.072937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cf2e250-532b-4771-90e2-3ea21993512e-node-exporter-tls\") pod \"node-exporter-p55vj\" (UID: \"6cf2e250-532b-4771-90e2-3ea21993512e\") " pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:05.098486 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:05.098444 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:05.159457 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:05.159426 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p55vj" Jun 05 21:09:06.238474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:06.238430 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:06.302675 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:06.302640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:06.365599 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:06.365553 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:06.612497 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:06.612465 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:08.090260 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:08.090224 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:08.186112 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:08.186073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:08.288489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:08.288445 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:08.388592 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:08.388505 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:09.526517 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:09.526451 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:11.225416 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:09:11.225384 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf2e250_532b_4771_90e2_3ea21993512e.slice/crio-7eb034b3afae2c2f114f711db14c3901d9c058a451bf9ee8539e5d2cc6e212e7 WatchSource:0}: Error finding container 7eb034b3afae2c2f114f711db14c3901d9c058a451bf9ee8539e5d2cc6e212e7: Status 404 returned error can't find the container with id 7eb034b3afae2c2f114f711db14c3901d9c058a451bf9ee8539e5d2cc6e212e7 Jun 05 21:09:11.289747 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:11.289709 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p55vj" event={"ID":"6cf2e250-532b-4771-90e2-3ea21993512e","Type":"ContainerStarted","Data":"7eb034b3afae2c2f114f711db14c3901d9c058a451bf9ee8539e5d2cc6e212e7"} Jun 05 21:09:12.299335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:12.298788 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-mzx7s" event={"ID":"256fadf1-27d4-42e8-a7f2-c232fa5f7b14","Type":"ContainerStarted","Data":"9a1399fe6da3d1b85e8469460079779c82d7dd43dbe4447aa2bca4bdca906363"} Jun 05 21:09:12.299801 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:12.299777 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:09:12.314195 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:12.314134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-mzx7s" Jun 05 21:09:12.318028 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:12.317788 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-mzx7s" podStartSLOduration=1.546740282 podStartE2EDuration="18.317770734s" totalImagesPullingTime="16.771030452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:12.316717066 +0000 UTC m=+241.408525514" watchObservedRunningTime="2026-06-05 21:09:12.317770734 +0000 UTC m=+241.409579182" Jun 05 21:09:12.405760 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:12.405716 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:12.450151 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:12.450114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:13.098496 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.098449 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:13.204317 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.204237 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:13.306013 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.305970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" event={"ID":"7af742e2-eeeb-45a2-8068-6740eb29f050","Type":"ContainerStarted","Data":"b90c712c89e14e03a8f8c80f9eeaa6b5bfe4a07fd558236e99dd884b4ee83742"} Jun 05 21:09:13.306470 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.306085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" event={"ID":"7af742e2-eeeb-45a2-8068-6740eb29f050","Type":"ContainerStarted","Data":"89f1bd3572462c78eaabc43cc0086f548153f05db78056df6495d2db5799af32"} Jun 05 21:09:13.306470 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.306121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" event={"ID":"7af742e2-eeeb-45a2-8068-6740eb29f050","Type":"ContainerStarted","Data":"86caa76cbbd243e06ccf7c9b83dd20ee98521263fa818eae22ca3deb1d13f9ce"} Jun 05 21:09:13.308056 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.308024 2560 generic.go:356] "Generic (PLEG): container finished" podID="6cf2e250-532b-4771-90e2-3ea21993512e" containerID="0d64f75c4eab506044bd76dfcedc939a56e4bb80194fdd63b5e0d4eb01f49320" exitCode=0 Jun 05 21:09:13.308200 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.308111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p55vj" event={"ID":"6cf2e250-532b-4771-90e2-3ea21993512e","Type":"ContainerDied","Data":"0d64f75c4eab506044bd76dfcedc939a56e4bb80194fdd63b5e0d4eb01f49320"} Jun 05 21:09:13.323121 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:13.323061 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8kxd5" podStartSLOduration=1.53070945 podStartE2EDuration="10.323040469s" totalImagesPullingTime="8.792331019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:13.322037697 +0000 UTC m=+242.413846137" watchObservedRunningTime="2026-06-05 21:09:13.323040469 +0000 UTC m=+242.414848917" Jun 05 21:09:14.315889 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:14.315769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p55vj" event={"ID":"6cf2e250-532b-4771-90e2-3ea21993512e","Type":"ContainerStarted","Data":"5b775658f8dbc40c1cbf992f81a775ff568357b2b955466cb78ce19de18997c3"} Jun 05 21:09:14.315889 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:14.315843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p55vj" event={"ID":"6cf2e250-532b-4771-90e2-3ea21993512e","Type":"ContainerStarted","Data":"fcc0638da7e1a71f00075fb00ab8ac5b73640068fa7e85813ab23fbcbdeee623"} Jun 05 21:09:14.336534 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:14.336466 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p55vj" podStartSLOduration=9.830389547 podStartE2EDuration="11.336441474s" totalImagesPullingTime="1.401271133s" totalInitContainerRuntime="104.780794ms" isStatefulPod=true podCreationTimestamp="2026-06-05 21:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:14.333512906 +0000 UTC m=+243.425321355" watchObservedRunningTime="2026-06-05 21:09:14.336441474 +0000 UTC m=+243.428249922" Jun 05 21:09:21.995421 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:21.995387 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:22.044241 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:22.044212 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:22.338068 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:22.338034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:09:22.340440 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:22.340404 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c09588-5928-4c1d-bd02-fab0875d1829-metrics-certs\") pod \"network-metrics-daemon-qqkxx\" (UID: \"92c09588-5928-4c1d-bd02-fab0875d1829\") " pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:09:22.374710 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:22.374677 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nklfc\"" Jun 05 21:09:22.383241 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:22.383218 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqkxx" Jun 05 21:09:22.561008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:22.560979 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqkxx"] Jun 05 21:09:22.564287 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:09:22.564260 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c09588_5928_4c1d_bd02_fab0875d1829.slice/crio-9aa88cec7a574b2d4b817b4d5effe97a3da847e163823d1e4f503a986a092a2f WatchSource:0}: Error finding container 9aa88cec7a574b2d4b817b4d5effe97a3da847e163823d1e4f503a986a092a2f: Status 404 returned error can't find the container with id 9aa88cec7a574b2d4b817b4d5effe97a3da847e163823d1e4f503a986a092a2f Jun 05 21:09:23.355288 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:23.355243 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqkxx" event={"ID":"92c09588-5928-4c1d-bd02-fab0875d1829","Type":"ContainerStarted","Data":"9aa88cec7a574b2d4b817b4d5effe97a3da847e163823d1e4f503a986a092a2f"} Jun 05 21:09:23.799000 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:23.798946 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:23.843475 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:23.843446 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:24.363813 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:24.363779 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqkxx" event={"ID":"92c09588-5928-4c1d-bd02-fab0875d1829","Type":"ContainerStarted","Data":"afce33ed4c8d1d636c139e67c18f39b0b434e6c5d37807e721ad64422b6f9476"} Jun 05 21:09:25.369194 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:25.369154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqkxx" event={"ID":"92c09588-5928-4c1d-bd02-fab0875d1829","Type":"ContainerStarted","Data":"4154822b118fccf0adced2e8dcc57c91114d06912605ca00544bf05092cc2369"} Jun 05 21:09:25.384598 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:25.384548 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qqkxx" podStartSLOduration=252.797787968 podStartE2EDuration="4m14.384532724s" totalImagesPullingTime="1.586744756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:25.38266636 +0000 UTC m=+254.474474806" watchObservedRunningTime="2026-06-05 21:09:25.384532724 +0000 UTC m=+254.476341171" Jun 05 21:09:25.458687 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:25.458653 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:25.510086 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:25.510054 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:26.891688 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:26.891657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:32.030263 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:32.030187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:32.085991 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:32.085955 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:36.405708 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:36.405675 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:36.455315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:36.455285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:41.775683 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:41.775650 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:41.828517 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:41.828483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:45.689079 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:45.689044 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:45.735685 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:45.735651 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:49.506064 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:49.506031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:49.560485 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:49.560456 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:49.611525 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:49.611495 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:52.988017 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:09:52.987972 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hrh6l" podUID="dc1f1707-6f58-4b7f-a6cd-adc845cbb816" Jun 05 21:09:53.469783 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:53.469746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hrh6l" Jun 05 21:09:55.381604 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.381571 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:55.431357 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.431326 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:55.478893 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.478861 2560 generic.go:356] "Generic (PLEG): container finished" podID="f93ecaf5-1f73-41b5-9d7d-3646022ff30a" containerID="2e97213a4f56c9b86bc50f3cb95c2dbf2c08b0b94a03825f3f81a48b3965f7b6" exitCode=0 Jun 05 21:09:55.479082 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.478949 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" event={"ID":"f93ecaf5-1f73-41b5-9d7d-3646022ff30a","Type":"ContainerDied","Data":"2e97213a4f56c9b86bc50f3cb95c2dbf2c08b0b94a03825f3f81a48b3965f7b6"} Jun 05 21:09:55.479352 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.479321 2560 scope.go:117] "RemoveContainer" containerID="2e97213a4f56c9b86bc50f3cb95c2dbf2c08b0b94a03825f3f81a48b3965f7b6" Jun 05 21:09:55.480563 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.480539 2560 generic.go:356] "Generic (PLEG): container finished" podID="8ea9d83c-60ef-405c-8b19-f72f2172dfd8" containerID="13c7bb546140138f0ad2ec02c79eb690b8d9fb5e6c38d00e525b7f29b6fb763a" exitCode=0 Jun 05 21:09:55.480641 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.480573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" event={"ID":"8ea9d83c-60ef-405c-8b19-f72f2172dfd8","Type":"ContainerDied","Data":"13c7bb546140138f0ad2ec02c79eb690b8d9fb5e6c38d00e525b7f29b6fb763a"} Jun 05 21:09:55.480882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:55.480869 2560 scope.go:117] "RemoveContainer" containerID="13c7bb546140138f0ad2ec02c79eb690b8d9fb5e6c38d00e525b7f29b6fb763a" Jun 05 21:09:56.486121 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.486086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gm4n9" event={"ID":"f93ecaf5-1f73-41b5-9d7d-3646022ff30a","Type":"ContainerStarted","Data":"83bde1d5ff327a3f5816923bea2fb2ea5009808a8f22072892765b2882ef0e8a"} Jun 05 21:09:56.487817 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.487794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6h2q" event={"ID":"8ea9d83c-60ef-405c-8b19-f72f2172dfd8","Type":"ContainerStarted","Data":"eff55c83cd5507b4e835eaaed22ee078c53b36190db47a85cec6ba87ddbc3006"} Jun 05 21:09:56.720497 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.720459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:09:56.720665 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.720506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:09:56.722994 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.722961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"image-registry-64b57f48f6-qzfgx\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:09:56.722994 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.722973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1707-6f58-4b7f-a6cd-adc845cbb816-metrics-tls\") pod \"dns-default-hrh6l\" (UID: \"dc1f1707-6f58-4b7f-a6cd-adc845cbb816\") " pod="openshift-dns/dns-default-hrh6l" Jun 05 21:09:56.772402 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.772328 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zr9h5\"" Jun 05 21:09:56.773108 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.773092 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v8s2r\"" Jun 05 21:09:56.780882 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.780859 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hrh6l" Jun 05 21:09:56.782095 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.782080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:09:56.963392 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.963353 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hrh6l"] Jun 05 21:09:56.967469 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:09:56.967436 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1f1707_6f58_4b7f_a6cd_adc845cbb816.slice/crio-0fc8e80da642d4ffbae72105e8a5338b925d6e0eb94972a6803be371931a82df WatchSource:0}: Error finding container 0fc8e80da642d4ffbae72105e8a5338b925d6e0eb94972a6803be371931a82df: Status 404 returned error can't find the container with id 0fc8e80da642d4ffbae72105e8a5338b925d6e0eb94972a6803be371931a82df Jun 05 21:09:56.981490 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:56.981456 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b57f48f6-qzfgx"] Jun 05 21:09:56.985042 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:09:56.985015 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860b2e64_1542_40fb_b601_3961f176532a.slice/crio-ab91e2160c4c33df83a5dfaeae14d7f51b383a0ec756baf57b55a4fe81ac7a9c WatchSource:0}: Error finding container ab91e2160c4c33df83a5dfaeae14d7f51b383a0ec756baf57b55a4fe81ac7a9c: Status 404 returned error can't find the container with id ab91e2160c4c33df83a5dfaeae14d7f51b383a0ec756baf57b55a4fe81ac7a9c Jun 05 21:09:57.494433 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:57.494392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hrh6l" event={"ID":"dc1f1707-6f58-4b7f-a6cd-adc845cbb816","Type":"ContainerStarted","Data":"0fc8e80da642d4ffbae72105e8a5338b925d6e0eb94972a6803be371931a82df"} Jun 05 21:09:57.496335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:57.496304 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" event={"ID":"860b2e64-1542-40fb-b601-3961f176532a","Type":"ContainerStarted","Data":"75a0cd0b04a6b9e68fc56de845b35772e2027885be82a4663b86db1da21e619c"} Jun 05 21:09:57.496464 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:57.496354 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" event={"ID":"860b2e64-1542-40fb-b601-3961f176532a","Type":"ContainerStarted","Data":"ab91e2160c4c33df83a5dfaeae14d7f51b383a0ec756baf57b55a4fe81ac7a9c"} Jun 05 21:09:57.496530 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:57.496478 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:09:57.514755 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:57.514709 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" podStartSLOduration=286.51469342 podStartE2EDuration="4m46.51469342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:57.513272481 +0000 UTC m=+286.605080965" watchObservedRunningTime="2026-06-05 21:09:57.51469342 +0000 UTC m=+286.606501866" Jun 05 21:09:59.507422 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:59.507386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hrh6l" event={"ID":"dc1f1707-6f58-4b7f-a6cd-adc845cbb816","Type":"ContainerStarted","Data":"d55fdfaa0319405722b3a8d0a4a88829a505ee5ca29a396329c3768381ab3f2d"} Jun 05 21:09:59.507857 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:59.507465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hrh6l" event={"ID":"dc1f1707-6f58-4b7f-a6cd-adc845cbb816","Type":"ContainerStarted","Data":"e9600dfc1619ceed3c148884956106246fc3a5d8da9f772d7973fa54a9a35237"} Jun 05 21:09:59.507857 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:59.507542 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hrh6l" Jun 05 21:09:59.526010 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:09:59.525954 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hrh6l" podStartSLOduration=251.615017908 podStartE2EDuration="4m13.525935104s" totalImagesPullingTime="1.910917196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:59.524223496 +0000 UTC m=+288.616031943" watchObservedRunningTime="2026-06-05 21:09:59.525935104 +0000 UTC m=+288.617743542" Jun 05 21:10:03.632661 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:03.632629 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qxm4h_2a927a74-d42b-4b94-ba6e-6088830250b5/cluster-monitoring-operator/0.log" Jun 05 21:10:03.831615 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:03.831572 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8kxd5_7af742e2-eeeb-45a2-8068-6740eb29f050/kube-state-metrics/0.log" Jun 05 21:10:04.031221 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:04.031193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8kxd5_7af742e2-eeeb-45a2-8068-6740eb29f050/kube-rbac-proxy-main/0.log" Jun 05 21:10:04.231612 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:04.231531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8kxd5_7af742e2-eeeb-45a2-8068-6740eb29f050/kube-rbac-proxy-self/0.log" Jun 05 21:10:04.893611 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:04.893539 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:06.031234 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:06.031208 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p55vj_6cf2e250-532b-4771-90e2-3ea21993512e/init-textfile/0.log" Jun 05 21:10:06.232221 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:06.232190 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p55vj_6cf2e250-532b-4771-90e2-3ea21993512e/node-exporter/0.log" Jun 05 21:10:06.436828 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:06.436726 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p55vj_6cf2e250-532b-4771-90e2-3ea21993512e/kube-rbac-proxy/0.log" Jun 05 21:10:08.632158 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:08.632131 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9dp4d_c246e39b-d98e-4bf4-856c-c513eefca57b/prometheus-operator/0.log" Jun 05 21:10:08.831154 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:08.831126 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9dp4d_c246e39b-d98e-4bf4-856c-c513eefca57b/kube-rbac-proxy/0.log" Jun 05 21:10:09.031552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:09.031530 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-wdjv5_30d8877d-9f22-419b-9e43-878a8027a61e/prometheus-operator-admission-webhook/0.log" Jun 05 21:10:09.513777 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:09.513688 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hrh6l" Jun 05 21:10:10.432513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:10.432465 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-2sklf_4ae32549-40e3-4f29-9ffb-414cfca77b6c/networking-console-plugin/0.log" Jun 05 21:10:10.631963 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:10.631909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:10:10.833642 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:10.833612 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/2.log" Jun 05 21:10:11.308819 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.308794 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:10:11.309724 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.309698 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:10:11.318315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.318289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:10:11.319387 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.319365 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:10:11.322233 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.322212 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 21:10:11.432230 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.432115 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-mzx7s_256fadf1-27d4-42e8-a7f2-c232fa5f7b14/download-server/0.log" Jun 05 21:10:11.632454 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.632381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hrh6l_dc1f1707-6f58-4b7f-a6cd-adc845cbb816/dns/0.log" Jun 05 21:10:11.831631 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:11.831602 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hrh6l_dc1f1707-6f58-4b7f-a6cd-adc845cbb816/kube-rbac-proxy/0.log" Jun 05 21:10:12.074107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:12.074067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:12.128230 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:12.128203 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:12.187262 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:12.187225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:12.831037 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:12.831009 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rnbd_4adaeb64-a7e4-4f77-9df0-6c56ce5909a2/dns-node-resolver/0.log" Jun 05 21:10:13.431667 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:13.431642 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64b57f48f6-qzfgx_860b2e64-1542-40fb-b601-3961f176532a/registry/0.log" Jun 05 21:10:14.232202 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:14.232177 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lchd7_6d77f8c4-33ef-4d38-be34-d75e980a508c/node-ca/0.log" Jun 05 21:10:14.426188 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:14.426157 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:14.631740 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:14.631714 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fd8545cc7-6dt76_43014c37-8528-499d-abf3-105d6a0d6f0f/router/0.log" Jun 05 21:10:14.831772 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:14.831749 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6h5db_f9168ed4-c7e2-450f-ae4f-d059945630bc/serve-healthcheck-canary/0.log" Jun 05 21:10:16.605351 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:16.605321 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:16.787044 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:16.787007 2560 patch_prober.go:28] interesting pod/image-registry-64b57f48f6-qzfgx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:10:16.787200 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:16.787081 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" podUID="860b2e64-1542-40fb-b601-3961f176532a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:10:18.506512 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:18.506484 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:10:18.624462 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:18.624433 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:18.682040 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:18.681984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:18.753675 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:18.753642 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:18.802412 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:18.802377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:21.506207 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:21.506174 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b57f48f6-qzfgx"] Jun 05 21:10:21.571473 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:21.571443 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:21.621827 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:21.621795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:21.716077 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:21.716040 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:21.817606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:21.817580 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:22.476809 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:22.476773 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:22.596968 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:22.596939 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:26.589567 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:26.589533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:26.638595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:26.638565 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:27.649346 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:27.649316 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:27.750512 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:27.750479 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:28.104248 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:28.104214 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:28.204395 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:28.204343 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:28.304536 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:28.304503 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:31.055937 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:31.055891 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:31.154442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:31.154403 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:31.255328 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:31.255281 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:31.354372 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:31.354276 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:31.795736 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:31.795692 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:35.664142 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:35.664104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:35.766322 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:35.766287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:41.776174 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:41.776136 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:41.825883 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:41.825843 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:42.377004 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:42.376970 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:42.428305 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:42.428272 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:43.662338 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:43.662308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:46.525793 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.525749 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" podUID="860b2e64-1542-40fb-b601-3961f176532a" containerName="registry" containerID="cri-o://75a0cd0b04a6b9e68fc56de845b35772e2027885be82a4663b86db1da21e619c" gracePeriod=30 Jun 05 21:10:46.698280 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.698246 2560 generic.go:356] "Generic (PLEG): container finished" podID="860b2e64-1542-40fb-b601-3961f176532a" containerID="75a0cd0b04a6b9e68fc56de845b35772e2027885be82a4663b86db1da21e619c" exitCode=0 Jun 05 21:10:46.698432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.698294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" event={"ID":"860b2e64-1542-40fb-b601-3961f176532a","Type":"ContainerDied","Data":"75a0cd0b04a6b9e68fc56de845b35772e2027885be82a4663b86db1da21e619c"} Jun 05 21:10:46.769108 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.769075 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:10:46.848561 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848525 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-bound-sa-token\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848728 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848576 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-trusted-ca\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848728 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848599 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848728 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848618 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-registry-certificates\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848728 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848644 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-image-registry-private-configuration\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848728 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848665 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860b2e64-1542-40fb-b601-3961f176532a-ca-trust-extracted\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848977 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848741 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk28x\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-kube-api-access-sk28x\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.848977 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.848771 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-installation-pull-secrets\") pod \"860b2e64-1542-40fb-b601-3961f176532a\" (UID: \"860b2e64-1542-40fb-b601-3961f176532a\") " Jun 05 21:10:46.849166 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.849121 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:46.849308 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.849278 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:10:46.851373 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.851269 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:46.851373 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.851325 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:46.851538 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.851514 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:46.851842 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.851819 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-kube-api-access-sk28x" (OuterVolumeSpecName: "kube-api-access-sk28x") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "kube-api-access-sk28x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:46.851977 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.851957 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:10:46.858425 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.858403 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/860b2e64-1542-40fb-b601-3961f176532a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "860b2e64-1542-40fb-b601-3961f176532a" (UID: "860b2e64-1542-40fb-b601-3961f176532a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:10:46.949410 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949365 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860b2e64-1542-40fb-b601-3961f176532a-ca-trust-extracted\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949410 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949402 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk28x\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-kube-api-access-sk28x\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949410 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949416 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-installation-pull-secrets\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949648 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949429 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-bound-sa-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949648 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949440 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-trusted-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949648 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949451 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860b2e64-1542-40fb-b601-3961f176532a-registry-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949648 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949461 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860b2e64-1542-40fb-b601-3961f176532a-registry-certificates\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:46.949648 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:46.949473 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860b2e64-1542-40fb-b601-3961f176532a-image-registry-private-configuration\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:10:47.703496 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:47.703427 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" Jun 05 21:10:47.703892 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:47.703422 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b57f48f6-qzfgx" event={"ID":"860b2e64-1542-40fb-b601-3961f176532a","Type":"ContainerDied","Data":"ab91e2160c4c33df83a5dfaeae14d7f51b383a0ec756baf57b55a4fe81ac7a9c"} Jun 05 21:10:47.703892 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:47.703555 2560 scope.go:117] "RemoveContainer" containerID="75a0cd0b04a6b9e68fc56de845b35772e2027885be82a4663b86db1da21e619c" Jun 05 21:10:47.721343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:47.720598 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b57f48f6-qzfgx"] Jun 05 21:10:47.724707 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:47.724681 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64b57f48f6-qzfgx"] Jun 05 21:10:49.376201 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:49.376166 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="860b2e64-1542-40fb-b601-3961f176532a" path="/var/lib/kubelet/pods/860b2e64-1542-40fb-b601-3961f176532a/volumes" Jun 05 21:10:56.775075 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:56.775018 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:56.825670 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:10:56.825640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:30.217487 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:30.217451 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:33.355174 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:33.355140 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:33.454962 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:33.454906 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:37.699225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:37.699194 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:37.747653 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:37.747617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:49.576755 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:49.576723 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:49.623310 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:49.623270 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:50.070369 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:50.070330 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:50.119954 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:50.119910 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:50.215577 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:50.215547 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:50.263803 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:50.263768 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:50.816402 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:50.816367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:50.865064 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:50.865031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:53.179210 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:53.179177 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:56.780066 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:56.780035 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:56.879900 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:11:56.879863 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:00.654782 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:00.654745 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:00.760205 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:00.760172 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:03.897792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:03.897757 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:35.719876 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:35.719776 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:35.818761 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:35.818727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:36.252489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.252443 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv"] Jun 05 21:12:36.252768 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.252756 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="860b2e64-1542-40fb-b601-3961f176532a" containerName="registry" Jun 05 21:12:36.252810 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.252769 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="860b2e64-1542-40fb-b601-3961f176532a" containerName="registry" Jun 05 21:12:36.252844 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.252832 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="860b2e64-1542-40fb-b601-3961f176532a" containerName="registry" Jun 05 21:12:36.255803 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.255788 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.258112 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.258089 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:12:36.259061 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.259040 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:12:36.259159 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.259046 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2fnxd\"" Jun 05 21:12:36.264675 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.264651 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv"] Jun 05 21:12:36.306474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.306439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdpfx\" (UniqueName: \"kubernetes.io/projected/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-kube-api-access-mdpfx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.306474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.306486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.306689 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.306523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.407551 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.407513 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.407711 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.407568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.407711 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.407605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdpfx\" (UniqueName: \"kubernetes.io/projected/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-kube-api-access-mdpfx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.407900 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.407871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.407960 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.407897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.415351 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.415323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdpfx\" (UniqueName: \"kubernetes.io/projected/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-kube-api-access-mdpfx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.566658 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.566617 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:36.696894 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.696859 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv"] Jun 05 21:12:36.700822 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:12:36.700792 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34d40cf_429d_4ce7_9b21_9bdfcb538b9b.slice/crio-981d0db3e1b35129949f480f2d30a070ef71c944071ebb3cc7c16b1225e979da WatchSource:0}: Error finding container 981d0db3e1b35129949f480f2d30a070ef71c944071ebb3cc7c16b1225e979da: Status 404 returned error can't find the container with id 981d0db3e1b35129949f480f2d30a070ef71c944071ebb3cc7c16b1225e979da Jun 05 21:12:36.702692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:36.702678 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:12:37.122354 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:37.122318 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" event={"ID":"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b","Type":"ContainerStarted","Data":"981d0db3e1b35129949f480f2d30a070ef71c944071ebb3cc7c16b1225e979da"} Jun 05 21:12:43.152300 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:43.152205 2560 generic.go:356] "Generic (PLEG): container finished" podID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerID="299bf642c52243d94a3d11c5bb80634e17c68edcc9bf75a885e57c4f4ec8301b" exitCode=0 Jun 05 21:12:43.152708 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:43.152293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" event={"ID":"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b","Type":"ContainerDied","Data":"299bf642c52243d94a3d11c5bb80634e17c68edcc9bf75a885e57c4f4ec8301b"} Jun 05 21:12:46.167738 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:46.167704 2560 generic.go:356] "Generic (PLEG): container finished" podID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerID="e1a2a374cee2ac62abb84bd5e16b55f5b2d98d6bdb18e2a92cfa361f8aab7b64" exitCode=0 Jun 05 21:12:46.168166 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:46.167784 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" event={"ID":"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b","Type":"ContainerDied","Data":"e1a2a374cee2ac62abb84bd5e16b55f5b2d98d6bdb18e2a92cfa361f8aab7b64"} Jun 05 21:12:47.653606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:47.653570 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:54.203947 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:54.203896 2560 generic.go:356] "Generic (PLEG): container finished" podID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerID="8d7538b5f3954012c2960fd97608b643131973ef0af68585f95b586c8a5e3ff9" exitCode=0 Jun 05 21:12:54.204362 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:54.203961 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" event={"ID":"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b","Type":"ContainerDied","Data":"8d7538b5f3954012c2960fd97608b643131973ef0af68585f95b586c8a5e3ff9"} Jun 05 21:12:55.344205 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.344179 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:55.473374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.473287 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-bundle\") pod \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " Jun 05 21:12:55.473374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.473355 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-util\") pod \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " Jun 05 21:12:55.473374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.473377 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdpfx\" (UniqueName: \"kubernetes.io/projected/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-kube-api-access-mdpfx\") pod \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\" (UID: \"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b\") " Jun 05 21:12:55.474158 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.474134 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-bundle" (OuterVolumeSpecName: "bundle") pod "f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" (UID: "f34d40cf-429d-4ce7-9b21-9bdfcb538b9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:12:55.475612 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.475590 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-kube-api-access-mdpfx" (OuterVolumeSpecName: "kube-api-access-mdpfx") pod "f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" (UID: "f34d40cf-429d-4ce7-9b21-9bdfcb538b9b"). InnerVolumeSpecName "kube-api-access-mdpfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:12:55.478806 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.478777 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-util" (OuterVolumeSpecName: "util") pod "f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" (UID: "f34d40cf-429d-4ce7-9b21-9bdfcb538b9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:12:55.574961 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.574932 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-util\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:12:55.574961 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.574958 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdpfx\" (UniqueName: \"kubernetes.io/projected/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-kube-api-access-mdpfx\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:12:55.575116 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:55.574970 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f34d40cf-429d-4ce7-9b21-9bdfcb538b9b-bundle\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:12:56.214511 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:56.214475 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" event={"ID":"f34d40cf-429d-4ce7-9b21-9bdfcb538b9b","Type":"ContainerDied","Data":"981d0db3e1b35129949f480f2d30a070ef71c944071ebb3cc7c16b1225e979da"} Jun 05 21:12:56.214511 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:56.214495 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dswznv" Jun 05 21:12:56.214752 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:56.214523 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="981d0db3e1b35129949f480f2d30a070ef71c944071ebb3cc7c16b1225e979da" Jun 05 21:12:59.742712 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:12:59.742678 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:01.135465 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.135426 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:01.682529 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682499 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb"] Jun 05 21:13:01.682797 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682785 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="pull" Jun 05 21:13:01.682847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682798 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="pull" Jun 05 21:13:01.682847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682810 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="util" Jun 05 21:13:01.682847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682816 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="util" Jun 05 21:13:01.682847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682827 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="extract" Jun 05 21:13:01.682847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682833 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="extract" Jun 05 21:13:01.683041 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.682892 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34d40cf-429d-4ce7-9b21-9bdfcb538b9b" containerName="extract" Jun 05 21:13:01.685734 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.685716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.688272 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.688245 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vksx5\"" Jun 05 21:13:01.688272 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.688245 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:13:01.688451 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.688346 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 21:13:01.699370 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.699342 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb"] Jun 05 21:13:01.829233 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.829195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g4vj\" (UniqueName: \"kubernetes.io/projected/47878c66-f94c-49e7-9b47-1b04b39e9313-kube-api-access-9g4vj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5pmdb\" (UID: \"47878c66-f94c-49e7-9b47-1b04b39e9313\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.829420 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.829253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47878c66-f94c-49e7-9b47-1b04b39e9313-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5pmdb\" (UID: \"47878c66-f94c-49e7-9b47-1b04b39e9313\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.930150 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.930119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47878c66-f94c-49e7-9b47-1b04b39e9313-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5pmdb\" (UID: \"47878c66-f94c-49e7-9b47-1b04b39e9313\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.930316 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.930181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g4vj\" (UniqueName: \"kubernetes.io/projected/47878c66-f94c-49e7-9b47-1b04b39e9313-kube-api-access-9g4vj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5pmdb\" (UID: \"47878c66-f94c-49e7-9b47-1b04b39e9313\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.930512 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.930493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47878c66-f94c-49e7-9b47-1b04b39e9313-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5pmdb\" (UID: \"47878c66-f94c-49e7-9b47-1b04b39e9313\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.939848 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.939786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g4vj\" (UniqueName: \"kubernetes.io/projected/47878c66-f94c-49e7-9b47-1b04b39e9313-kube-api-access-9g4vj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5pmdb\" (UID: \"47878c66-f94c-49e7-9b47-1b04b39e9313\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:01.994774 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:01.994746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" Jun 05 21:13:02.129813 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:02.129788 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb"] Jun 05 21:13:02.132782 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:13:02.132753 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47878c66_f94c_49e7_9b47_1b04b39e9313.slice/crio-fdedcb438adbaa364727aa2e433060ad3f86e7b466b7b2a824164ca05784afab WatchSource:0}: Error finding container fdedcb438adbaa364727aa2e433060ad3f86e7b466b7b2a824164ca05784afab: Status 404 returned error can't find the container with id fdedcb438adbaa364727aa2e433060ad3f86e7b466b7b2a824164ca05784afab Jun 05 21:13:02.240370 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:02.240296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" event={"ID":"47878c66-f94c-49e7-9b47-1b04b39e9313","Type":"ContainerStarted","Data":"fdedcb438adbaa364727aa2e433060ad3f86e7b466b7b2a824164ca05784afab"} Jun 05 21:13:03.349288 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:03.349255 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:03.449787 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:03.449747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:04.251149 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:04.251064 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" event={"ID":"47878c66-f94c-49e7-9b47-1b04b39e9313","Type":"ContainerStarted","Data":"d5e2501307a51dc486854dad13e3c71b315d9516c294c8bad50e150aed0290c7"} Jun 05 21:13:04.280192 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:04.280142 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5pmdb" podStartSLOduration=1.608817716 podStartE2EDuration="3.280124135s" totalImagesPullingTime="1.671306419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:04.278068735 +0000 UTC m=+473.369877205" watchObservedRunningTime="2026-06-05 21:13:04.280124135 +0000 UTC m=+473.371932559" Jun 05 21:13:04.674029 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:04.673964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:04.774603 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:04.774574 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:06.204008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.203967 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7f59m"] Jun 05 21:13:06.207209 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.207188 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.209374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.209356 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 21:13:06.210151 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.210129 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dnnfb\"" Jun 05 21:13:06.210264 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.210136 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 21:13:06.216624 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.216603 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7f59m"] Jun 05 21:13:06.364688 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.364655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d48d4671-2cf0-478d-9bd0-6634018bcd75-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7f59m\" (UID: \"d48d4671-2cf0-478d-9bd0-6634018bcd75\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.364838 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.364701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qr2d\" (UniqueName: \"kubernetes.io/projected/d48d4671-2cf0-478d-9bd0-6634018bcd75-kube-api-access-8qr2d\") pod \"cert-manager-webhook-7dc76cbb94-7f59m\" (UID: \"d48d4671-2cf0-478d-9bd0-6634018bcd75\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.465439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.465355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d48d4671-2cf0-478d-9bd0-6634018bcd75-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7f59m\" (UID: \"d48d4671-2cf0-478d-9bd0-6634018bcd75\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.465439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.465398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qr2d\" (UniqueName: \"kubernetes.io/projected/d48d4671-2cf0-478d-9bd0-6634018bcd75-kube-api-access-8qr2d\") pod \"cert-manager-webhook-7dc76cbb94-7f59m\" (UID: \"d48d4671-2cf0-478d-9bd0-6634018bcd75\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.472806 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.472775 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d48d4671-2cf0-478d-9bd0-6634018bcd75-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7f59m\" (UID: \"d48d4671-2cf0-478d-9bd0-6634018bcd75\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.473082 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.473062 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qr2d\" (UniqueName: \"kubernetes.io/projected/d48d4671-2cf0-478d-9bd0-6634018bcd75-kube-api-access-8qr2d\") pod \"cert-manager-webhook-7dc76cbb94-7f59m\" (UID: \"d48d4671-2cf0-478d-9bd0-6634018bcd75\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.527638 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.527591 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:06.652009 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:06.651937 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7f59m"] Jun 05 21:13:06.654266 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:13:06.654237 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd48d4671_2cf0_478d_9bd0_6634018bcd75.slice/crio-05c6228e22d074eb568113d1d704ee515da06ccfe0d7e05a8eef309bb8c8a600 WatchSource:0}: Error finding container 05c6228e22d074eb568113d1d704ee515da06ccfe0d7e05a8eef309bb8c8a600: Status 404 returned error can't find the container with id 05c6228e22d074eb568113d1d704ee515da06ccfe0d7e05a8eef309bb8c8a600 Jun 05 21:13:07.266764 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:07.266727 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" event={"ID":"d48d4671-2cf0-478d-9bd0-6634018bcd75","Type":"ContainerStarted","Data":"05c6228e22d074eb568113d1d704ee515da06ccfe0d7e05a8eef309bb8c8a600"} Jun 05 21:13:08.094419 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:08.094385 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:08.471183 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:08.471099 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:09.278104 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:09.278064 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" event={"ID":"d48d4671-2cf0-478d-9bd0-6634018bcd75","Type":"ContainerStarted","Data":"dae1586782980b6c91ad8a80eea274e0133b98c8a8f71484407a3943444bc4b7"} Jun 05 21:13:09.278332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:09.278129 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:09.294367 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:09.294315 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" podStartSLOduration=0.897613747 podStartE2EDuration="3.294301537s" totalImagesPullingTime="2.39668779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:09.293581554 +0000 UTC m=+478.385390012" watchObservedRunningTime="2026-06-05 21:13:09.294301537 +0000 UTC m=+478.386109984" Jun 05 21:13:10.150038 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:10.150004 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:10.250105 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:10.250071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:15.281180 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:15.281113 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:15.284428 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:15.284405 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7f59m" Jun 05 21:13:17.010502 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.010459 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-jpqvp"] Jun 05 21:13:17.015133 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.015103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.017365 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.017339 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4gsxx\"" Jun 05 21:13:17.022149 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.022120 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-jpqvp"] Jun 05 21:13:17.150667 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.150630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhzs\" (UniqueName: \"kubernetes.io/projected/32df3a96-ef50-48fc-8bea-c6713c4d1f2c-kube-api-access-tlhzs\") pod \"cert-manager-59c77684cc-jpqvp\" (UID: \"32df3a96-ef50-48fc-8bea-c6713c4d1f2c\") " pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.150824 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.150734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32df3a96-ef50-48fc-8bea-c6713c4d1f2c-bound-sa-token\") pod \"cert-manager-59c77684cc-jpqvp\" (UID: \"32df3a96-ef50-48fc-8bea-c6713c4d1f2c\") " pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.251704 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.251667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32df3a96-ef50-48fc-8bea-c6713c4d1f2c-bound-sa-token\") pod \"cert-manager-59c77684cc-jpqvp\" (UID: \"32df3a96-ef50-48fc-8bea-c6713c4d1f2c\") " pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.251874 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.251723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhzs\" (UniqueName: \"kubernetes.io/projected/32df3a96-ef50-48fc-8bea-c6713c4d1f2c-kube-api-access-tlhzs\") pod \"cert-manager-59c77684cc-jpqvp\" (UID: \"32df3a96-ef50-48fc-8bea-c6713c4d1f2c\") " pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.263499 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.263426 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32df3a96-ef50-48fc-8bea-c6713c4d1f2c-bound-sa-token\") pod \"cert-manager-59c77684cc-jpqvp\" (UID: \"32df3a96-ef50-48fc-8bea-c6713c4d1f2c\") " pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.264884 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.264859 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhzs\" (UniqueName: \"kubernetes.io/projected/32df3a96-ef50-48fc-8bea-c6713c4d1f2c-kube-api-access-tlhzs\") pod \"cert-manager-59c77684cc-jpqvp\" (UID: \"32df3a96-ef50-48fc-8bea-c6713c4d1f2c\") " pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.325841 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.325802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-jpqvp" Jun 05 21:13:17.461172 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:17.461147 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-jpqvp"] Jun 05 21:13:17.463608 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:13:17.463580 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32df3a96_ef50_48fc_8bea_c6713c4d1f2c.slice/crio-4a2139622141afd78c1dfb9e292147513a9d0bb1055d852fd8bc0f74d1b36812 WatchSource:0}: Error finding container 4a2139622141afd78c1dfb9e292147513a9d0bb1055d852fd8bc0f74d1b36812: Status 404 returned error can't find the container with id 4a2139622141afd78c1dfb9e292147513a9d0bb1055d852fd8bc0f74d1b36812 Jun 05 21:13:18.317257 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:18.317211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-jpqvp" event={"ID":"32df3a96-ef50-48fc-8bea-c6713c4d1f2c","Type":"ContainerStarted","Data":"1fd722cbcfcd33248bb2cca51488beeb2ba2f9c71cbf4bcb652ec0d057ebe120"} Jun 05 21:13:18.317637 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:18.317267 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-jpqvp" event={"ID":"32df3a96-ef50-48fc-8bea-c6713c4d1f2c","Type":"ContainerStarted","Data":"4a2139622141afd78c1dfb9e292147513a9d0bb1055d852fd8bc0f74d1b36812"} Jun 05 21:13:18.332135 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:18.332084 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-jpqvp" podStartSLOduration=2.332067131 podStartE2EDuration="2.332067131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:18.331600378 +0000 UTC m=+487.423408826" watchObservedRunningTime="2026-06-05 21:13:18.332067131 +0000 UTC m=+487.423875578" Jun 05 21:13:21.264691 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:21.264658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:21.313847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:21.313811 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:32.666834 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:32.666798 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:32.765204 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:32.765168 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:37.595574 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:37.595545 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:37.695117 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:37.695080 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:39.653682 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.653632 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:39.747854 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.747817 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv"] Jun 05 21:13:39.751562 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.751543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.753931 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.753893 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2fnxd\"" Jun 05 21:13:39.754063 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.753896 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:13:39.754063 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.753897 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:13:39.758134 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.758111 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv"] Jun 05 21:13:39.829433 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.829395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2wst\" (UniqueName: \"kubernetes.io/projected/9524c274-ba1d-47cb-868d-40d86c2ace0e-kube-api-access-x2wst\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.829606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.829443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.829606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.829477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.930595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.930505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2wst\" (UniqueName: \"kubernetes.io/projected/9524c274-ba1d-47cb-868d-40d86c2ace0e-kube-api-access-x2wst\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.930595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.930555 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.930595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.930595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.931068 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.931044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.931125 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.931056 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:39.938462 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:39.938437 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2wst\" (UniqueName: \"kubernetes.io/projected/9524c274-ba1d-47cb-868d-40d86c2ace0e-kube-api-access-x2wst\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:40.064552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:40.064517 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:40.197653 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:40.197625 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv"] Jun 05 21:13:40.200205 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:13:40.200175 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9524c274_ba1d_47cb_868d_40d86c2ace0e.slice/crio-a2e62dec0f3b82efca0055ceb0ddbc450c1d0e674660d66e2c0c78826c3de8da WatchSource:0}: Error finding container a2e62dec0f3b82efca0055ceb0ddbc450c1d0e674660d66e2c0c78826c3de8da: Status 404 returned error can't find the container with id a2e62dec0f3b82efca0055ceb0ddbc450c1d0e674660d66e2c0c78826c3de8da Jun 05 21:13:40.414429 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:40.414394 2560 generic.go:356] "Generic (PLEG): container finished" podID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerID="ed814fe29c7fc4374674552e86a2836b49fe725e2380347b4dcc16b6e4b68691" exitCode=0 Jun 05 21:13:40.414594 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:40.414477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" event={"ID":"9524c274-ba1d-47cb-868d-40d86c2ace0e","Type":"ContainerDied","Data":"ed814fe29c7fc4374674552e86a2836b49fe725e2380347b4dcc16b6e4b68691"} Jun 05 21:13:40.414594 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:40.414530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" event={"ID":"9524c274-ba1d-47cb-868d-40d86c2ace0e","Type":"ContainerStarted","Data":"a2e62dec0f3b82efca0055ceb0ddbc450c1d0e674660d66e2c0c78826c3de8da"} Jun 05 21:13:41.421206 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:41.421173 2560 generic.go:356] "Generic (PLEG): container finished" podID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerID="cfff8e0dfa9f7023e45d5f28f0038029b011357575d6c44aa6ba23478ae4065a" exitCode=0 Jun 05 21:13:41.421690 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:41.421242 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" event={"ID":"9524c274-ba1d-47cb-868d-40d86c2ace0e","Type":"ContainerDied","Data":"cfff8e0dfa9f7023e45d5f28f0038029b011357575d6c44aa6ba23478ae4065a"} Jun 05 21:13:42.427811 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:42.427775 2560 generic.go:356] "Generic (PLEG): container finished" podID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerID="84a87d970977a206e21b9e55cf5cd58a5c3543597254d2256a45ded90fafbfba" exitCode=0 Jun 05 21:13:42.428202 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:42.427859 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" event={"ID":"9524c274-ba1d-47cb-868d-40d86c2ace0e","Type":"ContainerDied","Data":"84a87d970977a206e21b9e55cf5cd58a5c3543597254d2256a45ded90fafbfba"} Jun 05 21:13:43.574240 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.574216 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:43.659579 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.659547 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-util\") pod \"9524c274-ba1d-47cb-868d-40d86c2ace0e\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " Jun 05 21:13:43.659776 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.659610 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2wst\" (UniqueName: \"kubernetes.io/projected/9524c274-ba1d-47cb-868d-40d86c2ace0e-kube-api-access-x2wst\") pod \"9524c274-ba1d-47cb-868d-40d86c2ace0e\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " Jun 05 21:13:43.659776 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.659660 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-bundle\") pod \"9524c274-ba1d-47cb-868d-40d86c2ace0e\" (UID: \"9524c274-ba1d-47cb-868d-40d86c2ace0e\") " Jun 05 21:13:43.660415 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.660379 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-bundle" (OuterVolumeSpecName: "bundle") pod "9524c274-ba1d-47cb-868d-40d86c2ace0e" (UID: "9524c274-ba1d-47cb-868d-40d86c2ace0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:13:43.661664 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.661646 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9524c274-ba1d-47cb-868d-40d86c2ace0e-kube-api-access-x2wst" (OuterVolumeSpecName: "kube-api-access-x2wst") pod "9524c274-ba1d-47cb-868d-40d86c2ace0e" (UID: "9524c274-ba1d-47cb-868d-40d86c2ace0e"). InnerVolumeSpecName "kube-api-access-x2wst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:13:43.665195 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.665170 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-util" (OuterVolumeSpecName: "util") pod "9524c274-ba1d-47cb-868d-40d86c2ace0e" (UID: "9524c274-ba1d-47cb-868d-40d86c2ace0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:13:43.760742 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.760656 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-util\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:13:43.760742 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.760687 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2wst\" (UniqueName: \"kubernetes.io/projected/9524c274-ba1d-47cb-868d-40d86c2ace0e-kube-api-access-x2wst\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:13:43.760742 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.760697 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9524c274-ba1d-47cb-868d-40d86c2ace0e-bundle\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:13:43.871216 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.871176 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:43.961704 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.961674 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j"] Jun 05 21:13:43.962003 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.961988 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="pull" Jun 05 21:13:43.962003 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.962002 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="pull" Jun 05 21:13:43.962148 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.962012 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="extract" Jun 05 21:13:43.962148 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.962018 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="extract" Jun 05 21:13:43.962148 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.962036 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="util" Jun 05 21:13:43.962148 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.962041 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="util" Jun 05 21:13:43.962148 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.962091 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9524c274-ba1d-47cb-868d-40d86c2ace0e" containerName="extract" Jun 05 21:13:43.965937 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.965893 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:43.971289 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.971257 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-24s78\"" Jun 05 21:13:43.971432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.971299 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 21:13:43.971432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.971332 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 21:13:43.971432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.971343 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 21:13:43.972105 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.972084 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:13:43.972207 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.972162 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 21:13:43.983092 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.983058 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:43.983392 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:43.983374 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j"] Jun 05 21:13:44.063274 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.063240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b6b308c-f6d6-476a-b1f0-55a16332604d-manager-config\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.063417 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.063278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl5tf\" (UniqueName: \"kubernetes.io/projected/3b6b308c-f6d6-476a-b1f0-55a16332604d-kube-api-access-wl5tf\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.063417 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.063300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6b308c-f6d6-476a-b1f0-55a16332604d-cert\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.063417 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.063328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b6b308c-f6d6-476a-b1f0-55a16332604d-metrics-cert\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.163857 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.163816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b6b308c-f6d6-476a-b1f0-55a16332604d-manager-config\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.164047 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.163880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl5tf\" (UniqueName: \"kubernetes.io/projected/3b6b308c-f6d6-476a-b1f0-55a16332604d-kube-api-access-wl5tf\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.164047 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.163908 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6b308c-f6d6-476a-b1f0-55a16332604d-cert\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.164047 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.163957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b6b308c-f6d6-476a-b1f0-55a16332604d-metrics-cert\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.164750 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.164689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b6b308c-f6d6-476a-b1f0-55a16332604d-manager-config\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.166692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.166671 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6b308c-f6d6-476a-b1f0-55a16332604d-cert\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.167692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.167672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b6b308c-f6d6-476a-b1f0-55a16332604d-metrics-cert\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.172358 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.172329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl5tf\" (UniqueName: \"kubernetes.io/projected/3b6b308c-f6d6-476a-b1f0-55a16332604d-kube-api-access-wl5tf\") pod \"lws-controller-manager-77f48f848-4gv7j\" (UID: \"3b6b308c-f6d6-476a-b1f0-55a16332604d\") " pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.275817 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.275780 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:44.405139 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.405108 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j"] Jun 05 21:13:44.407829 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:13:44.407799 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6b308c_f6d6_476a_b1f0_55a16332604d.slice/crio-d073b4b3cd3302de39c67ec14960ab64b84c7abdee03cdf69f475c9f13d6b5ea WatchSource:0}: Error finding container d073b4b3cd3302de39c67ec14960ab64b84c7abdee03cdf69f475c9f13d6b5ea: Status 404 returned error can't find the container with id d073b4b3cd3302de39c67ec14960ab64b84c7abdee03cdf69f475c9f13d6b5ea Jun 05 21:13:44.438659 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.438628 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" Jun 05 21:13:44.438659 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.438642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdthwqv" event={"ID":"9524c274-ba1d-47cb-868d-40d86c2ace0e","Type":"ContainerDied","Data":"a2e62dec0f3b82efca0055ceb0ddbc450c1d0e674660d66e2c0c78826c3de8da"} Jun 05 21:13:44.438864 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.438698 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2e62dec0f3b82efca0055ceb0ddbc450c1d0e674660d66e2c0c78826c3de8da" Jun 05 21:13:44.439883 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:44.439855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" event={"ID":"3b6b308c-f6d6-476a-b1f0-55a16332604d","Type":"ContainerStarted","Data":"d073b4b3cd3302de39c67ec14960ab64b84c7abdee03cdf69f475c9f13d6b5ea"} Jun 05 21:13:47.455847 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:47.455811 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" event={"ID":"3b6b308c-f6d6-476a-b1f0-55a16332604d","Type":"ContainerStarted","Data":"36615e4a2a084489424a4545ba058b2b13060a76fbb8fe466c83975432e2ba2c"} Jun 05 21:13:47.456277 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:47.455950 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:47.471542 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:47.471489 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" podStartSLOduration=2.4644366 podStartE2EDuration="4.47147286s" totalImagesPullingTime="2.00703626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:47.470741174 +0000 UTC m=+516.562549645" watchObservedRunningTime="2026-06-05 21:13:47.47147286 +0000 UTC m=+516.563281305" Jun 05 21:13:53.229668 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:53.229630 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:53.333079 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:53.333048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.053394 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.053363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.261211 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.261174 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.373272 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.373188 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.427285 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.427250 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb"] Jun 05 21:13:54.430760 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.430738 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.434144 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.434123 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 21:13:54.434250 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.434239 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 21:13:54.434513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.434496 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 21:13:54.434591 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.434557 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmwlw\"" Jun 05 21:13:54.434992 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.434980 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 21:13:54.454880 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.454849 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb"] Jun 05 21:13:54.534046 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.534014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.551247 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.551216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqzj\" (UniqueName: \"kubernetes.io/projected/fbfb5d6e-c1e9-49b9-8286-433d69739e54-kube-api-access-tlqzj\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.551341 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.551256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbfb5d6e-c1e9-49b9-8286-433d69739e54-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.551341 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.551280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbfb5d6e-c1e9-49b9-8286-433d69739e54-tmp\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.551418 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.551383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fbfb5d6e-c1e9-49b9-8286-433d69739e54-manifests\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.551452 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.551421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fbfb5d6e-c1e9-49b9-8286-433d69739e54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.642583 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.642502 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.652799 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.652770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbfb5d6e-c1e9-49b9-8286-433d69739e54-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.652994 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.652809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbfb5d6e-c1e9-49b9-8286-433d69739e54-tmp\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.652994 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.652964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fbfb5d6e-c1e9-49b9-8286-433d69739e54-manifests\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.653107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.653016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fbfb5d6e-c1e9-49b9-8286-433d69739e54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.653107 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.653087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqzj\" (UniqueName: \"kubernetes.io/projected/fbfb5d6e-c1e9-49b9-8286-433d69739e54-kube-api-access-tlqzj\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.653362 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.653341 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fbfb5d6e-c1e9-49b9-8286-433d69739e54-manifests\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.655568 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.655543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fbfb5d6e-c1e9-49b9-8286-433d69739e54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.655686 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.655620 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbfb5d6e-c1e9-49b9-8286-433d69739e54-tmp\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.655875 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.655857 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbfb5d6e-c1e9-49b9-8286-433d69739e54-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.660594 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.660566 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqzj\" (UniqueName: \"kubernetes.io/projected/fbfb5d6e-c1e9-49b9-8286-433d69739e54-kube-api-access-tlqzj\") pod \"opendatahub-operator-controller-manager-5b79b9d749-hbvpb\" (UID: \"fbfb5d6e-c1e9-49b9-8286-433d69739e54\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.736742 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.736700 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.740694 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.740678 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:13:54.838529 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.838491 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.900269 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.898720 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb"] Jun 05 21:13:54.911474 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.904628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:54.966128 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:54.966091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:55.498150 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:55.498071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" event={"ID":"fbfb5d6e-c1e9-49b9-8286-433d69739e54","Type":"ContainerStarted","Data":"1177e4e4afc33b206cd4c9d6d70f8568feb2e84a3d861359f1dd3167ffa64044"} Jun 05 21:13:58.463912 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:58.463882 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77f48f848-4gv7j" Jun 05 21:13:58.517286 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:58.517251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" event={"ID":"fbfb5d6e-c1e9-49b9-8286-433d69739e54","Type":"ContainerStarted","Data":"fba06de6fad31c17ae20dd5bf50480c990366a5e8b101bb2b4688c9fe0accdde"} Jun 05 21:13:59.523940 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:59.523886 2560 generic.go:356] "Generic (PLEG): container finished" podID="fbfb5d6e-c1e9-49b9-8286-433d69739e54" containerID="fba06de6fad31c17ae20dd5bf50480c990366a5e8b101bb2b4688c9fe0accdde" exitCode=0 Jun 05 21:13:59.524343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:13:59.523958 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" event={"ID":"fbfb5d6e-c1e9-49b9-8286-433d69739e54","Type":"ContainerDied","Data":"fba06de6fad31c17ae20dd5bf50480c990366a5e8b101bb2b4688c9fe0accdde"} Jun 05 21:14:00.535626 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:00.535583 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" event={"ID":"fbfb5d6e-c1e9-49b9-8286-433d69739e54","Type":"ContainerStarted","Data":"6cb08d3dbcec2f709581449579ed2d96ae6367bba34fc7a4304cbad238f9e861"} Jun 05 21:14:00.536015 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:00.535722 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:14:00.558572 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:00.558520 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" podStartSLOduration=2.37460752 podStartE2EDuration="6.558504623s" totalImagesPullingTime="3.121394409s" totalInitContainerRuntime="1.062502694s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:00.556193707 +0000 UTC m=+529.648002155" watchObservedRunningTime="2026-06-05 21:14:00.558504623 +0000 UTC m=+529.650313070" Jun 05 21:14:05.629550 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:05.629520 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:05.731397 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:05.731365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:11.541888 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:11.541855 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b79b9d749-hbvpb" Jun 05 21:14:13.160118 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:13.160076 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:13.264494 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:13.264463 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:13.728105 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:13.728071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:13.787407 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:13.787373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:13.987174 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:13.987090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:14.163560 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:14.163524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:14.531449 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:14.531421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:20.641286 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:20.641256 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:20.751263 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:20.751232 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:22.792888 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:22.792855 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:22.909475 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:22.909438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:23.548423 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:23.548385 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:23.625383 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:23.625348 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:23.705959 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:23.705901 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:24.015730 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:24.015649 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:24.130730 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:24.130696 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:24.277440 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:24.277363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:24.799840 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:24.799809 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:24.878137 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:24.878101 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:24.937339 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:24.937303 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:37.531674 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:37.531637 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:37.620927 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:37.620880 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:38.567709 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:38.567672 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:39.330435 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:39.330404 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:39.534665 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:39.534627 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:39.886180 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:39.886142 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:40.817969 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.817929 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-866f84b4bb-c28mc"] Jun 05 21:14:40.820266 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.820248 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:40.822579 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.822553 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5fpgb\"" Jun 05 21:14:40.822579 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.822571 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 21:14:40.831182 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.831157 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-866f84b4bb-c28mc"] Jun 05 21:14:40.839787 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.839764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6cdd75aa-ab46-4268-b6ef-4e465ef32fc2-redirect-config\") pod \"dashboard-redirect-866f84b4bb-c28mc\" (UID: \"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2\") " pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:40.839895 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.839801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtr7l\" (UniqueName: \"kubernetes.io/projected/6cdd75aa-ab46-4268-b6ef-4e465ef32fc2-kube-api-access-vtr7l\") pod \"dashboard-redirect-866f84b4bb-c28mc\" (UID: \"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2\") " pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:40.843548 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.843524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:40.940410 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.940375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6cdd75aa-ab46-4268-b6ef-4e465ef32fc2-redirect-config\") pod \"dashboard-redirect-866f84b4bb-c28mc\" (UID: \"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2\") " pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:40.940807 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.940416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtr7l\" (UniqueName: \"kubernetes.io/projected/6cdd75aa-ab46-4268-b6ef-4e465ef32fc2-kube-api-access-vtr7l\") pod \"dashboard-redirect-866f84b4bb-c28mc\" (UID: \"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2\") " pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:40.941207 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.941185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6cdd75aa-ab46-4268-b6ef-4e465ef32fc2-redirect-config\") pod \"dashboard-redirect-866f84b4bb-c28mc\" (UID: \"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2\") " pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:40.955426 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:40.955400 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtr7l\" (UniqueName: \"kubernetes.io/projected/6cdd75aa-ab46-4268-b6ef-4e465ef32fc2-kube-api-access-vtr7l\") pod \"dashboard-redirect-866f84b4bb-c28mc\" (UID: \"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2\") " pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:41.131080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:41.130999 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" Jun 05 21:14:41.266282 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:41.266245 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-866f84b4bb-c28mc"] Jun 05 21:14:41.269452 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:14:41.269418 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdd75aa_ab46_4268_b6ef_4e465ef32fc2.slice/crio-6ea2c0cea43a5edee4ad03e1f02e81e8a4e9b349412692aade84ee64f6995a0d WatchSource:0}: Error finding container 6ea2c0cea43a5edee4ad03e1f02e81e8a4e9b349412692aade84ee64f6995a0d: Status 404 returned error can't find the container with id 6ea2c0cea43a5edee4ad03e1f02e81e8a4e9b349412692aade84ee64f6995a0d Jun 05 21:14:41.728528 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:41.728487 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" event={"ID":"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2","Type":"ContainerStarted","Data":"6ea2c0cea43a5edee4ad03e1f02e81e8a4e9b349412692aade84ee64f6995a0d"} Jun 05 21:14:44.745345 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:44.745302 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" event={"ID":"6cdd75aa-ab46-4268-b6ef-4e465ef32fc2","Type":"ContainerStarted","Data":"daa7d358cd4d9a92429fa60d1f1089916b1c1129aff60b65482ed30455743240"} Jun 05 21:14:44.759412 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:44.759358 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-866f84b4bb-c28mc" podStartSLOduration=2.07883899 podStartE2EDuration="4.759343771s" totalImagesPullingTime="2.680504781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:44.759139863 +0000 UTC m=+573.850948311" watchObservedRunningTime="2026-06-05 21:14:44.759343771 +0000 UTC m=+573.851152217" Jun 05 21:14:50.350686 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:50.350644 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:50.451562 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:50.451533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:54.313956 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:54.313886 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:54.375944 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:54.375899 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:55.180580 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:55.180549 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:57.760984 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:57.760945 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:57.861755 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:57.861713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:58.018119 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.018038 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg"] Jun 05 21:14:58.020880 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.020858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.023283 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.023260 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 21:14:58.023414 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.023280 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s9tqz\"" Jun 05 21:14:58.033080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.033056 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg"] Jun 05 21:14:58.045111 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.045085 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:58.085602 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.085786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.085786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.085786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b104e19f-0a5a-4a0a-88b0-110a562346d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.085786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.086045 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq7q8\" (UniqueName: \"kubernetes.io/projected/b104e19f-0a5a-4a0a-88b0-110a562346d0-kube-api-access-nq7q8\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.086045 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085887 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.086045 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.086045 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.085975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186701 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186701 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186697 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186965 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186965 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186965 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186864 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186965 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b104e19f-0a5a-4a0a-88b0-110a562346d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.186965 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.186911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187185 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7q8\" (UniqueName: \"kubernetes.io/projected/b104e19f-0a5a-4a0a-88b0-110a562346d0-kube-api-access-nq7q8\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187185 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187185 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187167 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187299 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187202 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187651 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187620 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b104e19f-0a5a-4a0a-88b0-110a562346d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187779 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187721 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.187843 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.187823 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.189572 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.189548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.189775 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.189753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.194677 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.194655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq7q8\" (UniqueName: \"kubernetes.io/projected/b104e19f-0a5a-4a0a-88b0-110a562346d0-kube-api-access-nq7q8\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.195052 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.195036 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b104e19f-0a5a-4a0a-88b0-110a562346d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc6sxxg\" (UID: \"b104e19f-0a5a-4a0a-88b0-110a562346d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.289419 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.289379 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:58.331146 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.331111 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:14:58.473651 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.473618 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg"] Jun 05 21:14:58.476582 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:14:58.476558 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb104e19f_0a5a_4a0a_88b0_110a562346d0.slice/crio-c70f532a83472a526e15d9df0727b134d1e494a12fee0016eac1c50033605001 WatchSource:0}: Error finding container c70f532a83472a526e15d9df0727b134d1e494a12fee0016eac1c50033605001: Status 404 returned error can't find the container with id c70f532a83472a526e15d9df0727b134d1e494a12fee0016eac1c50033605001 Jun 05 21:14:58.556000 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.555926 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:58.651942 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.651887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:58.812131 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:14:58.812048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" event={"ID":"b104e19f-0a5a-4a0a-88b0-110a562346d0","Type":"ContainerStarted","Data":"c70f532a83472a526e15d9df0727b134d1e494a12fee0016eac1c50033605001"} Jun 05 21:15:01.007310 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:01.007268 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:15:01.007593 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:01.007355 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:15:01.007593 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:01.007386 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:15:01.830502 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:01.830462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" event={"ID":"b104e19f-0a5a-4a0a-88b0-110a562346d0","Type":"ContainerStarted","Data":"e9877ddd9ed97038b2bc804466ec22fc4adcce3d79840cb5d5f086f65942b9df"} Jun 05 21:15:01.851759 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:01.851702 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" podStartSLOduration=2.323697568 podStartE2EDuration="4.851681341s" totalImagesPullingTime="2.527983773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:01.850855259 +0000 UTC m=+590.942663730" watchObservedRunningTime="2026-06-05 21:15:01.851681341 +0000 UTC m=+590.943489788" Jun 05 21:15:02.333639 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:02.333462 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:15:02.338050 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:02.338025 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:15:02.835216 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:02.835183 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:15:02.835975 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:02.835960 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc6sxxg" Jun 05 21:15:11.343304 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:11.343274 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:15:11.343770 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:11.343753 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:15:11.350677 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:11.350654 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:15:11.351034 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:11.351019 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:15:14.724496 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.724458 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:14.817416 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.817384 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:14.852617 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.852573 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vttz"] Jun 05 21:15:14.855732 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.855716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:14.859646 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.859622 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:15:14.859787 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.859629 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dflcr\"" Jun 05 21:15:14.860043 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.860026 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:15:14.869332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.869306 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vttz"] Jun 05 21:15:14.913562 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:14.913529 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:15.046507 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.046467 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gpqs\" (UniqueName: \"kubernetes.io/projected/499a296d-6692-4f01-8095-606433e2fb6b-kube-api-access-4gpqs\") pod \"kuadrant-operator-catalog-9vttz\" (UID: \"499a296d-6692-4f01-8095-606433e2fb6b\") " pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:15.147537 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.147508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gpqs\" (UniqueName: \"kubernetes.io/projected/499a296d-6692-4f01-8095-606433e2fb6b-kube-api-access-4gpqs\") pod \"kuadrant-operator-catalog-9vttz\" (UID: \"499a296d-6692-4f01-8095-606433e2fb6b\") " pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:15.155302 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.155276 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gpqs\" (UniqueName: \"kubernetes.io/projected/499a296d-6692-4f01-8095-606433e2fb6b-kube-api-access-4gpqs\") pod \"kuadrant-operator-catalog-9vttz\" (UID: \"499a296d-6692-4f01-8095-606433e2fb6b\") " pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:15.166049 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.166026 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:15.210692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.210666 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vttz"] Jun 05 21:15:15.293008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.292981 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vttz"] Jun 05 21:15:15.296326 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:15.296304 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499a296d_6692_4f01_8095_606433e2fb6b.slice/crio-85a19a7dc67fc11314cb8a3939e38b35d1d0ca3beeeaab8be5bbd2aeeec71cf8 WatchSource:0}: Error finding container 85a19a7dc67fc11314cb8a3939e38b35d1d0ca3beeeaab8be5bbd2aeeec71cf8: Status 404 returned error can't find the container with id 85a19a7dc67fc11314cb8a3939e38b35d1d0ca3beeeaab8be5bbd2aeeec71cf8 Jun 05 21:15:15.423071 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.423039 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmc7w"] Jun 05 21:15:15.427319 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.427301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:15.433159 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.433131 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmc7w"] Jun 05 21:15:15.550677 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.550585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpgn\" (UniqueName: \"kubernetes.io/projected/a34212e5-0b70-4e95-ba83-5fc645bdc68b-kube-api-access-dcpgn\") pod \"kuadrant-operator-catalog-vmc7w\" (UID: \"a34212e5-0b70-4e95-ba83-5fc645bdc68b\") " pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:15.651175 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.651142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpgn\" (UniqueName: \"kubernetes.io/projected/a34212e5-0b70-4e95-ba83-5fc645bdc68b-kube-api-access-dcpgn\") pod \"kuadrant-operator-catalog-vmc7w\" (UID: \"a34212e5-0b70-4e95-ba83-5fc645bdc68b\") " pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:15.659798 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.659765 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpgn\" (UniqueName: \"kubernetes.io/projected/a34212e5-0b70-4e95-ba83-5fc645bdc68b-kube-api-access-dcpgn\") pod \"kuadrant-operator-catalog-vmc7w\" (UID: \"a34212e5-0b70-4e95-ba83-5fc645bdc68b\") " pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:15.738112 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.738077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:15.877524 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.877499 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmc7w"] Jun 05 21:15:15.899250 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:15.899216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" event={"ID":"499a296d-6692-4f01-8095-606433e2fb6b","Type":"ContainerStarted","Data":"85a19a7dc67fc11314cb8a3939e38b35d1d0ca3beeeaab8be5bbd2aeeec71cf8"} Jun 05 21:15:15.903394 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:15.903368 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34212e5_0b70_4e95_ba83_5fc645bdc68b.slice/crio-54bb9d4d8b803c1f8231d9a2b8c59dfb7c219024f91565cad30fd994c589caa6 WatchSource:0}: Error finding container 54bb9d4d8b803c1f8231d9a2b8c59dfb7c219024f91565cad30fd994c589caa6: Status 404 returned error can't find the container with id 54bb9d4d8b803c1f8231d9a2b8c59dfb7c219024f91565cad30fd994c589caa6 Jun 05 21:15:16.906327 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:16.906295 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" event={"ID":"a34212e5-0b70-4e95-ba83-5fc645bdc68b","Type":"ContainerStarted","Data":"54bb9d4d8b803c1f8231d9a2b8c59dfb7c219024f91565cad30fd994c589caa6"} Jun 05 21:15:17.912898 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:17.912846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" event={"ID":"499a296d-6692-4f01-8095-606433e2fb6b","Type":"ContainerStarted","Data":"82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90"} Jun 05 21:15:17.912898 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:17.912885 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" podUID="499a296d-6692-4f01-8095-606433e2fb6b" containerName="registry-server" containerID="cri-o://82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90" gracePeriod=2 Jun 05 21:15:17.914536 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:17.914508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" event={"ID":"a34212e5-0b70-4e95-ba83-5fc645bdc68b","Type":"ContainerStarted","Data":"c438f630c5193a0a5f523f25ccbc4d19d311924403227b565150244960400b4e"} Jun 05 21:15:17.929248 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:17.929193 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" podStartSLOduration=1.805159954 podStartE2EDuration="3.929173244s" totalImagesPullingTime="2.12401329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:17.929047233 +0000 UTC m=+607.020855694" watchObservedRunningTime="2026-06-05 21:15:17.929173244 +0000 UTC m=+607.020981692" Jun 05 21:15:17.947187 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:17.947144 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" podStartSLOduration=1.410302068 podStartE2EDuration="2.947130034s" totalImagesPullingTime="1.536827966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:17.944487404 +0000 UTC m=+607.036295851" watchObservedRunningTime="2026-06-05 21:15:17.947130034 +0000 UTC m=+607.038938481" Jun 05 21:15:18.161033 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.161006 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:18.174177 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.174103 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gpqs\" (UniqueName: \"kubernetes.io/projected/499a296d-6692-4f01-8095-606433e2fb6b-kube-api-access-4gpqs\") pod \"499a296d-6692-4f01-8095-606433e2fb6b\" (UID: \"499a296d-6692-4f01-8095-606433e2fb6b\") " Jun 05 21:15:18.176220 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.176191 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/499a296d-6692-4f01-8095-606433e2fb6b-kube-api-access-4gpqs" (OuterVolumeSpecName: "kube-api-access-4gpqs") pod "499a296d-6692-4f01-8095-606433e2fb6b" (UID: "499a296d-6692-4f01-8095-606433e2fb6b"). InnerVolumeSpecName "kube-api-access-4gpqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:15:18.274709 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.274674 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gpqs\" (UniqueName: \"kubernetes.io/projected/499a296d-6692-4f01-8095-606433e2fb6b-kube-api-access-4gpqs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:18.920823 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.920784 2560 generic.go:356] "Generic (PLEG): container finished" podID="499a296d-6692-4f01-8095-606433e2fb6b" containerID="82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90" exitCode=0 Jun 05 21:15:18.920823 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.920827 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" Jun 05 21:15:18.921303 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.920867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" event={"ID":"499a296d-6692-4f01-8095-606433e2fb6b","Type":"ContainerDied","Data":"82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90"} Jun 05 21:15:18.921303 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.920937 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9vttz" event={"ID":"499a296d-6692-4f01-8095-606433e2fb6b","Type":"ContainerDied","Data":"85a19a7dc67fc11314cb8a3939e38b35d1d0ca3beeeaab8be5bbd2aeeec71cf8"} Jun 05 21:15:18.921303 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.920962 2560 scope.go:117] "RemoveContainer" containerID="82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90" Jun 05 21:15:18.930326 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.930304 2560 scope.go:117] "RemoveContainer" containerID="82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90" Jun 05 21:15:18.930582 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:15:18.930562 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90\": container with ID starting with 82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90 not found: ID does not exist" containerID="82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90" Jun 05 21:15:18.930637 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.930592 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90"} err="failed to get container status \"82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90\": rpc error: code = NotFound desc = could not find container \"82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90\": container with ID starting with 82dbc8fe29456c7d93f2211b5194280e5e834e50dc87d7d0c53676b3449dab90 not found: ID does not exist" Jun 05 21:15:18.947949 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.943887 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vttz"] Jun 05 21:15:18.951254 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:18.951231 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vttz"] Jun 05 21:15:19.376565 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:19.376533 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="499a296d-6692-4f01-8095-606433e2fb6b" path="/var/lib/kubelet/pods/499a296d-6692-4f01-8095-606433e2fb6b/volumes" Jun 05 21:15:25.738546 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:25.738500 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:25.739024 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:25.738568 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:25.761216 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:25.761186 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:25.975535 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:25.975506 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vmc7w" Jun 05 21:15:30.738281 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.738247 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn"] Jun 05 21:15:30.738661 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.738595 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="499a296d-6692-4f01-8095-606433e2fb6b" containerName="registry-server" Jun 05 21:15:30.738661 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.738607 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="499a296d-6692-4f01-8095-606433e2fb6b" containerName="registry-server" Jun 05 21:15:30.738731 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.738663 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="499a296d-6692-4f01-8095-606433e2fb6b" containerName="registry-server" Jun 05 21:15:30.743103 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.743082 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.747050 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.747015 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4hfk5\"" Jun 05 21:15:30.755321 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.755299 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn"] Jun 05 21:15:30.776543 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.776514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jswjb\" (UniqueName: \"kubernetes.io/projected/c72abce0-3f98-4e2c-b4df-96cae737ac85-kube-api-access-jswjb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.776707 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.776573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.776707 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.776625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.877098 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.877061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jswjb\" (UniqueName: \"kubernetes.io/projected/c72abce0-3f98-4e2c-b4df-96cae737ac85-kube-api-access-jswjb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.877252 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.877128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.877252 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.877157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.877500 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.877481 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.877538 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.877510 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:30.887141 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:30.887116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jswjb\" (UniqueName: \"kubernetes.io/projected/c72abce0-3f98-4e2c-b4df-96cae737ac85-kube-api-access-jswjb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:31.052070 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.052031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:31.204589 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.204558 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn"] Jun 05 21:15:31.205104 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:31.205068 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72abce0_3f98_4e2c_b4df_96cae737ac85.slice/crio-5f38c159c62d8397c35031dcadc60371c9f96da207d78370197fb003846fe3fc WatchSource:0}: Error finding container 5f38c159c62d8397c35031dcadc60371c9f96da207d78370197fb003846fe3fc: Status 404 returned error can't find the container with id 5f38c159c62d8397c35031dcadc60371c9f96da207d78370197fb003846fe3fc Jun 05 21:15:31.240319 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.240289 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d"] Jun 05 21:15:31.244739 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.244718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.256841 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.256815 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d"] Jun 05 21:15:31.279242 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.279211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.279390 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.279254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.279390 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.279288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rc5\" (UniqueName: \"kubernetes.io/projected/67afcda5-d6ac-4b5f-acaa-789b52206b37-kube-api-access-h2rc5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.380215 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.380184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.380417 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.380232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.380417 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.380277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rc5\" (UniqueName: \"kubernetes.io/projected/67afcda5-d6ac-4b5f-acaa-789b52206b37-kube-api-access-h2rc5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.380575 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.380552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.380651 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.380577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.391074 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.391050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rc5\" (UniqueName: \"kubernetes.io/projected/67afcda5-d6ac-4b5f-acaa-789b52206b37-kube-api-access-h2rc5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.555485 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.555402 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:31.646343 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.646313 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs"] Jun 05 21:15:31.652647 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.652622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.664573 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.664547 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs"] Jun 05 21:15:31.682009 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.681983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc489\" (UniqueName: \"kubernetes.io/projected/102fe1f6-a986-4728-bbad-cf119830568d-kube-api-access-hc489\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.682181 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.682100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.682181 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.682140 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.699544 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.699518 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d"] Jun 05 21:15:31.701978 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:31.701949 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67afcda5_d6ac_4b5f_acaa_789b52206b37.slice/crio-6116941561c8c168e3f9df24f2922a303f2b362b09e30c6668cb5ca3569c4bfe WatchSource:0}: Error finding container 6116941561c8c168e3f9df24f2922a303f2b362b09e30c6668cb5ca3569c4bfe: Status 404 returned error can't find the container with id 6116941561c8c168e3f9df24f2922a303f2b362b09e30c6668cb5ca3569c4bfe Jun 05 21:15:31.783527 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.783485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.783527 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.783526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.784089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.783577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc489\" (UniqueName: \"kubernetes.io/projected/102fe1f6-a986-4728-bbad-cf119830568d-kube-api-access-hc489\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.784089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.783954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.784089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.783967 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.794817 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.794789 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc489\" (UniqueName: \"kubernetes.io/projected/102fe1f6-a986-4728-bbad-cf119830568d-kube-api-access-hc489\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.963910 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.963876 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:31.983295 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.983264 2560 generic.go:356] "Generic (PLEG): container finished" podID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerID="0fd5874dbd2493ffbc1a5929dffba2eab8269893c119e6b9b32e829bf39376ec" exitCode=0 Jun 05 21:15:31.983419 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.983306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" event={"ID":"67afcda5-d6ac-4b5f-acaa-789b52206b37","Type":"ContainerDied","Data":"0fd5874dbd2493ffbc1a5929dffba2eab8269893c119e6b9b32e829bf39376ec"} Jun 05 21:15:31.983419 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.983351 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" event={"ID":"67afcda5-d6ac-4b5f-acaa-789b52206b37","Type":"ContainerStarted","Data":"6116941561c8c168e3f9df24f2922a303f2b362b09e30c6668cb5ca3569c4bfe"} Jun 05 21:15:31.984980 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.984955 2560 generic.go:356] "Generic (PLEG): container finished" podID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerID="8a138f6d08ad868bbdb2f9f2e8c51829fec43809a4cce4f5a0e7172814aabc04" exitCode=0 Jun 05 21:15:31.985070 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.984999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" event={"ID":"c72abce0-3f98-4e2c-b4df-96cae737ac85","Type":"ContainerDied","Data":"8a138f6d08ad868bbdb2f9f2e8c51829fec43809a4cce4f5a0e7172814aabc04"} Jun 05 21:15:31.985070 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:31.985033 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" event={"ID":"c72abce0-3f98-4e2c-b4df-96cae737ac85","Type":"ContainerStarted","Data":"5f38c159c62d8397c35031dcadc60371c9f96da207d78370197fb003846fe3fc"} Jun 05 21:15:32.038625 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.038596 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx"] Jun 05 21:15:32.043213 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.043192 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.059375 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.059342 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx"] Jun 05 21:15:32.086323 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.086137 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.086323 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.086206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.086613 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.086338 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhj48\" (UniqueName: \"kubernetes.io/projected/02006ecc-0eb0-4b38-9374-96fb52e39b35-kube-api-access-mhj48\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.127361 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.127337 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs"] Jun 05 21:15:32.129666 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:32.129641 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102fe1f6_a986_4728_bbad_cf119830568d.slice/crio-ccd6a93f661b5e153b7456dd9a6984d05d163dd2823df4262389dbb3cc571fd2 WatchSource:0}: Error finding container ccd6a93f661b5e153b7456dd9a6984d05d163dd2823df4262389dbb3cc571fd2: Status 404 returned error can't find the container with id ccd6a93f661b5e153b7456dd9a6984d05d163dd2823df4262389dbb3cc571fd2 Jun 05 21:15:32.187826 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.187792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.187964 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.187853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.188042 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.188027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhj48\" (UniqueName: \"kubernetes.io/projected/02006ecc-0eb0-4b38-9374-96fb52e39b35-kube-api-access-mhj48\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.188290 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.188268 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.188331 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.188305 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.200446 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.200422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhj48\" (UniqueName: \"kubernetes.io/projected/02006ecc-0eb0-4b38-9374-96fb52e39b35-kube-api-access-mhj48\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.354353 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.354313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:32.503424 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.503398 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx"] Jun 05 21:15:32.514797 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:32.514766 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02006ecc_0eb0_4b38_9374_96fb52e39b35.slice/crio-289fd1cb6ca7e2472cb58d56cecbf32a5cf8e6669fcf888682502c438e905704 WatchSource:0}: Error finding container 289fd1cb6ca7e2472cb58d56cecbf32a5cf8e6669fcf888682502c438e905704: Status 404 returned error can't find the container with id 289fd1cb6ca7e2472cb58d56cecbf32a5cf8e6669fcf888682502c438e905704 Jun 05 21:15:32.993170 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.993097 2560 generic.go:356] "Generic (PLEG): container finished" podID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerID="6479f4f79c618f287bd31d6bd4e130e6a6e53a8244bc2864a6fd38a446c2275a" exitCode=0 Jun 05 21:15:32.993532 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.993178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" event={"ID":"c72abce0-3f98-4e2c-b4df-96cae737ac85","Type":"ContainerDied","Data":"6479f4f79c618f287bd31d6bd4e130e6a6e53a8244bc2864a6fd38a446c2275a"} Jun 05 21:15:32.994766 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.994741 2560 generic.go:356] "Generic (PLEG): container finished" podID="102fe1f6-a986-4728-bbad-cf119830568d" containerID="63cfc383fa0d1663dd828143f82b99cf381ea28223997bda301ac6c9f3a25263" exitCode=0 Jun 05 21:15:32.994875 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.994816 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" event={"ID":"102fe1f6-a986-4728-bbad-cf119830568d","Type":"ContainerDied","Data":"63cfc383fa0d1663dd828143f82b99cf381ea28223997bda301ac6c9f3a25263"} Jun 05 21:15:32.994875 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.994869 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" event={"ID":"102fe1f6-a986-4728-bbad-cf119830568d","Type":"ContainerStarted","Data":"ccd6a93f661b5e153b7456dd9a6984d05d163dd2823df4262389dbb3cc571fd2"} Jun 05 21:15:32.996439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.996412 2560 generic.go:356] "Generic (PLEG): container finished" podID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerID="bc4577b8ee1b0c0b6446694b7076fcd873a1c0c6895f8fa9d7d622e6b0a35ea4" exitCode=0 Jun 05 21:15:32.996573 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.996450 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" event={"ID":"02006ecc-0eb0-4b38-9374-96fb52e39b35","Type":"ContainerDied","Data":"bc4577b8ee1b0c0b6446694b7076fcd873a1c0c6895f8fa9d7d622e6b0a35ea4"} Jun 05 21:15:32.996573 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:32.996486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" event={"ID":"02006ecc-0eb0-4b38-9374-96fb52e39b35","Type":"ContainerStarted","Data":"289fd1cb6ca7e2472cb58d56cecbf32a5cf8e6669fcf888682502c438e905704"} Jun 05 21:15:34.002708 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.002624 2560 generic.go:356] "Generic (PLEG): container finished" podID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerID="02bd6d2a0d6647722cd6c01a332369cc6327db9757d16ed2dde0c870c32e6b6a" exitCode=0 Jun 05 21:15:34.003125 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.002700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" event={"ID":"67afcda5-d6ac-4b5f-acaa-789b52206b37","Type":"ContainerDied","Data":"02bd6d2a0d6647722cd6c01a332369cc6327db9757d16ed2dde0c870c32e6b6a"} Jun 05 21:15:34.004902 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.004883 2560 generic.go:356] "Generic (PLEG): container finished" podID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerID="e627c68b5fc64a73ff6623a7e476875d9595cd61ca4b764cce69bb74149cd40f" exitCode=0 Jun 05 21:15:34.005006 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.004953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" event={"ID":"c72abce0-3f98-4e2c-b4df-96cae737ac85","Type":"ContainerDied","Data":"e627c68b5fc64a73ff6623a7e476875d9595cd61ca4b764cce69bb74149cd40f"} Jun 05 21:15:34.006556 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.006535 2560 generic.go:356] "Generic (PLEG): container finished" podID="102fe1f6-a986-4728-bbad-cf119830568d" containerID="e3812908c2aebd1587afff4e5acb4858647de6e10a180d231bf89efe6112e3c5" exitCode=0 Jun 05 21:15:34.006692 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.006611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" event={"ID":"102fe1f6-a986-4728-bbad-cf119830568d","Type":"ContainerDied","Data":"e3812908c2aebd1587afff4e5acb4858647de6e10a180d231bf89efe6112e3c5"} Jun 05 21:15:34.011443 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.011370 2560 generic.go:356] "Generic (PLEG): container finished" podID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerID="ffcc0130be7a3891d72c19f15302dacf2e668270501173f5b8a625e9eaa016cc" exitCode=0 Jun 05 21:15:34.011544 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:34.011471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" event={"ID":"02006ecc-0eb0-4b38-9374-96fb52e39b35","Type":"ContainerDied","Data":"ffcc0130be7a3891d72c19f15302dacf2e668270501173f5b8a625e9eaa016cc"} Jun 05 21:15:35.018648 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.018619 2560 generic.go:356] "Generic (PLEG): container finished" podID="102fe1f6-a986-4728-bbad-cf119830568d" containerID="2a7b22fe354a369975a7951c8285cf71a9b6721a3e8010c3a50285526c0623db" exitCode=0 Jun 05 21:15:35.019081 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.018715 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" event={"ID":"102fe1f6-a986-4728-bbad-cf119830568d","Type":"ContainerDied","Data":"2a7b22fe354a369975a7951c8285cf71a9b6721a3e8010c3a50285526c0623db"} Jun 05 21:15:35.020744 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.020717 2560 generic.go:356] "Generic (PLEG): container finished" podID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerID="abcfcb6aff1ca2fa89af4e18c850c30ba97058d507f6f331aefa58cc02f81096" exitCode=0 Jun 05 21:15:35.020865 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.020745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" event={"ID":"02006ecc-0eb0-4b38-9374-96fb52e39b35","Type":"ContainerDied","Data":"abcfcb6aff1ca2fa89af4e18c850c30ba97058d507f6f331aefa58cc02f81096"} Jun 05 21:15:35.022769 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.022748 2560 generic.go:356] "Generic (PLEG): container finished" podID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerID="0a2e537fa485dd87b4ac47a21dfcf8cbf3b30ebcbd6293516903d1e326a45b10" exitCode=0 Jun 05 21:15:35.022881 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.022817 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" event={"ID":"67afcda5-d6ac-4b5f-acaa-789b52206b37","Type":"ContainerDied","Data":"0a2e537fa485dd87b4ac47a21dfcf8cbf3b30ebcbd6293516903d1e326a45b10"} Jun 05 21:15:35.161511 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.161448 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:35.212195 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.212166 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-util\") pod \"c72abce0-3f98-4e2c-b4df-96cae737ac85\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " Jun 05 21:15:35.212333 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.212268 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-bundle\") pod \"c72abce0-3f98-4e2c-b4df-96cae737ac85\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " Jun 05 21:15:35.212333 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.212294 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jswjb\" (UniqueName: \"kubernetes.io/projected/c72abce0-3f98-4e2c-b4df-96cae737ac85-kube-api-access-jswjb\") pod \"c72abce0-3f98-4e2c-b4df-96cae737ac85\" (UID: \"c72abce0-3f98-4e2c-b4df-96cae737ac85\") " Jun 05 21:15:35.212711 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.212681 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-bundle" (OuterVolumeSpecName: "bundle") pod "c72abce0-3f98-4e2c-b4df-96cae737ac85" (UID: "c72abce0-3f98-4e2c-b4df-96cae737ac85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:35.214430 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.214401 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72abce0-3f98-4e2c-b4df-96cae737ac85-kube-api-access-jswjb" (OuterVolumeSpecName: "kube-api-access-jswjb") pod "c72abce0-3f98-4e2c-b4df-96cae737ac85" (UID: "c72abce0-3f98-4e2c-b4df-96cae737ac85"). InnerVolumeSpecName "kube-api-access-jswjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:15:35.217587 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.217564 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-util" (OuterVolumeSpecName: "util") pod "c72abce0-3f98-4e2c-b4df-96cae737ac85" (UID: "c72abce0-3f98-4e2c-b4df-96cae737ac85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:35.312786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.312743 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-bundle\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:35.312786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.312776 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jswjb\" (UniqueName: \"kubernetes.io/projected/c72abce0-3f98-4e2c-b4df-96cae737ac85-kube-api-access-jswjb\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:35.312786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:35.312786 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72abce0-3f98-4e2c-b4df-96cae737ac85-util\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.029261 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.029233 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" Jun 05 21:15:36.029618 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.029265 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn" event={"ID":"c72abce0-3f98-4e2c-b4df-96cae737ac85","Type":"ContainerDied","Data":"5f38c159c62d8397c35031dcadc60371c9f96da207d78370197fb003846fe3fc"} Jun 05 21:15:36.029618 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.029316 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f38c159c62d8397c35031dcadc60371c9f96da207d78370197fb003846fe3fc" Jun 05 21:15:36.172530 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.172501 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:36.219964 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.219937 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-bundle\") pod \"102fe1f6-a986-4728-bbad-cf119830568d\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " Jun 05 21:15:36.220139 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.219990 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc489\" (UniqueName: \"kubernetes.io/projected/102fe1f6-a986-4728-bbad-cf119830568d-kube-api-access-hc489\") pod \"102fe1f6-a986-4728-bbad-cf119830568d\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " Jun 05 21:15:36.220139 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.220009 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-util\") pod \"102fe1f6-a986-4728-bbad-cf119830568d\" (UID: \"102fe1f6-a986-4728-bbad-cf119830568d\") " Jun 05 21:15:36.220396 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.220378 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:36.220659 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.220633 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-bundle" (OuterVolumeSpecName: "bundle") pod "102fe1f6-a986-4728-bbad-cf119830568d" (UID: "102fe1f6-a986-4728-bbad-cf119830568d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:36.222358 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.222335 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102fe1f6-a986-4728-bbad-cf119830568d-kube-api-access-hc489" (OuterVolumeSpecName: "kube-api-access-hc489") pod "102fe1f6-a986-4728-bbad-cf119830568d" (UID: "102fe1f6-a986-4728-bbad-cf119830568d"). InnerVolumeSpecName "kube-api-access-hc489". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:15:36.224307 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.224290 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:36.229002 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.228972 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-util" (OuterVolumeSpecName: "util") pod "102fe1f6-a986-4728-bbad-cf119830568d" (UID: "102fe1f6-a986-4728-bbad-cf119830568d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:36.320799 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.320714 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2rc5\" (UniqueName: \"kubernetes.io/projected/67afcda5-d6ac-4b5f-acaa-789b52206b37-kube-api-access-h2rc5\") pod \"67afcda5-d6ac-4b5f-acaa-789b52206b37\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " Jun 05 21:15:36.320799 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.320758 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-util\") pod \"67afcda5-d6ac-4b5f-acaa-789b52206b37\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " Jun 05 21:15:36.320799 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.320792 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-bundle\") pod \"02006ecc-0eb0-4b38-9374-96fb52e39b35\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " Jun 05 21:15:36.321073 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.320966 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-util\") pod \"02006ecc-0eb0-4b38-9374-96fb52e39b35\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " Jun 05 21:15:36.321073 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321020 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-bundle\") pod \"67afcda5-d6ac-4b5f-acaa-789b52206b37\" (UID: \"67afcda5-d6ac-4b5f-acaa-789b52206b37\") " Jun 05 21:15:36.321073 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321058 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhj48\" (UniqueName: \"kubernetes.io/projected/02006ecc-0eb0-4b38-9374-96fb52e39b35-kube-api-access-mhj48\") pod \"02006ecc-0eb0-4b38-9374-96fb52e39b35\" (UID: \"02006ecc-0eb0-4b38-9374-96fb52e39b35\") " Jun 05 21:15:36.321448 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321348 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-bundle\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.321448 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321373 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc489\" (UniqueName: \"kubernetes.io/projected/102fe1f6-a986-4728-bbad-cf119830568d-kube-api-access-hc489\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.321448 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321389 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102fe1f6-a986-4728-bbad-cf119830568d-util\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.321677 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321534 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-bundle" (OuterVolumeSpecName: "bundle") pod "67afcda5-d6ac-4b5f-acaa-789b52206b37" (UID: "67afcda5-d6ac-4b5f-acaa-789b52206b37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:36.321677 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.321651 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-bundle" (OuterVolumeSpecName: "bundle") pod "02006ecc-0eb0-4b38-9374-96fb52e39b35" (UID: "02006ecc-0eb0-4b38-9374-96fb52e39b35"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:36.323401 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.323367 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02006ecc-0eb0-4b38-9374-96fb52e39b35-kube-api-access-mhj48" (OuterVolumeSpecName: "kube-api-access-mhj48") pod "02006ecc-0eb0-4b38-9374-96fb52e39b35" (UID: "02006ecc-0eb0-4b38-9374-96fb52e39b35"). InnerVolumeSpecName "kube-api-access-mhj48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:15:36.323401 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.323381 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67afcda5-d6ac-4b5f-acaa-789b52206b37-kube-api-access-h2rc5" (OuterVolumeSpecName: "kube-api-access-h2rc5") pod "67afcda5-d6ac-4b5f-acaa-789b52206b37" (UID: "67afcda5-d6ac-4b5f-acaa-789b52206b37"). InnerVolumeSpecName "kube-api-access-h2rc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:15:36.327065 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.327043 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-util" (OuterVolumeSpecName: "util") pod "67afcda5-d6ac-4b5f-acaa-789b52206b37" (UID: "67afcda5-d6ac-4b5f-acaa-789b52206b37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:36.327595 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.327577 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-util" (OuterVolumeSpecName: "util") pod "02006ecc-0eb0-4b38-9374-96fb52e39b35" (UID: "02006ecc-0eb0-4b38-9374-96fb52e39b35"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:15:36.422693 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.422652 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2rc5\" (UniqueName: \"kubernetes.io/projected/67afcda5-d6ac-4b5f-acaa-789b52206b37-kube-api-access-h2rc5\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.422693 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.422686 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-util\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.422693 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.422695 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-bundle\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.422693 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.422702 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02006ecc-0eb0-4b38-9374-96fb52e39b35-util\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.422979 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.422710 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67afcda5-d6ac-4b5f-acaa-789b52206b37-bundle\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:36.422979 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:36.422719 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhj48\" (UniqueName: \"kubernetes.io/projected/02006ecc-0eb0-4b38-9374-96fb52e39b35-kube-api-access-mhj48\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:15:37.036321 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.036289 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" Jun 05 21:15:37.036321 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.036307 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx" event={"ID":"02006ecc-0eb0-4b38-9374-96fb52e39b35","Type":"ContainerDied","Data":"289fd1cb6ca7e2472cb58d56cecbf32a5cf8e6669fcf888682502c438e905704"} Jun 05 21:15:37.036809 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.036359 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="289fd1cb6ca7e2472cb58d56cecbf32a5cf8e6669fcf888682502c438e905704" Jun 05 21:15:37.038263 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.038244 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" Jun 05 21:15:37.038263 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.038258 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d" event={"ID":"67afcda5-d6ac-4b5f-acaa-789b52206b37","Type":"ContainerDied","Data":"6116941561c8c168e3f9df24f2922a303f2b362b09e30c6668cb5ca3569c4bfe"} Jun 05 21:15:37.038483 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.038294 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6116941561c8c168e3f9df24f2922a303f2b362b09e30c6668cb5ca3569c4bfe" Jun 05 21:15:37.040279 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.040256 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" event={"ID":"102fe1f6-a986-4728-bbad-cf119830568d","Type":"ContainerDied","Data":"ccd6a93f661b5e153b7456dd9a6984d05d163dd2823df4262389dbb3cc571fd2"} Jun 05 21:15:37.040382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.040297 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccd6a93f661b5e153b7456dd9a6984d05d163dd2823df4262389dbb3cc571fd2" Jun 05 21:15:37.040382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:37.040270 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs" Jun 05 21:15:38.535622 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:38.535593 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:41.470257 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:41.470216 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:43.601995 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.601953 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx"] Jun 05 21:15:43.602445 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602426 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="extract" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602445 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="extract" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602461 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="util" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602472 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="util" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602484 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="util" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602492 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="util" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602506 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="util" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602514 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="util" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602526 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="pull" Jun 05 21:15:43.602533 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602535 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602543 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602550 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602563 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602571 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602583 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602592 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602604 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="util" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602613 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="util" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602625 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602633 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602650 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602658 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="pull" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602670 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602678 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602761 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="102fe1f6-a986-4728-bbad-cf119830568d" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602777 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="02006ecc-0eb0-4b38-9374-96fb52e39b35" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602787 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="67afcda5-d6ac-4b5f-acaa-789b52206b37" containerName="extract" Jun 05 21:15:43.602987 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.602797 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72abce0-3f98-4e2c-b4df-96cae737ac85" containerName="extract" Jun 05 21:15:43.607196 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.607174 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.610359 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.610339 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mtgsq\"" Jun 05 21:15:43.626280 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.626256 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx"] Jun 05 21:15:43.693260 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.693219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzj82\" (UniqueName: \"kubernetes.io/projected/6d593dd8-8cdc-4c96-980f-8c605c2a101e-kube-api-access-jzj82\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.693406 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.693277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d593dd8-8cdc-4c96-980f-8c605c2a101e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.794055 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.794013 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzj82\" (UniqueName: \"kubernetes.io/projected/6d593dd8-8cdc-4c96-980f-8c605c2a101e-kube-api-access-jzj82\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.794202 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.794074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d593dd8-8cdc-4c96-980f-8c605c2a101e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.794465 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.794445 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d593dd8-8cdc-4c96-980f-8c605c2a101e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.808532 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.808507 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzj82\" (UniqueName: \"kubernetes.io/projected/6d593dd8-8cdc-4c96-980f-8c605c2a101e-kube-api-access-jzj82\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.917489 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.917404 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:43.928638 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:43.928609 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:44.063496 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:44.063471 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx"] Jun 05 21:15:44.068803 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:44.065862 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d593dd8_8cdc_4c96_980f_8c605c2a101e.slice/crio-641b097bf1c4f1cc3b0b5933b7c1cb23e6ad3be25943f02b0fd953dede266b42 WatchSource:0}: Error finding container 641b097bf1c4f1cc3b0b5933b7c1cb23e6ad3be25943f02b0fd953dede266b42: Status 404 returned error can't find the container with id 641b097bf1c4f1cc3b0b5933b7c1cb23e6ad3be25943f02b0fd953dede266b42 Jun 05 21:15:44.076331 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:44.076305 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" event={"ID":"6d593dd8-8cdc-4c96-980f-8c605c2a101e","Type":"ContainerStarted","Data":"641b097bf1c4f1cc3b0b5933b7c1cb23e6ad3be25943f02b0fd953dede266b42"} Jun 05 21:15:44.277209 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:44.277091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:44.411147 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:44.411110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:44.504903 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:44.504867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:44.954527 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:44.954485 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:45.068366 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.068334 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:45.415550 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.415515 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:45.518638 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.518606 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99"] Jun 05 21:15:45.522263 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.522236 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:15:45.525622 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.525593 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fbct7\"" Jun 05 21:15:45.526260 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.526236 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 21:15:45.537529 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.537505 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99"] Jun 05 21:15:45.609826 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.609789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75xq\" (UniqueName: \"kubernetes.io/projected/c5ffc88a-5007-4e51-a7ec-228df7f92709-kube-api-access-g75xq\") pod \"dns-operator-controller-manager-864dd78c4c-r5f99\" (UID: \"c5ffc88a-5007-4e51-a7ec-228df7f92709\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:15:45.710684 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.710597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75xq\" (UniqueName: \"kubernetes.io/projected/c5ffc88a-5007-4e51-a7ec-228df7f92709-kube-api-access-g75xq\") pod \"dns-operator-controller-manager-864dd78c4c-r5f99\" (UID: \"c5ffc88a-5007-4e51-a7ec-228df7f92709\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:15:45.721057 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.721027 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75xq\" (UniqueName: \"kubernetes.io/projected/c5ffc88a-5007-4e51-a7ec-228df7f92709-kube-api-access-g75xq\") pod \"dns-operator-controller-manager-864dd78c4c-r5f99\" (UID: \"c5ffc88a-5007-4e51-a7ec-228df7f92709\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:15:45.842080 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:45.835966 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:15:46.026008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:46.025948 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99"] Jun 05 21:15:46.028422 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:46.028391 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ffc88a_5007_4e51_a7ec_228df7f92709.slice/crio-628b87ec81d4502e7c728fa2cd4527a41ce5404849d5222359081bb8c4f09f74 WatchSource:0}: Error finding container 628b87ec81d4502e7c728fa2cd4527a41ce5404849d5222359081bb8c4f09f74: Status 404 returned error can't find the container with id 628b87ec81d4502e7c728fa2cd4527a41ce5404849d5222359081bb8c4f09f74 Jun 05 21:15:46.089548 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:46.089516 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" event={"ID":"c5ffc88a-5007-4e51-a7ec-228df7f92709","Type":"ContainerStarted","Data":"628b87ec81d4502e7c728fa2cd4527a41ce5404849d5222359081bb8c4f09f74"} Jun 05 21:15:46.095791 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:46.095760 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:46.717208 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:46.717176 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:48.102757 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.102722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" event={"ID":"c5ffc88a-5007-4e51-a7ec-228df7f92709","Type":"ContainerStarted","Data":"6e3f1a84e2ace38ea9f55684975e8195d2e945ca9443aa823e41717607c63e15"} Jun 05 21:15:48.103241 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.102822 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:15:48.124444 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.124392 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" podStartSLOduration=1.202596422 podStartE2EDuration="3.124376273s" totalImagesPullingTime="1.921779851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:48.121420461 +0000 UTC m=+637.213228907" watchObservedRunningTime="2026-06-05 21:15:48.124376273 +0000 UTC m=+637.216184720" Jun 05 21:15:48.694072 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.694034 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-25wk4"] Jun 05 21:15:48.697798 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.697772 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:15:48.700255 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.700233 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4hb8g\"" Jun 05 21:15:48.714399 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.714373 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-25wk4"] Jun 05 21:15:48.742215 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.742180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6mbz\" (UniqueName: \"kubernetes.io/projected/2a32844e-3bca-41e0-af4b-236d687440eb-kube-api-access-v6mbz\") pod \"authorino-operator-75cc8d5cb7-25wk4\" (UID: \"2a32844e-3bca-41e0-af4b-236d687440eb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:15:48.833833 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.833762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:48.843544 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.843512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6mbz\" (UniqueName: \"kubernetes.io/projected/2a32844e-3bca-41e0-af4b-236d687440eb-kube-api-access-v6mbz\") pod \"authorino-operator-75cc8d5cb7-25wk4\" (UID: \"2a32844e-3bca-41e0-af4b-236d687440eb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:15:48.864748 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.864713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6mbz\" (UniqueName: \"kubernetes.io/projected/2a32844e-3bca-41e0-af4b-236d687440eb-kube-api-access-v6mbz\") pod \"authorino-operator-75cc8d5cb7-25wk4\" (UID: \"2a32844e-3bca-41e0-af4b-236d687440eb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:15:48.979266 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:48.979187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:49.011973 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:49.011654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:15:49.627572 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:49.627541 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-25wk4"] Jun 05 21:15:49.631062 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:15:49.631040 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a32844e_3bca_41e0_af4b_236d687440eb.slice/crio-5effada9b7f4b3aa6d6ebc9f8c61455b7e7cbf7b91a7082c2962d559ec9acfef WatchSource:0}: Error finding container 5effada9b7f4b3aa6d6ebc9f8c61455b7e7cbf7b91a7082c2962d559ec9acfef: Status 404 returned error can't find the container with id 5effada9b7f4b3aa6d6ebc9f8c61455b7e7cbf7b91a7082c2962d559ec9acfef Jun 05 21:15:49.811498 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:49.811466 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:50.115383 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:50.115294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" event={"ID":"2a32844e-3bca-41e0-af4b-236d687440eb","Type":"ContainerStarted","Data":"5effada9b7f4b3aa6d6ebc9f8c61455b7e7cbf7b91a7082c2962d559ec9acfef"} Jun 05 21:15:50.116933 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:50.116887 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" event={"ID":"6d593dd8-8cdc-4c96-980f-8c605c2a101e","Type":"ContainerStarted","Data":"b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64"} Jun 05 21:15:50.117054 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:50.117041 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:15:50.140193 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:50.140123 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" podStartSLOduration=1.67895807 podStartE2EDuration="7.140105585s" totalImagesPullingTime="5.461147515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:50.139667178 +0000 UTC m=+639.231475637" watchObservedRunningTime="2026-06-05 21:15:50.140105585 +0000 UTC m=+639.231914032" Jun 05 21:15:51.670817 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:51.670777 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:52.130419 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:52.130385 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" event={"ID":"2a32844e-3bca-41e0-af4b-236d687440eb","Type":"ContainerStarted","Data":"681b641ea993256120c3c7709cc8cf7085b4972ebe9b5431c390246cdcc2f1f8"} Jun 05 21:15:52.130588 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:52.130473 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:15:52.157880 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:52.157828 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" podStartSLOduration=2.000367712 podStartE2EDuration="4.157814248s" totalImagesPullingTime="2.157446536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:52.156776629 +0000 UTC m=+641.248585076" watchObservedRunningTime="2026-06-05 21:15:52.157814248 +0000 UTC m=+641.249622695" Jun 05 21:15:53.074809 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:53.074773 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:53.286751 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:53.286713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:53.679328 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:53.679297 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:53.920629 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:53.920596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:54.135413 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:54.135381 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:54.257396 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:54.257363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:55.016893 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:55.016861 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:55.134826 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:55.134789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:55.218681 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:55.218646 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:59.111470 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:15:59.111438 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r5f99" Jun 05 21:16:01.126482 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:01.126452 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:16:02.411170 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:02.411132 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:03.138640 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.138613 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-25wk4" Jun 05 21:16:03.161542 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.161509 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx"] Jun 05 21:16:03.161708 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.161682 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" containerName="manager" containerID="cri-o://b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64" gracePeriod=2 Jun 05 21:16:03.183089 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.183065 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx"] Jun 05 21:16:03.210883 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:16:03.210838 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:16:03.231559 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.231520 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:03.245035 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.245002 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks"] Jun 05 21:16:03.245390 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.245378 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" containerName="manager" Jun 05 21:16:03.245433 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.245394 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" containerName="manager" Jun 05 21:16:03.245471 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.245463 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" containerName="manager" Jun 05 21:16:03.248382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.248362 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.282948 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.282909 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks"] Jun 05 21:16:03.374721 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.374691 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15efd5f-edcb-4e83-8814-b04dfb9f3715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8nks\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.374862 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.374765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwc5\" (UniqueName: \"kubernetes.io/projected/b15efd5f-edcb-4e83-8814-b04dfb9f3715-kube-api-access-5qwc5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8nks\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.406722 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:16:03.406635 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9k6zx\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:16:03.435811 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.435784 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:16:03.475197 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.475166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwc5\" (UniqueName: \"kubernetes.io/projected/b15efd5f-edcb-4e83-8814-b04dfb9f3715-kube-api-access-5qwc5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8nks\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.475360 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.475245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15efd5f-edcb-4e83-8814-b04dfb9f3715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8nks\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.475626 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.475609 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15efd5f-edcb-4e83-8814-b04dfb9f3715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8nks\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.514468 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.514441 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwc5\" (UniqueName: \"kubernetes.io/projected/b15efd5f-edcb-4e83-8814-b04dfb9f3715-kube-api-access-5qwc5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8nks\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.560723 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.560690 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:03.576428 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.576390 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzj82\" (UniqueName: \"kubernetes.io/projected/6d593dd8-8cdc-4c96-980f-8c605c2a101e-kube-api-access-jzj82\") pod \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " Jun 05 21:16:03.576553 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.576515 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d593dd8-8cdc-4c96-980f-8c605c2a101e-extensions-socket-volume\") pod \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\" (UID: \"6d593dd8-8cdc-4c96-980f-8c605c2a101e\") " Jun 05 21:16:03.577137 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.577110 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d593dd8-8cdc-4c96-980f-8c605c2a101e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d593dd8-8cdc-4c96-980f-8c605c2a101e" (UID: "6d593dd8-8cdc-4c96-980f-8c605c2a101e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:16:03.578443 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.578418 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d593dd8-8cdc-4c96-980f-8c605c2a101e-kube-api-access-jzj82" (OuterVolumeSpecName: "kube-api-access-jzj82") pod "6d593dd8-8cdc-4c96-980f-8c605c2a101e" (UID: "6d593dd8-8cdc-4c96-980f-8c605c2a101e"). InnerVolumeSpecName "kube-api-access-jzj82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:16:03.677570 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.677502 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d593dd8-8cdc-4c96-980f-8c605c2a101e-extensions-socket-volume\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:16:03.677570 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.677533 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzj82\" (UniqueName: \"kubernetes.io/projected/6d593dd8-8cdc-4c96-980f-8c605c2a101e-kube-api-access-jzj82\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:16:03.725969 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:03.725942 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks"] Jun 05 21:16:03.728222 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:16:03.728181 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15efd5f_edcb_4e83_8814_b04dfb9f3715.slice/crio-49baeaba1de524ee8899c5bda30c8540d40f643d8931341e3c96fc5a045cc908 WatchSource:0}: Error finding container 49baeaba1de524ee8899c5bda30c8540d40f643d8931341e3c96fc5a045cc908: Status 404 returned error can't find the container with id 49baeaba1de524ee8899c5bda30c8540d40f643d8931341e3c96fc5a045cc908 Jun 05 21:16:04.202733 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.202694 2560 generic.go:356] "Generic (PLEG): container finished" podID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" containerID="b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64" exitCode=0 Jun 05 21:16:04.202733 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.202740 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9k6zx" Jun 05 21:16:04.203014 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.202794 2560 scope.go:117] "RemoveContainer" containerID="b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64" Jun 05 21:16:04.204652 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.204601 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" event={"ID":"b15efd5f-edcb-4e83-8814-b04dfb9f3715","Type":"ContainerStarted","Data":"70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c"} Jun 05 21:16:04.204753 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.204664 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:04.204753 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.204689 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" event={"ID":"b15efd5f-edcb-4e83-8814-b04dfb9f3715","Type":"ContainerStarted","Data":"49baeaba1de524ee8899c5bda30c8540d40f643d8931341e3c96fc5a045cc908"} Jun 05 21:16:04.212168 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.212141 2560 scope.go:117] "RemoveContainer" containerID="b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64" Jun 05 21:16:04.212450 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:16:04.212431 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64\": container with ID starting with b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64 not found: ID does not exist" containerID="b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64" Jun 05 21:16:04.212500 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.212458 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64"} err="failed to get container status \"b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64\": rpc error: code = NotFound desc = could not find container \"b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64\": container with ID starting with b87f781a2f7bfaaa505b4dc34a3d711a1d6c31be67ca3a30bf96e23dc6349c64 not found: ID does not exist" Jun 05 21:16:04.251726 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:04.251677 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" podStartSLOduration=1.2516594109999999 podStartE2EDuration="1.251659411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:04.250625741 +0000 UTC m=+653.342434211" watchObservedRunningTime="2026-06-05 21:16:04.251659411 +0000 UTC m=+653.343467858" Jun 05 21:16:05.376636 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:05.376602 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d593dd8-8cdc-4c96-980f-8c605c2a101e" path="/var/lib/kubelet/pods/6d593dd8-8cdc-4c96-980f-8c605c2a101e/volumes" Jun 05 21:16:06.402007 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:06.401973 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:07.545874 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.545841 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk"] Jun 05 21:16:07.550873 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.550854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.576083 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.576050 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk"] Jun 05 21:16:07.714011 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.713972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b2a2a03-d28e-4282-b378-ead377ed7c8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ljrgk\" (UID: \"0b2a2a03-d28e-4282-b378-ead377ed7c8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.714011 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.714021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnxmc\" (UniqueName: \"kubernetes.io/projected/0b2a2a03-d28e-4282-b378-ead377ed7c8b-kube-api-access-vnxmc\") pod \"kuadrant-operator-controller-manager-86878c769f-ljrgk\" (UID: \"0b2a2a03-d28e-4282-b378-ead377ed7c8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.814973 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.814884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b2a2a03-d28e-4282-b378-ead377ed7c8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ljrgk\" (UID: \"0b2a2a03-d28e-4282-b378-ead377ed7c8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.815110 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.814971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnxmc\" (UniqueName: \"kubernetes.io/projected/0b2a2a03-d28e-4282-b378-ead377ed7c8b-kube-api-access-vnxmc\") pod \"kuadrant-operator-controller-manager-86878c769f-ljrgk\" (UID: \"0b2a2a03-d28e-4282-b378-ead377ed7c8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.815362 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.815342 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b2a2a03-d28e-4282-b378-ead377ed7c8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ljrgk\" (UID: \"0b2a2a03-d28e-4282-b378-ead377ed7c8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.826501 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.826472 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnxmc\" (UniqueName: \"kubernetes.io/projected/0b2a2a03-d28e-4282-b378-ead377ed7c8b-kube-api-access-vnxmc\") pod \"kuadrant-operator-controller-manager-86878c769f-ljrgk\" (UID: \"0b2a2a03-d28e-4282-b378-ead377ed7c8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:07.860320 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:07.860288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:08.028023 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.027997 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk"] Jun 05 21:16:08.030907 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:16:08.030879 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2a2a03_d28e_4282_b378_ead377ed7c8b.slice/crio-45e92248e798e3f31bbcbaaea486cc7a4c1a97db364d4022da607a81caaca039 WatchSource:0}: Error finding container 45e92248e798e3f31bbcbaaea486cc7a4c1a97db364d4022da607a81caaca039: Status 404 returned error can't find the container with id 45e92248e798e3f31bbcbaaea486cc7a4c1a97db364d4022da607a81caaca039 Jun 05 21:16:08.048304 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.048273 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:08.206978 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.206944 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:08.228819 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.228786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" event={"ID":"0b2a2a03-d28e-4282-b378-ead377ed7c8b","Type":"ContainerStarted","Data":"b0abd5369b80b252abdd8c56a88125cc13d70b5b166c98b307c107d2a62b9a12"} Jun 05 21:16:08.229021 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.228859 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" event={"ID":"0b2a2a03-d28e-4282-b378-ead377ed7c8b","Type":"ContainerStarted","Data":"45e92248e798e3f31bbcbaaea486cc7a4c1a97db364d4022da607a81caaca039"} Jun 05 21:16:08.229021 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.228945 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:08.277238 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.277190 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" podStartSLOduration=1.277173081 podStartE2EDuration="1.277173081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:08.275068793 +0000 UTC m=+657.366877250" watchObservedRunningTime="2026-06-05 21:16:08.277173081 +0000 UTC m=+657.368981526" Jun 05 21:16:08.471591 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:08.471483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:11.074616 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:11.074586 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:11.473377 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:11.473344 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:15.213948 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:15.213902 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:15.655826 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:15.655796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:15.839165 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:15.839129 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:19.236895 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.236866 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ljrgk" Jun 05 21:16:19.312746 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.312710 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks"] Jun 05 21:16:19.312969 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.312947 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" podUID="b15efd5f-edcb-4e83-8814-b04dfb9f3715" containerName="manager" containerID="cri-o://70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c" gracePeriod=10 Jun 05 21:16:19.575912 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.575887 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:19.608159 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.608123 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15efd5f-edcb-4e83-8814-b04dfb9f3715-extensions-socket-volume\") pod \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " Jun 05 21:16:19.608318 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.608168 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qwc5\" (UniqueName: \"kubernetes.io/projected/b15efd5f-edcb-4e83-8814-b04dfb9f3715-kube-api-access-5qwc5\") pod \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\" (UID: \"b15efd5f-edcb-4e83-8814-b04dfb9f3715\") " Jun 05 21:16:19.608548 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.608523 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15efd5f-edcb-4e83-8814-b04dfb9f3715-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b15efd5f-edcb-4e83-8814-b04dfb9f3715" (UID: "b15efd5f-edcb-4e83-8814-b04dfb9f3715"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:16:19.610276 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.610248 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15efd5f-edcb-4e83-8814-b04dfb9f3715-kube-api-access-5qwc5" (OuterVolumeSpecName: "kube-api-access-5qwc5") pod "b15efd5f-edcb-4e83-8814-b04dfb9f3715" (UID: "b15efd5f-edcb-4e83-8814-b04dfb9f3715"). InnerVolumeSpecName "kube-api-access-5qwc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:16:19.709236 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.709204 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15efd5f-edcb-4e83-8814-b04dfb9f3715-extensions-socket-volume\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:16:19.709236 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:19.709231 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qwc5\" (UniqueName: \"kubernetes.io/projected/b15efd5f-edcb-4e83-8814-b04dfb9f3715-kube-api-access-5qwc5\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:16:20.301272 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.301238 2560 generic.go:356] "Generic (PLEG): container finished" podID="b15efd5f-edcb-4e83-8814-b04dfb9f3715" containerID="70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c" exitCode=0 Jun 05 21:16:20.301678 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.301278 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" Jun 05 21:16:20.301678 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.301318 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" event={"ID":"b15efd5f-edcb-4e83-8814-b04dfb9f3715","Type":"ContainerDied","Data":"70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c"} Jun 05 21:16:20.301678 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.301371 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks" event={"ID":"b15efd5f-edcb-4e83-8814-b04dfb9f3715","Type":"ContainerDied","Data":"49baeaba1de524ee8899c5bda30c8540d40f643d8931341e3c96fc5a045cc908"} Jun 05 21:16:20.301678 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.301394 2560 scope.go:117] "RemoveContainer" containerID="70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c" Jun 05 21:16:20.310876 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.310862 2560 scope.go:117] "RemoveContainer" containerID="70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c" Jun 05 21:16:20.311167 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:16:20.311148 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c\": container with ID starting with 70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c not found: ID does not exist" containerID="70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c" Jun 05 21:16:20.311213 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.311178 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c"} err="failed to get container status \"70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c\": rpc error: code = NotFound desc = could not find container \"70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c\": container with ID starting with 70a610923773ac65fee4a2890dc38572648411aa243f37ca54c0aeca8fc5235c not found: ID does not exist" Jun 05 21:16:20.335301 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.335271 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks"] Jun 05 21:16:20.339364 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:20.339342 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8nks"] Jun 05 21:16:21.376612 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:21.376580 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15efd5f-edcb-4e83-8814-b04dfb9f3715" path="/var/lib/kubelet/pods/b15efd5f-edcb-4e83-8814-b04dfb9f3715/volumes" Jun 05 21:16:22.491658 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:22.491622 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:22.616745 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:22.616713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:28.970556 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:28.970523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:29.071760 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:29.071722 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:31.990629 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:31.990595 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:32.109777 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:32.109716 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:35.685793 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.685765 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4"] Jun 05 21:16:35.686147 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.686133 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15efd5f-edcb-4e83-8814-b04dfb9f3715" containerName="manager" Jun 05 21:16:35.686194 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.686149 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15efd5f-edcb-4e83-8814-b04dfb9f3715" containerName="manager" Jun 05 21:16:35.686229 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.686211 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15efd5f-edcb-4e83-8814-b04dfb9f3715" containerName="manager" Jun 05 21:16:35.689140 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.689123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.692226 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.692207 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xvqc4\"" Jun 05 21:16:35.702275 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.702244 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4"] Jun 05 21:16:35.716454 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.716425 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:35.740988 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.740952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a18490d-f052-4d5a-8eaa-f4550286af8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741157 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk8cr\" (UniqueName: \"kubernetes.io/projected/3a18490d-f052-4d5a-8eaa-f4550286af8f-kube-api-access-dk8cr\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741398 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.741398 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.741245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.821520 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.821485 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:35.842645 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.842615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.842762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.842655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.842762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.842673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.842762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.842694 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.842762 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.842722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843029 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8cr\" (UniqueName: \"kubernetes.io/projected/3a18490d-f052-4d5a-8eaa-f4550286af8f-kube-api-access-dk8cr\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843103 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843167 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843124 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843339 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843258 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843339 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a18490d-f052-4d5a-8eaa-f4550286af8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.843443 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.844017 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.843991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a18490d-f052-4d5a-8eaa-f4550286af8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.845147 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.845126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.845427 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.845408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.851021 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.850998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a18490d-f052-4d5a-8eaa-f4550286af8f-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.851118 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.851105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk8cr\" (UniqueName: \"kubernetes.io/projected/3a18490d-f052-4d5a-8eaa-f4550286af8f-kube-api-access-dk8cr\") pod \"maas-default-gateway-openshift-default-8559cd5744-xwzh4\" (UID: \"3a18490d-f052-4d5a-8eaa-f4550286af8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:35.999510 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:35.999412 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:36.141143 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.141117 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4"] Jun 05 21:16:36.143735 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:16:36.143707 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a18490d_f052_4d5a_8eaa_f4550286af8f.slice/crio-a350e3f65e9a7d9aa0367b3a65d5a4f9d8223635de36bd49fc7b67858e708962 WatchSource:0}: Error finding container a350e3f65e9a7d9aa0367b3a65d5a4f9d8223635de36bd49fc7b67858e708962: Status 404 returned error can't find the container with id a350e3f65e9a7d9aa0367b3a65d5a4f9d8223635de36bd49fc7b67858e708962 Jun 05 21:16:36.145792 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.145760 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:16:36.145881 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.145825 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:16:36.145881 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.145854 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:16:36.394074 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.394038 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" event={"ID":"3a18490d-f052-4d5a-8eaa-f4550286af8f","Type":"ContainerStarted","Data":"b8c2c79777574ada7a181b85a6385785cc8e1266b706b0f678610a4ddebb2ae3"} Jun 05 21:16:36.394234 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.394113 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" event={"ID":"3a18490d-f052-4d5a-8eaa-f4550286af8f","Type":"ContainerStarted","Data":"a350e3f65e9a7d9aa0367b3a65d5a4f9d8223635de36bd49fc7b67858e708962"} Jun 05 21:16:36.414321 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:36.414264 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" podStartSLOduration=1.414242097 podStartE2EDuration="1.414242097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:36.413755658 +0000 UTC m=+685.505564108" watchObservedRunningTime="2026-06-05 21:16:36.414242097 +0000 UTC m=+685.506050545" Jun 05 21:16:37.000594 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:37.000552 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:37.005593 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:37.005566 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:37.400196 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:37.400164 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:37.401268 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:37.401243 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:16:39.910316 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:39.910282 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:40.236369 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.236278 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:40.350964 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.350931 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:40.451628 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.451582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:40.738120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.738086 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:16:40.741860 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.741840 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:40.744736 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.744711 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 21:16:40.745171 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.745145 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4hfk5\"" Jun 05 21:16:40.750791 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.750765 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:16:40.783975 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.783942 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:16:40.787963 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.787902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkbb7\" (UniqueName: \"kubernetes.io/projected/16191fa7-92a4-4435-8c3d-cfe083eca4ce-kube-api-access-bkbb7\") pod \"limitador-limitador-54d6d988d5-b85f6\" (UID: \"16191fa7-92a4-4435-8c3d-cfe083eca4ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:40.788103 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.787992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/16191fa7-92a4-4435-8c3d-cfe083eca4ce-config-file\") pod \"limitador-limitador-54d6d988d5-b85f6\" (UID: \"16191fa7-92a4-4435-8c3d-cfe083eca4ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:40.889208 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.889174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkbb7\" (UniqueName: \"kubernetes.io/projected/16191fa7-92a4-4435-8c3d-cfe083eca4ce-kube-api-access-bkbb7\") pod \"limitador-limitador-54d6d988d5-b85f6\" (UID: \"16191fa7-92a4-4435-8c3d-cfe083eca4ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:40.889382 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.889218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/16191fa7-92a4-4435-8c3d-cfe083eca4ce-config-file\") pod \"limitador-limitador-54d6d988d5-b85f6\" (UID: \"16191fa7-92a4-4435-8c3d-cfe083eca4ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:40.889996 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.889978 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/16191fa7-92a4-4435-8c3d-cfe083eca4ce-config-file\") pod \"limitador-limitador-54d6d988d5-b85f6\" (UID: \"16191fa7-92a4-4435-8c3d-cfe083eca4ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:40.897709 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:40.897675 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkbb7\" (UniqueName: \"kubernetes.io/projected/16191fa7-92a4-4435-8c3d-cfe083eca4ce-kube-api-access-bkbb7\") pod \"limitador-limitador-54d6d988d5-b85f6\" (UID: \"16191fa7-92a4-4435-8c3d-cfe083eca4ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:41.054207 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.054166 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:41.093241 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.093199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:41.166704 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.166664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:41.187776 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.187744 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vmcgl"] Jun 05 21:16:41.192618 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.192598 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:16:41.195035 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.195017 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2mt6\"" Jun 05 21:16:41.198738 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.198713 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vmcgl"] Jun 05 21:16:41.205505 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.205473 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:16:41.207471 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:16:41.207449 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16191fa7_92a4_4435_8c3d_cfe083eca4ce.slice/crio-8a29ef9270ebf0d1a851901608d64a5232a0233cecbf60be9370bf1e0ea577b7 WatchSource:0}: Error finding container 8a29ef9270ebf0d1a851901608d64a5232a0233cecbf60be9370bf1e0ea577b7: Status 404 returned error can't find the container with id 8a29ef9270ebf0d1a851901608d64a5232a0233cecbf60be9370bf1e0ea577b7 Jun 05 21:16:41.293290 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.293254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47zkr\" (UniqueName: \"kubernetes.io/projected/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5-kube-api-access-47zkr\") pod \"authorino-75d556bd77-vmcgl\" (UID: \"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5\") " pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:16:41.394466 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.394383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47zkr\" (UniqueName: \"kubernetes.io/projected/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5-kube-api-access-47zkr\") pod \"authorino-75d556bd77-vmcgl\" (UID: \"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5\") " pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:16:41.404440 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.404416 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47zkr\" (UniqueName: \"kubernetes.io/projected/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5-kube-api-access-47zkr\") pod \"authorino-75d556bd77-vmcgl\" (UID: \"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5\") " pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:16:41.422895 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.422858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" event={"ID":"16191fa7-92a4-4435-8c3d-cfe083eca4ce","Type":"ContainerStarted","Data":"8a29ef9270ebf0d1a851901608d64a5232a0233cecbf60be9370bf1e0ea577b7"} Jun 05 21:16:41.503508 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.503469 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:16:41.656666 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.656544 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:41.680676 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.680638 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vmcgl"] Jun 05 21:16:41.686040 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:16:41.686000 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aaecf80_c95e_4f7b_b3eb_6ca753c17eb5.slice/crio-aaa827bc5f9c2913c5fb326eb33e5e3a5430358fd875b547aeef15fb3e966f66 WatchSource:0}: Error finding container aaa827bc5f9c2913c5fb326eb33e5e3a5430358fd875b547aeef15fb3e966f66: Status 404 returned error can't find the container with id aaa827bc5f9c2913c5fb326eb33e5e3a5430358fd875b547aeef15fb3e966f66 Jun 05 21:16:41.758060 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:41.758020 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:42.299883 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:42.299846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:42.357205 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:42.357166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:42.432911 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:42.432876 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vmcgl" event={"ID":"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5","Type":"ContainerStarted","Data":"aaa827bc5f9c2913c5fb326eb33e5e3a5430358fd875b547aeef15fb3e966f66"} Jun 05 21:16:46.459099 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:46.459050 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" event={"ID":"16191fa7-92a4-4435-8c3d-cfe083eca4ce","Type":"ContainerStarted","Data":"e4bc66d50b0fd6f34e48bea6be7b4ffa47ba40611153bd2d18351b0d5ef73394"} Jun 05 21:16:46.459547 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:46.459223 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:16:46.460650 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:46.460622 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vmcgl" event={"ID":"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5","Type":"ContainerStarted","Data":"e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1"} Jun 05 21:16:46.478288 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:46.478226 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" podStartSLOduration=2.204315876 podStartE2EDuration="6.478205497s" totalImagesPullingTime="4.273889621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:46.475149893 +0000 UTC m=+695.566958369" watchObservedRunningTime="2026-06-05 21:16:46.478205497 +0000 UTC m=+695.570013943" Jun 05 21:16:46.491456 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:46.491401 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vmcgl" podStartSLOduration=1.646342476 podStartE2EDuration="5.49138474s" totalImagesPullingTime="3.845042264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:16:46.489109968 +0000 UTC m=+695.580918416" watchObservedRunningTime="2026-06-05 21:16:46.49138474 +0000 UTC m=+695.583193186" Jun 05 21:16:57.467480 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:16:57.467448 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b85f6" Jun 05 21:17:01.352602 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:01.352509 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:01.456856 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:01.456810 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:01.710991 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:01.710842 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:11.416268 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:11.416234 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:11.510464 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:11.510423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:11.653603 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:11.653517 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:40.191049 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:40.191009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:40.287380 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:40.287341 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:57.093940 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:17:57.093887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:09.774626 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:09.774586 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:09.997300 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:09.997266 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pbnds"] Jun 05 21:18:10.008052 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.008015 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:10.009509 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.009476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pbnds"] Jun 05 21:18:10.166597 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.166561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsmmt\" (UniqueName: \"kubernetes.io/projected/0c79feef-394f-4d9c-ad8b-4c88c337c3f6-kube-api-access-xsmmt\") pod \"authorino-5d4b67c446-pbnds\" (UID: \"0c79feef-394f-4d9c-ad8b-4c88c337c3f6\") " pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:10.227743 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.227705 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pbnds"] Jun 05 21:18:10.228037 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:18:10.228015 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xsmmt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pbnds" podUID="0c79feef-394f-4d9c-ad8b-4c88c337c3f6" Jun 05 21:18:10.267979 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.267937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsmmt\" (UniqueName: \"kubernetes.io/projected/0c79feef-394f-4d9c-ad8b-4c88c337c3f6-kube-api-access-xsmmt\") pod \"authorino-5d4b67c446-pbnds\" (UID: \"0c79feef-394f-4d9c-ad8b-4c88c337c3f6\") " pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:10.277339 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.277311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsmmt\" (UniqueName: \"kubernetes.io/projected/0c79feef-394f-4d9c-ad8b-4c88c337c3f6-kube-api-access-xsmmt\") pod \"authorino-5d4b67c446-pbnds\" (UID: \"0c79feef-394f-4d9c-ad8b-4c88c337c3f6\") " pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:10.522167 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.522077 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:10.711363 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.711322 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78f95d8945-5zfpk"] Jun 05 21:18:10.715147 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.715123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:10.718189 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.718168 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 21:18:10.727477 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.727453 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78f95d8945-5zfpk"] Jun 05 21:18:10.874029 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.873988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdtlr\" (UniqueName: \"kubernetes.io/projected/205c8f64-9766-49f5-a4a8-3c8550a88b73-kube-api-access-bdtlr\") pod \"authorino-78f95d8945-5zfpk\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:10.874414 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.874096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/205c8f64-9766-49f5-a4a8-3c8550a88b73-tls-cert\") pod \"authorino-78f95d8945-5zfpk\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:10.911229 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.911202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:10.917771 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.917749 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:10.975120 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.975074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/205c8f64-9766-49f5-a4a8-3c8550a88b73-tls-cert\") pod \"authorino-78f95d8945-5zfpk\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:10.975306 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.975165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdtlr\" (UniqueName: \"kubernetes.io/projected/205c8f64-9766-49f5-a4a8-3c8550a88b73-kube-api-access-bdtlr\") pod \"authorino-78f95d8945-5zfpk\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:10.977589 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.977556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/205c8f64-9766-49f5-a4a8-3c8550a88b73-tls-cert\") pod \"authorino-78f95d8945-5zfpk\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:10.983479 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:10.983454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdtlr\" (UniqueName: \"kubernetes.io/projected/205c8f64-9766-49f5-a4a8-3c8550a88b73-kube-api-access-bdtlr\") pod \"authorino-78f95d8945-5zfpk\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:11.025606 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.025562 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:18:11.076654 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.076617 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsmmt\" (UniqueName: \"kubernetes.io/projected/0c79feef-394f-4d9c-ad8b-4c88c337c3f6-kube-api-access-xsmmt\") pod \"0c79feef-394f-4d9c-ad8b-4c88c337c3f6\" (UID: \"0c79feef-394f-4d9c-ad8b-4c88c337c3f6\") " Jun 05 21:18:11.080205 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.080147 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c79feef-394f-4d9c-ad8b-4c88c337c3f6-kube-api-access-xsmmt" (OuterVolumeSpecName: "kube-api-access-xsmmt") pod "0c79feef-394f-4d9c-ad8b-4c88c337c3f6" (UID: "0c79feef-394f-4d9c-ad8b-4c88c337c3f6"). InnerVolumeSpecName "kube-api-access-xsmmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:18:11.168806 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.168782 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78f95d8945-5zfpk"] Jun 05 21:18:11.172069 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:18:11.172039 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod205c8f64_9766_49f5_a4a8_3c8550a88b73.slice/crio-9301efb712405db9f6ae62b8854f569703f99e9ac16935642a5e84af476b0065 WatchSource:0}: Error finding container 9301efb712405db9f6ae62b8854f569703f99e9ac16935642a5e84af476b0065: Status 404 returned error can't find the container with id 9301efb712405db9f6ae62b8854f569703f99e9ac16935642a5e84af476b0065 Jun 05 21:18:11.173505 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.173489 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:18:11.177291 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.177270 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsmmt\" (UniqueName: \"kubernetes.io/projected/0c79feef-394f-4d9c-ad8b-4c88c337c3f6-kube-api-access-xsmmt\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:18:11.925116 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.925078 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f95d8945-5zfpk" event={"ID":"205c8f64-9766-49f5-a4a8-3c8550a88b73","Type":"ContainerStarted","Data":"59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0"} Jun 05 21:18:11.925116 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.925123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f95d8945-5zfpk" event={"ID":"205c8f64-9766-49f5-a4a8-3c8550a88b73","Type":"ContainerStarted","Data":"9301efb712405db9f6ae62b8854f569703f99e9ac16935642a5e84af476b0065"} Jun 05 21:18:11.925561 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.925125 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pbnds" Jun 05 21:18:11.944093 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.944035 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78f95d8945-5zfpk" podStartSLOduration=1.647969467 podStartE2EDuration="1.944019659s" totalImagesPullingTime="296.050192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:11.942032057 +0000 UTC m=+781.033840506" watchObservedRunningTime="2026-06-05 21:18:11.944019659 +0000 UTC m=+781.035828152" Jun 05 21:18:11.968806 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.968760 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pbnds"] Jun 05 21:18:11.971095 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.971063 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vmcgl"] Jun 05 21:18:11.971262 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.971241 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vmcgl" podUID="0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" containerName="authorino" containerID="cri-o://e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1" gracePeriod=30 Jun 05 21:18:11.975681 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:11.975655 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pbnds"] Jun 05 21:18:12.218685 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.218659 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:18:12.286000 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.285972 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47zkr\" (UniqueName: \"kubernetes.io/projected/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5-kube-api-access-47zkr\") pod \"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5\" (UID: \"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5\") " Jun 05 21:18:12.288246 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.288214 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5-kube-api-access-47zkr" (OuterVolumeSpecName: "kube-api-access-47zkr") pod "0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" (UID: "0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5"). InnerVolumeSpecName "kube-api-access-47zkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:18:12.387250 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.387217 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47zkr\" (UniqueName: \"kubernetes.io/projected/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5-kube-api-access-47zkr\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:18:12.935036 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.935003 2560 generic.go:356] "Generic (PLEG): container finished" podID="0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" containerID="e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1" exitCode=0 Jun 05 21:18:12.935597 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.935076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vmcgl" event={"ID":"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5","Type":"ContainerDied","Data":"e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1"} Jun 05 21:18:12.935680 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.935628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vmcgl" event={"ID":"0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5","Type":"ContainerDied","Data":"aaa827bc5f9c2913c5fb326eb33e5e3a5430358fd875b547aeef15fb3e966f66"} Jun 05 21:18:12.935680 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.935654 2560 scope.go:117] "RemoveContainer" containerID="e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1" Jun 05 21:18:12.935780 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.935112 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vmcgl" Jun 05 21:18:12.947244 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.947222 2560 scope.go:117] "RemoveContainer" containerID="e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1" Jun 05 21:18:12.947544 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:18:12.947519 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1\": container with ID starting with e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1 not found: ID does not exist" containerID="e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1" Jun 05 21:18:12.947633 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.947552 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1"} err="failed to get container status \"e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1\": rpc error: code = NotFound desc = could not find container \"e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1\": container with ID starting with e54ae2e4bd18d6ab8255a32bf4fdba03f1224d9a0df7ca1d70354b198999f7c1 not found: ID does not exist" Jun 05 21:18:12.959151 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.959129 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vmcgl"] Jun 05 21:18:12.964324 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:12.964303 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vmcgl"] Jun 05 21:18:13.376729 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:13.376692 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" path="/var/lib/kubelet/pods/0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5/volumes" Jun 05 21:18:13.377221 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:13.377202 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c79feef-394f-4d9c-ad8b-4c88c337c3f6" path="/var/lib/kubelet/pods/0c79feef-394f-4d9c-ad8b-4c88c337c3f6/volumes" Jun 05 21:18:15.534903 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:15.534864 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:15.614133 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:15.614097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:15.670678 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:15.670646 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:15.916887 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:15.916772 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:19.118072 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:19.118033 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:19.209336 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:19.209301 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:37.809150 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:37.809066 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:37.860620 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:37.860571 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:50.237135 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:50.237103 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:50.514278 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:50.514187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:50.653826 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:50.653793 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:50.736483 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:50.736446 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:50.895315 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:50.895280 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:18:56.229091 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:56.229051 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:59.199011 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:59.198976 2560 generic.go:356] "Generic (PLEG): container finished" podID="3a18490d-f052-4d5a-8eaa-f4550286af8f" containerID="b8c2c79777574ada7a181b85a6385785cc8e1266b706b0f678610a4ddebb2ae3" exitCode=0 Jun 05 21:18:59.199442 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:59.199052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" event={"ID":"3a18490d-f052-4d5a-8eaa-f4550286af8f","Type":"ContainerDied","Data":"b8c2c79777574ada7a181b85a6385785cc8e1266b706b0f678610a4ddebb2ae3"} Jun 05 21:18:59.199540 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:59.199522 2560 scope.go:117] "RemoveContainer" containerID="b8c2c79777574ada7a181b85a6385785cc8e1266b706b0f678610a4ddebb2ae3" Jun 05 21:18:59.200555 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:59.200525 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:18:59.200616 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:59.200595 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:18:59.200652 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:18:59.200625 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:19:00.206631 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:00.206599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" event={"ID":"3a18490d-f052-4d5a-8eaa-f4550286af8f","Type":"ContainerStarted","Data":"782ad1fe175fc78aaf5c30f5acdbfb43e85787c9b8ac0b9cef2e098d603cc271"} Jun 05 21:19:00.999830 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:00.999787 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:19:01.000084 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:01.000058 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-xwzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 05 21:19:01.000136 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:01.000111 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" podUID="3a18490d-f052-4d5a-8eaa-f4550286af8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 05 21:19:02.000807 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:02.000768 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-xwzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 05 21:19:02.001253 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:02.000840 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" podUID="3a18490d-f052-4d5a-8eaa-f4550286af8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 05 21:19:03.000277 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:03.000238 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-xwzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 05 21:19:03.000460 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:03.000300 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" podUID="3a18490d-f052-4d5a-8eaa-f4550286af8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 05 21:19:04.000750 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:04.000719 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-xwzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jun 05 21:19:04.001145 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:04.000778 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" podUID="3a18490d-f052-4d5a-8eaa-f4550286af8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jun 05 21:19:05.003985 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:05.003956 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:19:05.004461 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:05.004242 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:19:05.005001 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:05.004987 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-xwzh4" Jun 05 21:19:38.951090 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.951049 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6795b8897c-ffzxf"] Jun 05 21:19:38.951805 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.951780 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" containerName="authorino" Jun 05 21:19:38.951901 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.951808 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" containerName="authorino" Jun 05 21:19:38.952010 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.951910 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aaecf80-c95e-4f7b-b3eb-6ca753c17eb5" containerName="authorino" Jun 05 21:19:38.953846 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.953822 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:38.956221 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.956201 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 05 21:19:38.963574 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:38.963549 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6795b8897c-ffzxf"] Jun 05 21:19:39.065231 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.065188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be89fac6-35b5-4741-aec3-8c417476f3dd-oidc-ca\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.065403 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.065246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be89fac6-35b5-4741-aec3-8c417476f3dd-tls-cert\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.065403 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.065351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl52k\" (UniqueName: \"kubernetes.io/projected/be89fac6-35b5-4741-aec3-8c417476f3dd-kube-api-access-kl52k\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.165899 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.165862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl52k\" (UniqueName: \"kubernetes.io/projected/be89fac6-35b5-4741-aec3-8c417476f3dd-kube-api-access-kl52k\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.166117 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.165962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be89fac6-35b5-4741-aec3-8c417476f3dd-oidc-ca\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.166117 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.165988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be89fac6-35b5-4741-aec3-8c417476f3dd-tls-cert\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.166726 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.166703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be89fac6-35b5-4741-aec3-8c417476f3dd-oidc-ca\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.168643 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.168623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be89fac6-35b5-4741-aec3-8c417476f3dd-tls-cert\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.174035 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.174009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl52k\" (UniqueName: \"kubernetes.io/projected/be89fac6-35b5-4741-aec3-8c417476f3dd-kube-api-access-kl52k\") pod \"authorino-6795b8897c-ffzxf\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.264143 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.264044 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:19:39.402780 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.402757 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6795b8897c-ffzxf"] Jun 05 21:19:39.404767 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:19:39.404737 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe89fac6_35b5_4741_aec3_8c417476f3dd.slice/crio-c9eaef1f432d7cc7548d7950ace9f80c096ed0a103a655b0909b0e98e50ade6c WatchSource:0}: Error finding container c9eaef1f432d7cc7548d7950ace9f80c096ed0a103a655b0909b0e98e50ade6c: Status 404 returned error can't find the container with id c9eaef1f432d7cc7548d7950ace9f80c096ed0a103a655b0909b0e98e50ade6c Jun 05 21:19:39.416793 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:39.416769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6795b8897c-ffzxf" event={"ID":"be89fac6-35b5-4741-aec3-8c417476f3dd","Type":"ContainerStarted","Data":"c9eaef1f432d7cc7548d7950ace9f80c096ed0a103a655b0909b0e98e50ade6c"} Jun 05 21:19:40.425483 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.425357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6795b8897c-ffzxf" event={"ID":"be89fac6-35b5-4741-aec3-8c417476f3dd","Type":"ContainerStarted","Data":"e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690"} Jun 05 21:19:40.441476 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.441413 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6795b8897c-ffzxf" podStartSLOduration=2.11818809 podStartE2EDuration="2.441391606s" totalImagesPullingTime="323.203516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:40.438858432 +0000 UTC m=+869.530666881" watchObservedRunningTime="2026-06-05 21:19:40.441391606 +0000 UTC m=+869.533200056" Jun 05 21:19:40.466090 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.466051 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f95d8945-5zfpk"] Jun 05 21:19:40.466374 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.466341 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-78f95d8945-5zfpk" podUID="205c8f64-9766-49f5-a4a8-3c8550a88b73" containerName="authorino" containerID="cri-o://59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0" gracePeriod=30 Jun 05 21:19:40.739222 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.739199 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:19:40.788331 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.788286 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdtlr\" (UniqueName: \"kubernetes.io/projected/205c8f64-9766-49f5-a4a8-3c8550a88b73-kube-api-access-bdtlr\") pod \"205c8f64-9766-49f5-a4a8-3c8550a88b73\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " Jun 05 21:19:40.788515 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.788393 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/205c8f64-9766-49f5-a4a8-3c8550a88b73-tls-cert\") pod \"205c8f64-9766-49f5-a4a8-3c8550a88b73\" (UID: \"205c8f64-9766-49f5-a4a8-3c8550a88b73\") " Jun 05 21:19:40.790447 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.790417 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205c8f64-9766-49f5-a4a8-3c8550a88b73-kube-api-access-bdtlr" (OuterVolumeSpecName: "kube-api-access-bdtlr") pod "205c8f64-9766-49f5-a4a8-3c8550a88b73" (UID: "205c8f64-9766-49f5-a4a8-3c8550a88b73"). InnerVolumeSpecName "kube-api-access-bdtlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:19:40.799431 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.799403 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/205c8f64-9766-49f5-a4a8-3c8550a88b73-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "205c8f64-9766-49f5-a4a8-3c8550a88b73" (UID: "205c8f64-9766-49f5-a4a8-3c8550a88b73"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:19:40.886073 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.886036 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:40.889165 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.889147 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdtlr\" (UniqueName: \"kubernetes.io/projected/205c8f64-9766-49f5-a4a8-3c8550a88b73-kube-api-access-bdtlr\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:19:40.889256 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.889166 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/205c8f64-9766-49f5-a4a8-3c8550a88b73-tls-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:19:40.990876 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:40.990791 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:41.433221 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.433188 2560 generic.go:356] "Generic (PLEG): container finished" podID="205c8f64-9766-49f5-a4a8-3c8550a88b73" containerID="59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0" exitCode=0 Jun 05 21:19:41.433649 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.433231 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f95d8945-5zfpk" Jun 05 21:19:41.433649 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.433270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f95d8945-5zfpk" event={"ID":"205c8f64-9766-49f5-a4a8-3c8550a88b73","Type":"ContainerDied","Data":"59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0"} Jun 05 21:19:41.433649 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.433311 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f95d8945-5zfpk" event={"ID":"205c8f64-9766-49f5-a4a8-3c8550a88b73","Type":"ContainerDied","Data":"9301efb712405db9f6ae62b8854f569703f99e9ac16935642a5e84af476b0065"} Jun 05 21:19:41.433649 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.433327 2560 scope.go:117] "RemoveContainer" containerID="59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0" Jun 05 21:19:41.442121 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.442100 2560 scope.go:117] "RemoveContainer" containerID="59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0" Jun 05 21:19:41.442360 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:19:41.442342 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0\": container with ID starting with 59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0 not found: ID does not exist" containerID="59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0" Jun 05 21:19:41.442411 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.442366 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0"} err="failed to get container status \"59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0\": rpc error: code = NotFound desc = could not find container \"59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0\": container with ID starting with 59254f7f357de3d3c77da71df16da565e292e3ea3f7157c9025ed6a43f75a4b0 not found: ID does not exist" Jun 05 21:19:41.450861 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.450836 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f95d8945-5zfpk"] Jun 05 21:19:41.454439 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:41.454420 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78f95d8945-5zfpk"] Jun 05 21:19:43.377188 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:43.377154 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205c8f64-9766-49f5-a4a8-3c8550a88b73" path="/var/lib/kubelet/pods/205c8f64-9766-49f5-a4a8-3c8550a88b73/volumes" Jun 05 21:19:45.742599 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:45.742569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:46.131505 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:46.131469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:19:59.470620 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:59.470590 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:59.838774 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:19:59.838735 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:20:11.377770 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:11.377682 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:20:11.380062 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:11.380036 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:20:11.385325 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:11.385303 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:20:11.387076 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:11.387059 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqkpx_27d9d21b-0638-49de-a49f-0b581389c01f/ovn-acl-logging/0.log" Jun 05 21:20:21.349621 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:21.349583 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:21.817332 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:21.817291 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:20:28.436455 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:28.436423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:29.134265 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:29.134222 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:20:31.852703 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:31.852670 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:32.523875 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:32.523838 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:20:41.843147 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:41.843111 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:42.861573 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:42.861538 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:47.861652 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:47.861612 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:48.616933 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:20:48.616890 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b85f6"] Jun 05 21:21:37.418647 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:37.418547 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:46.298181 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.298143 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-548f5dd8d8-wttn8"] Jun 05 21:21:46.298658 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.298580 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="205c8f64-9766-49f5-a4a8-3c8550a88b73" containerName="authorino" Jun 05 21:21:46.298658 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.298598 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="205c8f64-9766-49f5-a4a8-3c8550a88b73" containerName="authorino" Jun 05 21:21:46.298741 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.298681 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="205c8f64-9766-49f5-a4a8-3c8550a88b73" containerName="authorino" Jun 05 21:21:46.301587 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.301569 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.311236 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.311209 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548f5dd8d8-wttn8"] Jun 05 21:21:46.400983 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.400906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbjlk\" (UniqueName: \"kubernetes.io/projected/184e7b0f-d87d-40d7-a22f-81cfcca595ab-kube-api-access-zbjlk\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.401168 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.401030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/184e7b0f-d87d-40d7-a22f-81cfcca595ab-tls-cert\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.401168 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.401063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/184e7b0f-d87d-40d7-a22f-81cfcca595ab-oidc-ca\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.502102 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.502060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/184e7b0f-d87d-40d7-a22f-81cfcca595ab-tls-cert\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.502102 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.502107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/184e7b0f-d87d-40d7-a22f-81cfcca595ab-oidc-ca\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.502370 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.502162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbjlk\" (UniqueName: \"kubernetes.io/projected/184e7b0f-d87d-40d7-a22f-81cfcca595ab-kube-api-access-zbjlk\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.502794 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.502768 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/184e7b0f-d87d-40d7-a22f-81cfcca595ab-oidc-ca\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.504530 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.504505 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/184e7b0f-d87d-40d7-a22f-81cfcca595ab-tls-cert\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.509786 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.509763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbjlk\" (UniqueName: \"kubernetes.io/projected/184e7b0f-d87d-40d7-a22f-81cfcca595ab-kube-api-access-zbjlk\") pod \"authorino-548f5dd8d8-wttn8\" (UID: \"184e7b0f-d87d-40d7-a22f-81cfcca595ab\") " pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.612322 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.612234 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548f5dd8d8-wttn8" Jun 05 21:21:46.753578 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.753548 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548f5dd8d8-wttn8"] Jun 05 21:21:46.755853 ip-10-0-128-37 kubenswrapper[2560]: W0605 21:21:46.755818 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod184e7b0f_d87d_40d7_a22f_81cfcca595ab.slice/crio-7d5c571e52f9b86cfdb0efa8004ea40291e5abb3ef89459c96a645857d525534 WatchSource:0}: Error finding container 7d5c571e52f9b86cfdb0efa8004ea40291e5abb3ef89459c96a645857d525534: Status 404 returned error can't find the container with id 7d5c571e52f9b86cfdb0efa8004ea40291e5abb3ef89459c96a645857d525534 Jun 05 21:21:46.828026 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.827979 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:46.920764 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:46.920669 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:47.125119 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:47.125084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548f5dd8d8-wttn8" event={"ID":"184e7b0f-d87d-40d7-a22f-81cfcca595ab","Type":"ContainerStarted","Data":"7d5c571e52f9b86cfdb0efa8004ea40291e5abb3ef89459c96a645857d525534"} Jun 05 21:21:47.996441 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:47.996389 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:48.093200 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.093163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:48.132776 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.132741 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548f5dd8d8-wttn8" event={"ID":"184e7b0f-d87d-40d7-a22f-81cfcca595ab","Type":"ContainerStarted","Data":"12e5083070c3ec84b2e9f61eb28160f7ec78013bc1b35e9e6d2e0b6d83153d1b"} Jun 05 21:21:48.157505 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.157438 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-548f5dd8d8-wttn8" podStartSLOduration=1.787179429 podStartE2EDuration="2.157416045s" totalImagesPullingTime="370.236616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:48.154422708 +0000 UTC m=+997.246231155" watchObservedRunningTime="2026-06-05 21:21:48.157416045 +0000 UTC m=+997.249224493" Jun 05 21:21:48.215535 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.215494 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6795b8897c-ffzxf"] Jun 05 21:21:48.216071 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.216031 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6795b8897c-ffzxf" podUID="be89fac6-35b5-4741-aec3-8c417476f3dd" containerName="authorino" containerID="cri-o://e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690" gracePeriod=30 Jun 05 21:21:48.479562 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.479529 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:21:48.523319 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.523275 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be89fac6-35b5-4741-aec3-8c417476f3dd-oidc-ca\") pod \"be89fac6-35b5-4741-aec3-8c417476f3dd\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " Jun 05 21:21:48.523490 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.523370 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be89fac6-35b5-4741-aec3-8c417476f3dd-tls-cert\") pod \"be89fac6-35b5-4741-aec3-8c417476f3dd\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " Jun 05 21:21:48.523490 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.523392 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl52k\" (UniqueName: \"kubernetes.io/projected/be89fac6-35b5-4741-aec3-8c417476f3dd-kube-api-access-kl52k\") pod \"be89fac6-35b5-4741-aec3-8c417476f3dd\" (UID: \"be89fac6-35b5-4741-aec3-8c417476f3dd\") " Jun 05 21:21:48.525582 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.525541 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be89fac6-35b5-4741-aec3-8c417476f3dd-kube-api-access-kl52k" (OuterVolumeSpecName: "kube-api-access-kl52k") pod "be89fac6-35b5-4741-aec3-8c417476f3dd" (UID: "be89fac6-35b5-4741-aec3-8c417476f3dd"). InnerVolumeSpecName "kube-api-access-kl52k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:21:48.529771 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.529734 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be89fac6-35b5-4741-aec3-8c417476f3dd-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "be89fac6-35b5-4741-aec3-8c417476f3dd" (UID: "be89fac6-35b5-4741-aec3-8c417476f3dd"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:21:48.534722 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.534694 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be89fac6-35b5-4741-aec3-8c417476f3dd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "be89fac6-35b5-4741-aec3-8c417476f3dd" (UID: "be89fac6-35b5-4741-aec3-8c417476f3dd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:21:48.624714 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.624629 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be89fac6-35b5-4741-aec3-8c417476f3dd-tls-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:21:48.624714 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.624662 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl52k\" (UniqueName: \"kubernetes.io/projected/be89fac6-35b5-4741-aec3-8c417476f3dd-kube-api-access-kl52k\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:21:48.624714 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:48.624672 2560 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be89fac6-35b5-4741-aec3-8c417476f3dd-oidc-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\"" Jun 05 21:21:49.139498 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.139465 2560 generic.go:356] "Generic (PLEG): container finished" podID="be89fac6-35b5-4741-aec3-8c417476f3dd" containerID="e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690" exitCode=0 Jun 05 21:21:49.140008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.139526 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6795b8897c-ffzxf" Jun 05 21:21:49.140008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.139561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6795b8897c-ffzxf" event={"ID":"be89fac6-35b5-4741-aec3-8c417476f3dd","Type":"ContainerDied","Data":"e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690"} Jun 05 21:21:49.140008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.139615 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6795b8897c-ffzxf" event={"ID":"be89fac6-35b5-4741-aec3-8c417476f3dd","Type":"ContainerDied","Data":"c9eaef1f432d7cc7548d7950ace9f80c096ed0a103a655b0909b0e98e50ade6c"} Jun 05 21:21:49.140008 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.139639 2560 scope.go:117] "RemoveContainer" containerID="e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690" Jun 05 21:21:49.150991 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.150968 2560 scope.go:117] "RemoveContainer" containerID="e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690" Jun 05 21:21:49.151283 ip-10-0-128-37 kubenswrapper[2560]: E0605 21:21:49.151265 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690\": container with ID starting with e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690 not found: ID does not exist" containerID="e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690" Jun 05 21:21:49.151355 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.151292 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690"} err="failed to get container status \"e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690\": rpc error: code = NotFound desc = could not find container \"e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690\": container with ID starting with e454e7756da8db8d4b11330091903047a35ffbdb3bb5a0881bbce5e841da9690 not found: ID does not exist" Jun 05 21:21:49.172432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.172401 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6795b8897c-ffzxf"] Jun 05 21:21:49.179518 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.179483 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6795b8897c-ffzxf"] Jun 05 21:21:49.377667 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:21:49.377633 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be89fac6-35b5-4741-aec3-8c417476f3dd" path="/var/lib/kubelet/pods/be89fac6-35b5-4741-aec3-8c417476f3dd/volumes" Jun 05 21:22:00.008220 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:00.008190 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548f5dd8d8-wttn8_184e7b0f-d87d-40d7-a22f-81cfcca595ab/authorino/0.log" Jun 05 21:22:04.487689 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:04.487661 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-866f84b4bb-c28mc_6cdd75aa-ab46-4268-b6ef-4e465ef32fc2/nginx/0.log" Jun 05 21:22:05.341128 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:05.341099 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-hbvpb_fbfb5d6e-c1e9-49b9-8286-433d69739e54/copy-manifests/0.log" Jun 05 21:22:05.349790 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:05.349757 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-hbvpb_fbfb5d6e-c1e9-49b9-8286-433d69739e54/manager/0.log" Jun 05 21:22:06.371015 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.370986 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn_c72abce0-3f98-4e2c-b4df-96cae737ac85/util/0.log" Jun 05 21:22:06.378906 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.378852 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn_c72abce0-3f98-4e2c-b4df-96cae737ac85/pull/0.log" Jun 05 21:22:06.386373 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.386356 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn_c72abce0-3f98-4e2c-b4df-96cae737ac85/extract/0.log" Jun 05 21:22:06.496159 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.496133 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx_02006ecc-0eb0-4b38-9374-96fb52e39b35/util/0.log" Jun 05 21:22:06.504415 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.504363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx_02006ecc-0eb0-4b38-9374-96fb52e39b35/pull/0.log" Jun 05 21:22:06.512597 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.512547 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx_02006ecc-0eb0-4b38-9374-96fb52e39b35/extract/0.log" Jun 05 21:22:06.625124 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.625043 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs_102fe1f6-a986-4728-bbad-cf119830568d/util/0.log" Jun 05 21:22:06.634344 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.634315 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs_102fe1f6-a986-4728-bbad-cf119830568d/pull/0.log" Jun 05 21:22:06.641555 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.641518 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs_102fe1f6-a986-4728-bbad-cf119830568d/extract/0.log" Jun 05 21:22:06.757911 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.757886 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d_67afcda5-d6ac-4b5f-acaa-789b52206b37/util/0.log" Jun 05 21:22:06.771552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.771484 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d_67afcda5-d6ac-4b5f-acaa-789b52206b37/pull/0.log" Jun 05 21:22:06.780002 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.779978 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d_67afcda5-d6ac-4b5f-acaa-789b52206b37/extract/0.log" Jun 05 21:22:06.902104 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:06.902024 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548f5dd8d8-wttn8_184e7b0f-d87d-40d7-a22f-81cfcca595ab/authorino/0.log" Jun 05 21:22:07.030460 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:07.030429 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-25wk4_2a32844e-3bca-41e0-af4b-236d687440eb/manager/0.log" Jun 05 21:22:07.145800 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:07.145768 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r5f99_c5ffc88a-5007-4e51-a7ec-228df7f92709/manager/0.log" Jun 05 21:22:07.371001 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:07.370952 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vmc7w_a34212e5-0b70-4e95-ba83-5fc645bdc68b/registry-server/0.log" Jun 05 21:22:07.492242 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:07.492203 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ljrgk_0b2a2a03-d28e-4282-b378-ead377ed7c8b/manager/0.log" Jun 05 21:22:07.604626 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:07.604598 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b85f6_16191fa7-92a4-4435-8c3d-cfe083eca4ce/limitador/0.log" Jun 05 21:22:08.071307 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:08.071276 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc6sxxg_b104e19f-0a5a-4a0a-88b0-110a562346d0/istio-proxy/0.log" Jun 05 21:22:08.547839 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:08.547813 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/1.log" Jun 05 21:22:08.888706 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:08.888579 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fd8545cc7-6dt76_43014c37-8528-499d-abf3-105d6a0d6f0f/router/0.log" Jun 05 21:22:13.634646 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.634600 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:13.690128 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.690094 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58whj/must-gather-mgnqv"] Jun 05 21:22:13.690466 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.690454 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be89fac6-35b5-4741-aec3-8c417476f3dd" containerName="authorino" Jun 05 21:22:13.690512 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.690467 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="be89fac6-35b5-4741-aec3-8c417476f3dd" containerName="authorino" Jun 05 21:22:13.690547 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.690535 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="be89fac6-35b5-4741-aec3-8c417476f3dd" containerName="authorino" Jun 05 21:22:13.695149 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.695121 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:13.702448 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.702425 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-58whj\"/\"default-dockercfg-tqjqs\"" Jun 05 21:22:13.702552 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.702425 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58whj\"/\"kube-root-ca.crt\"" Jun 05 21:22:13.703132 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.703116 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58whj\"/\"openshift-service-ca.crt\"" Jun 05 21:22:13.716407 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.716380 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58whj/must-gather-mgnqv"] Jun 05 21:22:13.817577 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.817543 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:13.849832 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.849797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51-must-gather-output\") pod \"must-gather-mgnqv\" (UID: \"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51\") " pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:13.850038 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.849859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr524\" (UniqueName: \"kubernetes.io/projected/b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51-kube-api-access-wr524\") pod \"must-gather-mgnqv\" (UID: \"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51\") " pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:13.951335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.951242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51-must-gather-output\") pod \"must-gather-mgnqv\" (UID: \"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51\") " pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:13.951335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.951301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr524\" (UniqueName: \"kubernetes.io/projected/b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51-kube-api-access-wr524\") pod \"must-gather-mgnqv\" (UID: \"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51\") " pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:13.951604 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.951583 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51-must-gather-output\") pod \"must-gather-mgnqv\" (UID: \"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51\") " pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:13.978328 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:13.978296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr524\" (UniqueName: \"kubernetes.io/projected/b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51-kube-api-access-wr524\") pod \"must-gather-mgnqv\" (UID: \"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51\") " pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:14.003858 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:14.003820 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58whj/must-gather-mgnqv" Jun 05 21:22:14.193233 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:14.191184 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58whj/must-gather-mgnqv"] Jun 05 21:22:14.279931 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:14.279888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/must-gather-mgnqv" event={"ID":"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51","Type":"ContainerStarted","Data":"d51469721e91783007d259fb3874cd9cbb4fba35aa7daee8e531b420fcf49402"} Jun 05 21:22:15.290694 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:15.289737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/must-gather-mgnqv" event={"ID":"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51","Type":"ContainerStarted","Data":"7f65c82659c2d05c69cefc106f6b4543b80835bb4e6d10f0b50a088419216049"} Jun 05 21:22:15.290694 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:15.289794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/must-gather-mgnqv" event={"ID":"b8b460ca-9d1f-4d90-a405-f8ccc7b6cc51","Type":"ContainerStarted","Data":"9c080238b7bc8d70212b3b0036dcb15793763b8102c7e5bab50cdd04ba47fd86"} Jun 05 21:22:15.320372 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:15.320319 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58whj/must-gather-mgnqv" podStartSLOduration=1.481458742 podStartE2EDuration="2.320298842s" totalImagesPullingTime="838.8401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:15.318648527 +0000 UTC m=+1024.410456971" watchObservedRunningTime="2026-06-05 21:22:15.320298842 +0000 UTC m=+1024.412107288" Jun 05 21:22:16.873793 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:16.873760 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d2wd6_ee131199-02c0-49dc-b384-1826bec3c5ff/global-pull-secret-syncer/0.log" Jun 05 21:22:16.976026 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:16.975993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" Jun 05 21:22:17.075333 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:17.075301 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-37.ec2.internal_04c5343738b2a5e9259847f1e464ce4d/haproxy/0.log" Jun 05 21:22:21.598525 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.598477 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn_c72abce0-3f98-4e2c-b4df-96cae737ac85/extract/0.log" Jun 05 21:22:21.648512 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.648478 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn_c72abce0-3f98-4e2c-b4df-96cae737ac85/util/0.log" Jun 05 21:22:21.674324 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.674279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969qjn_c72abce0-3f98-4e2c-b4df-96cae737ac85/pull/0.log" Jun 05 21:22:21.714750 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.714688 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx_02006ecc-0eb0-4b38-9374-96fb52e39b35/extract/0.log" Jun 05 21:22:21.743788 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.743758 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx_02006ecc-0eb0-4b38-9374-96fb52e39b35/util/0.log" Jun 05 21:22:21.771499 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.771435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl4rx_02006ecc-0eb0-4b38-9374-96fb52e39b35/pull/0.log" Jun 05 21:22:21.809791 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.809764 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs_102fe1f6-a986-4728-bbad-cf119830568d/extract/0.log" Jun 05 21:22:21.846424 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.846397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs_102fe1f6-a986-4728-bbad-cf119830568d/util/0.log" Jun 05 21:22:21.882032 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.881947 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738twqs_102fe1f6-a986-4728-bbad-cf119830568d/pull/0.log" Jun 05 21:22:21.917863 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.917834 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d_67afcda5-d6ac-4b5f-acaa-789b52206b37/extract/0.log" Jun 05 21:22:21.959899 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:21.959867 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d_67afcda5-d6ac-4b5f-acaa-789b52206b37/util/0.log" Jun 05 21:22:22.021465 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.021416 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f2h2d_67afcda5-d6ac-4b5f-acaa-789b52206b37/pull/0.log" Jun 05 21:22:22.069254 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.069208 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548f5dd8d8-wttn8_184e7b0f-d87d-40d7-a22f-81cfcca595ab/authorino/0.log" Jun 05 21:22:22.129802 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.129763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-25wk4_2a32844e-3bca-41e0-af4b-236d687440eb/manager/0.log" Jun 05 21:22:22.156974 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.156853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r5f99_c5ffc88a-5007-4e51-a7ec-228df7f92709/manager/0.log" Jun 05 21:22:22.227551 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.227519 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vmc7w_a34212e5-0b70-4e95-ba83-5fc645bdc68b/registry-server/0.log" Jun 05 21:22:22.276450 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.276405 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ljrgk_0b2a2a03-d28e-4282-b378-ead377ed7c8b/manager/0.log" Jun 05 21:22:22.301222 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:22.301188 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b85f6_16191fa7-92a4-4435-8c3d-cfe083eca4ce/limitador/0.log" Jun 05 21:22:24.143335 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.143291 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qxm4h_2a927a74-d42b-4b94-ba6e-6088830250b5/cluster-monitoring-operator/0.log" Jun 05 21:22:24.155267 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.155229 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hgrh6_7334cf6d-90f0-42dd-bc33-aaa84db972c6/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:24.191527 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.191499 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8kxd5_7af742e2-eeeb-45a2-8068-6740eb29f050/kube-state-metrics/0.log" Jun 05 21:22:24.255310 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.255180 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8kxd5_7af742e2-eeeb-45a2-8068-6740eb29f050/kube-rbac-proxy-main/0.log" Jun 05 21:22:24.303432 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.303388 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8kxd5_7af742e2-eeeb-45a2-8068-6740eb29f050/kube-rbac-proxy-self/0.log" Jun 05 21:22:24.631739 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.631703 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p55vj_6cf2e250-532b-4771-90e2-3ea21993512e/node-exporter/0.log" Jun 05 21:22:24.655909 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.655876 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p55vj_6cf2e250-532b-4771-90e2-3ea21993512e/kube-rbac-proxy/0.log" Jun 05 21:22:24.703769 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:24.703726 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p55vj_6cf2e250-532b-4771-90e2-3ea21993512e/init-textfile/0.log" Jun 05 21:22:25.014345 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:25.014256 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9dp4d_c246e39b-d98e-4bf4-856c-c513eefca57b/prometheus-operator/0.log" Jun 05 21:22:25.042597 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:25.042562 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9dp4d_c246e39b-d98e-4bf4-856c-c513eefca57b/kube-rbac-proxy/0.log" Jun 05 21:22:25.076116 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:25.076086 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-wdjv5_30d8877d-9f22-419b-9e43-878a8027a61e/prometheus-operator-admission-webhook/0.log" Jun 05 21:22:26.656549 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:26.656503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-2sklf_4ae32549-40e3-4f29-9ffb-414cfca77b6c/networking-console-plugin/0.log" Jun 05 21:22:27.258602 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.258564 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/1.log" Jun 05 21:22:27.264821 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.264784 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-t8dcs_17165a00-98d1-4e26-afbc-23a11c66479c/console-operator/2.log" Jun 05 21:22:27.505598 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.505559 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z"] Jun 05 21:22:27.513462 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.513383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.519587 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.519558 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z"] Jun 05 21:22:27.695840 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.695800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5vkh\" (UniqueName: \"kubernetes.io/projected/c67e399a-6ead-413b-9dab-dd8c364cb309-kube-api-access-t5vkh\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.696363 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.695871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-proc\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.696363 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.695935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-sys\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.696363 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.696012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-podres\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.696363 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.696088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-lib-modules\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.796902 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.796862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-proc\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797192 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797122 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-proc\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797334 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-sys\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797513 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-sys\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797633 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-podres\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797633 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-lib-modules\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797633 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5vkh\" (UniqueName: \"kubernetes.io/projected/c67e399a-6ead-413b-9dab-dd8c364cb309-kube-api-access-t5vkh\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797633 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-podres\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.797797 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.797779 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c67e399a-6ead-413b-9dab-dd8c364cb309-lib-modules\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.810241 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.807010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5vkh\" (UniqueName: \"kubernetes.io/projected/c67e399a-6ead-413b-9dab-dd8c364cb309-kube-api-access-t5vkh\") pod \"perf-node-gather-daemonset-5zr9z\" (UID: \"c67e399a-6ead-413b-9dab-dd8c364cb309\") " pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.834075 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.834035 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:27.884938 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:27.879676 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-mzx7s_256fadf1-27d4-42e8-a7f2-c232fa5f7b14/download-server/0.log" Jun 05 21:22:28.045453 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:28.045152 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z"] Jun 05 21:22:28.396003 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:28.395892 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" event={"ID":"c67e399a-6ead-413b-9dab-dd8c364cb309","Type":"ContainerStarted","Data":"6707721d727c5b7e8a5b72fa680aed905ff4edcedf5a2690292b5d236efe08b3"} Jun 05 21:22:28.396003 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:28.395988 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" event={"ID":"c67e399a-6ead-413b-9dab-dd8c364cb309","Type":"ContainerStarted","Data":"e8cc89bdd21bf8f75947cf723c320c65e11ab438686cc1d2668fc52fa249f9df"} Jun 05 21:22:28.396823 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:28.396792 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:28.418971 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:28.418858 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" podStartSLOduration=1.418830233 podStartE2EDuration="1.418830233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:28.417660517 +0000 UTC m=+1037.509468965" watchObservedRunningTime="2026-06-05 21:22:28.418830233 +0000 UTC m=+1037.510638681" Jun 05 21:22:29.981351 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:29.981309 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hrh6l_dc1f1707-6f58-4b7f-a6cd-adc845cbb816/dns/0.log" Jun 05 21:22:30.018616 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:30.018592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hrh6l_dc1f1707-6f58-4b7f-a6cd-adc845cbb816/kube-rbac-proxy/0.log" Jun 05 21:22:30.257497 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:30.257413 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rnbd_4adaeb64-a7e4-4f77-9df0-6c56ce5909a2/dns-node-resolver/0.log" Jun 05 21:22:31.040027 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:31.039996 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lchd7_6d77f8c4-33ef-4d38-be34-d75e980a508c/node-ca/0.log" Jun 05 21:22:32.376958 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:32.376909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc6sxxg_b104e19f-0a5a-4a0a-88b0-110a562346d0/istio-proxy/0.log" Jun 05 21:22:32.652778 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:32.652675 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/1.log" Jun 05 21:22:32.653114 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:32.652895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/0.log" Jun 05 21:22:32.810538 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:32.810496 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fd8545cc7-6dt76_43014c37-8528-499d-abf3-105d6a0d6f0f/router/0.log" Jun 05 21:22:33.627851 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:33.627819 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6h5db_f9168ed4-c7e2-450f-ae4f-d059945630bc/serve-healthcheck-canary/0.log" Jun 05 21:22:34.679032 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:34.678995 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ldwh_00297e7e-5ad3-4a4b-9f34-962d9170f97f/kube-rbac-proxy/0.log" Jun 05 21:22:34.750604 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:34.750577 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ldwh_00297e7e-5ad3-4a4b-9f34-962d9170f97f/exporter/0.log" Jun 05 21:22:34.838593 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:34.838564 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ldwh_00297e7e-5ad3-4a4b-9f34-962d9170f97f/extractor/0.log" Jun 05 21:22:35.423973 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:35.423944 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-58whj/perf-node-gather-daemonset-5zr9z" Jun 05 21:22:37.926955 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:37.926903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-866f84b4bb-c28mc_6cdd75aa-ab46-4268-b6ef-4e465ef32fc2/nginx/0.log" Jun 05 21:22:38.403317 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:38.403292 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-hbvpb_fbfb5d6e-c1e9-49b9-8286-433d69739e54/manager/0.log" Jun 05 21:22:38.466968 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:38.466869 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79b9d749-hbvpb_fbfb5d6e-c1e9-49b9-8286-433d69739e54/copy-manifests/0.log" Jun 05 21:22:40.467632 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:40.467541 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77f48f848-4gv7j_3b6b308c-f6d6-476a-b1f0-55a16332604d/manager/0.log" Jun 05 21:22:42.029636 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:42.029606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc6sxxg_b104e19f-0a5a-4a0a-88b0-110a562346d0/istio-proxy/0.log" Jun 05 21:22:42.143225 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:42.143191 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/0.log" Jun 05 21:22:42.144550 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:42.144520 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/1.log" Jun 05 21:22:42.209507 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:42.209481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fd8545cc7-6dt76_43014c37-8528-499d-abf3-105d6a0d6f0f/router/0.log" Jun 05 21:22:43.347191 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:43.347154 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc6sxxg_b104e19f-0a5a-4a0a-88b0-110a562346d0/istio-proxy/0.log" Jun 05 21:22:43.453274 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:43.453193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/1.log" Jun 05 21:22:43.455631 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:43.455603 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/0.log" Jun 05 21:22:43.508388 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:43.508362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fd8545cc7-6dt76_43014c37-8528-499d-abf3-105d6a0d6f0f/router/0.log" Jun 05 21:22:45.308721 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:45.308687 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc6sxxg_b104e19f-0a5a-4a0a-88b0-110a562346d0/istio-proxy/0.log" Jun 05 21:22:45.398698 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:45.398614 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/1.log" Jun 05 21:22:45.398839 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:45.398802 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-xwzh4_3a18490d-f052-4d5a-8eaa-f4550286af8f/istio-proxy/0.log" Jun 05 21:22:45.459674 ip-10-0-128-37 kubenswrapper[2560]: I0605 21:22:45.459646 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fd8545cc7-6dt76_43014c37-8528-499d-abf3-105d6a0d6f0f/router/0.log"