Jun 10 11:16:06.886224 ip-10-0-130-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 11:16:06.886236 ip-10-0-130-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 11:16:06.886246 ip-10-0-130-135 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 11:16:06.886410 ip-10-0-130-135 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 11:16:17.083602 ip-10-0-130-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 11:16:17.083624 ip-10-0-130-135 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 13201f8056a14ea7b2355d844ec0a09f -- Jun 10 11:18:39.828432 ip-10-0-130-135 systemd[1]: Starting Kubernetes Kubelet... Jun 10 11:18:40.262621 ip-10-0-130-135 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:18:40.262621 ip-10-0-130-135 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 11:18:40.262621 ip-10-0-130-135 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:18:40.262621 ip-10-0-130-135 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 11:18:40.262621 ip-10-0-130-135 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:18:40.264222 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.264127 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 11:18:40.268258 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268241 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:18:40.268258 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268258 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268262 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268265 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268268 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268272 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268274 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268278 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268281 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268283 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268286 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268288 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268291 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268293 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268296 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268298 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268301 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268303 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268306 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268308 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:18:40.268319 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268311 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268313 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268316 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268318 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268321 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268324 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268327 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268330 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268334 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268337 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268340 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268343 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268345 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268349 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268351 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268354 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268356 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268360 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268364 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:18:40.268771 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268367 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268370 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268372 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268375 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268378 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268380 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268383 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268385 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268388 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268390 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268393 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268395 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268397 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268400 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268403 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268406 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268409 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268411 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268414 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268416 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:18:40.269244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268419 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268422 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268424 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268427 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268430 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268433 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268435 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268438 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268440 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268442 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268445 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268447 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268450 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268452 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268454 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268457 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268459 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268463 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268466 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268468 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:18:40.269726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268471 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268474 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268476 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268479 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268481 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268484 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268487 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268490 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268493 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268495 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268497 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268500 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268502 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268505 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268507 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268510 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268513 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268517 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268519 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:18:40.270256 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.268522 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269297 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269304 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269307 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269310 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269313 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269315 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269318 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269321 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269323 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269326 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269328 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269331 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269334 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269336 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269339 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269342 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269345 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269347 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269351 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:18:40.270735 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269354 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269356 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269359 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269362 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269364 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269367 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269370 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269373 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269376 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269378 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269381 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269383 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269386 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269389 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269392 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269394 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269397 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269400 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269402 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269405 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:18:40.271244 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269408 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269410 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269413 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269415 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269418 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269420 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269423 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269425 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269427 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269431 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269435 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269438 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269442 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269445 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269449 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269453 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269456 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269459 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269461 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269464 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:18:40.271807 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269467 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269470 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269472 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269475 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269478 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269481 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269485 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269487 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269490 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269492 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269495 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269497 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269500 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269502 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269504 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269507 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269509 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269512 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269514 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:18:40.272333 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269516 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269519 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269522 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269524 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269528 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269531 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269533 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269536 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269538 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269541 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269543 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269546 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269548 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269551 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269553 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269556 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269558 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269560 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269564 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:18:40.272788 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269568 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.269571 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270029 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270036 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270040 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270044 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270047 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270050 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270053 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270056 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270059 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270061 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270064 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270066 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270069 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270072 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270074 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270077 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270080 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270082 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:18:40.273318 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270085 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270088 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270090 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270093 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270095 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270098 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270100 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270103 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270105 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270107 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270110 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270112 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270115 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270117 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270120 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270122 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270125 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270128 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270130 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270132 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:18:40.273810 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270134 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270137 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270141 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270145 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270147 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270150 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270152 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270155 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270157 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270160 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270163 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270166 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270168 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270173 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270176 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270179 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270181 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270184 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270186 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:18:40.274321 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270189 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270191 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270194 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270196 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270198 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270201 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270204 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270206 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270209 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270211 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270213 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270216 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270218 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270221 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270223 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270226 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270228 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270231 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270233 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:18:40.274780 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270236 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270238 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270241 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270243 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270246 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270249 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270251 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270254 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270256 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270259 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270262 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270267 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270270 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270272 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270275 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270278 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270280 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270283 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270286 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270288 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:18:40.275253 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270291 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270293 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.270296 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270369 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270375 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270382 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270386 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270390 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270394 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270398 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270402 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270405 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270408 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270412 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270415 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270418 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270421 2576 flags.go:64] FLAG: --cgroup-root="" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270424 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270427 2576 flags.go:64] FLAG: --client-ca-file="" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270430 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270433 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270437 2576 flags.go:64] FLAG: --cluster-domain="" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270440 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 11:18:40.275728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270445 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270448 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270451 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270455 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270458 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270461 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270464 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270467 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270470 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270473 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270476 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270479 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270483 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270486 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270489 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270492 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270495 2576 flags.go:64] FLAG: --enable-server="true" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270497 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270501 2576 flags.go:64] FLAG: --event-burst="100" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270505 2576 flags.go:64] FLAG: --event-qps="50" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270507 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270510 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270513 2576 flags.go:64] FLAG: --eviction-hard="" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270517 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 11:18:40.276301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270520 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270523 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270526 2576 flags.go:64] FLAG: --eviction-soft="" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270529 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270531 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270535 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270538 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270540 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270546 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270548 2576 flags.go:64] FLAG: --feature-gates="" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270552 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270555 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270558 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270562 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270564 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270568 2576 flags.go:64] FLAG: --help="false" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270570 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270574 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270577 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270582 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270586 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270589 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270592 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 11:18:40.276878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270595 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270598 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270600 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270603 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270606 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270609 2576 flags.go:64] FLAG: --kube-reserved="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270611 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270614 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270620 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270623 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270625 2576 flags.go:64] FLAG: --lock-file="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270628 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270631 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270634 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270639 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270642 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270645 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270649 2576 flags.go:64] FLAG: --logging-format="text" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270651 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270655 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270658 2576 flags.go:64] FLAG: --manifest-url="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270660 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270664 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270667 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270671 2576 flags.go:64] FLAG: --max-pods="110" Jun 10 11:18:40.277520 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270674 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270677 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270680 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270683 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270686 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270689 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270692 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270699 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270702 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270705 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270708 2576 flags.go:64] FLAG: --pod-cidr="" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270711 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270721 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270724 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270727 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270730 2576 flags.go:64] FLAG: --port="10250" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270735 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270737 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a0595b9d60230efd" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270741 2576 flags.go:64] FLAG: --qos-reserved="" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270744 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270747 2576 flags.go:64] FLAG: --register-node="true" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270750 2576 flags.go:64] FLAG: --register-with-taints="" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270757 2576 flags.go:64] FLAG: --registry-burst="10" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270760 2576 flags.go:64] FLAG: --registry-qps="5" Jun 10 11:18:40.278147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270763 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270766 2576 flags.go:64] FLAG: --reserved-memory="" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270770 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270773 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270776 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270778 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270781 2576 flags.go:64] FLAG: --runonce="false" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270784 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270787 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270789 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270792 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270796 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270799 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270802 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270805 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270808 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270811 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270814 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270816 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270819 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270822 2576 flags.go:64] FLAG: --system-cgroups="" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270824 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270829 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270832 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270836 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 11:18:40.279033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270840 2576 flags.go:64] FLAG: --tls-min-version="" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270843 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270846 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270849 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270851 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270854 2576 flags.go:64] FLAG: --v="2" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270858 2576 flags.go:64] FLAG: --version="false" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270862 2576 flags.go:64] FLAG: --vmodule="" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270866 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.270869 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271005 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271010 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271013 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271016 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271019 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271022 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271025 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271028 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271031 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271034 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271037 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:18:40.279797 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271042 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271045 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271048 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271051 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271054 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271056 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271059 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271061 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271064 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271066 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271070 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271073 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271075 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271077 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271080 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271082 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271085 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271087 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271090 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271093 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:18:40.280357 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271096 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271098 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271101 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271103 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271105 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271108 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271110 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271113 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271115 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271117 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271120 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271123 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271125 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271128 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271131 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271133 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271135 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271138 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271140 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271142 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:18:40.280850 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271144 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271147 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271150 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271153 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271155 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271158 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271160 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271163 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271165 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271168 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271172 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271175 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271178 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271181 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271184 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271187 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271189 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271192 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271194 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:18:40.281361 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271197 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271199 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271202 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271204 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271207 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271209 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271211 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271215 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271219 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271222 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271224 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271226 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271229 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271231 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271234 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271238 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271240 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271243 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271245 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:18:40.281830 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271248 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271251 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271253 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271257 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271260 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271263 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271265 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271268 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271271 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.271273 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.271783 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.279746 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.279764 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.279791 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.279799 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 11:18:40.282301 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279885 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279892 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279897 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279901 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279906 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279910 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279914 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279920 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279928 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279932 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279936 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279941 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279944 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279946 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279950 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279952 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279955 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279958 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279961 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279963 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:18:40.282708 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279966 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279987 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279992 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279995 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.279997 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280000 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280002 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280005 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280008 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280011 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280013 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280016 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280018 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280021 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280024 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280026 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280028 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280031 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280034 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280037 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:18:40.283208 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280039 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280042 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280044 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280047 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280049 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280052 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280056 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280060 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280063 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280066 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280069 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280072 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280075 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280077 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280080 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280082 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280085 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280087 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280090 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:18:40.283685 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280092 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280095 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280097 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280100 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280102 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280105 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280108 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280110 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280112 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280115 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280118 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280121 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280124 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280127 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280130 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280133 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280135 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280138 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280141 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:18:40.284158 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280144 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280148 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280150 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280153 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280156 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280159 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280168 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280172 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280175 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280177 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280180 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280182 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280185 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280188 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280191 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280194 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280196 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280198 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280201 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:18:40.284617 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280203 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280206 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.280211 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280326 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280332 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280335 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280338 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280340 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280343 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280346 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280349 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280352 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280354 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280357 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280360 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:18:40.285088 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280364 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280367 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280370 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280373 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280375 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280378 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280381 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280384 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280386 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280389 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280391 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280394 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280396 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280399 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280401 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280404 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280406 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280409 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280411 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280414 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:18:40.285470 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280416 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280419 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280421 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280424 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280426 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280429 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280431 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280434 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280438 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280441 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280444 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280446 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280449 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280452 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280454 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280457 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280459 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280462 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280464 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:18:40.285959 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280467 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280470 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280474 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280477 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280479 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280482 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280485 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280488 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280490 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280493 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280496 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280499 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280501 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280504 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280507 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280509 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280511 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280514 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280516 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280519 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:18:40.286434 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280522 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280524 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280527 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280529 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280532 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280534 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280537 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280540 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280542 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280544 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280547 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280549 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280552 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280554 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280557 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280559 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280561 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280564 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280567 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:18:40.286912 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280569 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280572 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280576 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280579 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280582 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280584 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280587 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280589 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:40.280592 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.280597 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.280704 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.282676 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.283997 2576 server.go:1019] "Starting client certificate rotation" Jun 10 11:18:40.287382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.284104 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:18:40.287704 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.284135 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:18:40.287704 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.286598 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:18:40.291221 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.291198 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:18:40.304213 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.304188 2576 log.go:25] "Validated CRI v1 runtime API" Jun 10 11:18:40.307178 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.307162 2576 log.go:25] "Validated CRI v1 image API" Jun 10 11:18:40.308754 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.308723 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 11:18:40.313120 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.313102 2576 fs.go:135] Filesystem UUIDs: map[30abc191-ee90-4f58-be87-31b149d63515:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7c32f6ad-6ba6-4075-9699-3fa2bdb5e6d1:/dev/nvme0n1p3] Jun 10 11:18:40.313185 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.313121 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 11:18:40.318046 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.317917 2576 manager.go:216] Machine: {Timestamp:2026-06-10 11:18:40.317436196 +0000 UTC m=+0.363612195 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099043 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f22854b0da973c1c38a9cc5a7255 SystemUUID:ec21f228-54b0-da97-3c1c-38a9cc5a7255 BootID:13201f80-56a1-4ea7-b235-5d844ec0a09f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:43:b6:c4:b9:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:43:b6:c4:b9:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:19:2c:aa:cc:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 11:18:40.318046 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.318041 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 11:18:40.318158 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.318120 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 11:18:40.320225 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.320199 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 11:18:40.320361 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.320226 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 11:18:40.320917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.320907 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 11:18:40.320948 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.320919 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 11:18:40.320948 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.320928 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:18:40.321416 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.321405 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:18:40.322123 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.322114 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 11:18:40.323360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.323336 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:18:40.324719 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324706 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:18:40.324837 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324827 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 11:18:40.324871 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324861 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 10 11:18:40.324917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324877 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 11:18:40.324917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324897 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 11:18:40.324917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324911 2576 kubelet.go:398] "Adding apiserver pod source" Jun 10 11:18:40.325060 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.324926 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 11:18:40.325360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.325348 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:18:40.325409 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.325367 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:18:40.330307 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.328689 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 11:18:40.333508 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.333490 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 11:18:40.333587 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.333530 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 11:18:40.334465 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334450 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334471 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334481 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334488 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334500 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334508 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334520 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 11:18:40.334530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334528 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 11:18:40.334745 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334538 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 11:18:40.334745 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334546 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 11:18:40.334745 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334558 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 11:18:40.334745 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.334567 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 11:18:40.335417 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.335405 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 11:18:40.335481 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.335419 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 11:18:40.337397 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.337370 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 11:18:40.337488 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.337395 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 11:18:40.337544 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.337484 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 11:18:40.338715 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.338702 2576 server.go:1268] "Started kubelet" Jun 10 11:18:40.338844 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.338810 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 11:18:40.338937 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.338863 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 11:18:40.339339 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.339305 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 11:18:40.339644 ip-10-0-130-135 systemd[1]: Started Kubernetes Kubelet. Jun 10 11:18:40.340271 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.340254 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 11:18:40.341574 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.341557 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 10 11:18:40.344784 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.343911 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-135.ec2.internal.18b7b435b0ac607a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-135.ec2.internal,UID:ip-10-0-130-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-135.ec2.internal,},FirstTimestamp:2026-06-10 11:18:40.338673786 +0000 UTC m=+0.384849785,LastTimestamp:2026-06-10 11:18:40.338673786 +0000 UTC m=+0.384849785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-135.ec2.internal,}" Jun 10 11:18:40.345846 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.345827 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 11:18:40.345940 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.345847 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 11:18:40.345940 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.345926 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.346383 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.346357 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 11:18:40.346756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.346738 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 11:18:40.346756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.346757 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 11:18:40.347071 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.346912 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 10 11:18:40.347071 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.346920 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 10 11:18:40.349083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349062 2576 factory.go:55] Registering systemd factory Jun 10 11:18:40.349152 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349087 2576 factory.go:223] Registration of the systemd container factory successfully Jun 10 11:18:40.350184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349807 2576 factory.go:153] Registering CRI-O factory Jun 10 11:18:40.350184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349827 2576 factory.go:223] Registration of the crio container factory successfully Jun 10 11:18:40.350184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349882 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 11:18:40.350184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349904 2576 factory.go:103] Registering Raw factory Jun 10 11:18:40.350184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.349918 2576 manager.go:1196] Started watching for new ooms in manager Jun 10 11:18:40.350422 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.350308 2576 manager.go:349] Starting recovery of all containers Jun 10 11:18:40.352749 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.352714 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 11:18:40.353876 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.353847 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 11:18:40.353965 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.353902 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 11:18:40.362763 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.362504 2576 manager.go:354] Recovery completed Jun 10 11:18:40.367347 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.367334 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.369150 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369127 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.369245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369160 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.369245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369170 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.369707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369693 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 11:18:40.369707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369703 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.369832 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369706 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 11:18:40.369832 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.369749 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:18:40.370409 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.370395 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.370469 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.370420 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.370469 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.370429 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.370967 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.370955 2576 policy_none.go:49] "None policy: Start" Jun 10 11:18:40.371015 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.370989 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 11:18:40.371015 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.371002 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 11:18:40.371722 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.371659 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-135.ec2.internal.18b7b435b27d5cbf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-135.ec2.internal,UID:ip-10-0-130-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-135.ec2.internal,},FirstTimestamp:2026-06-10 11:18:40.369147071 +0000 UTC m=+0.415323072,LastTimestamp:2026-06-10 11:18:40.369147071 +0000 UTC m=+0.415323072,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-135.ec2.internal,}" Jun 10 11:18:40.372067 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.372055 2576 policy_none.go:47] "Start" Jun 10 11:18:40.375089 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.375059 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fgdm2" Jun 10 11:18:40.381584 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.381509 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-135.ec2.internal.18b7b435b27da26c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-135.ec2.internal,UID:ip-10-0-130-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-135.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-135.ec2.internal,},FirstTimestamp:2026-06-10 11:18:40.369164908 +0000 UTC m=+0.415340906,LastTimestamp:2026-06-10 11:18:40.369164908 +0000 UTC m=+0.415340906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-135.ec2.internal,}" Jun 10 11:18:40.383390 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.383375 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fgdm2" Jun 10 11:18:40.418696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.418677 2576 manager.go:337] "Starting Device Plugin manager" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.418746 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.418759 2576 server.go:87] "Starting device plugin registration server" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.419050 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.419062 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.419123 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.419211 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.419223 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.420006 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.420047 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.420933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.420127 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 11:18:40.421763 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.421744 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 11:18:40.421847 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.421781 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 11:18:40.421847 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.421802 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 11:18:40.422026 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.421870 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 11:18:40.425142 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.425125 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:18:40.520211 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.520111 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.521190 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.521176 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.521243 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.521206 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.521243 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.521217 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.521243 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.521240 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.522248 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.522230 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal"] Jun 10 11:18:40.522299 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.522290 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.523023 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.522998 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.523023 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.523026 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.523169 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.523040 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.524247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.524235 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.524360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.524345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.524398 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.524381 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.524886 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.524872 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.524957 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.524901 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.524957 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.524913 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.525298 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.525283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.525363 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.525315 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.525363 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.525327 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.526245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.526229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.526334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.526252 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:40.526959 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.526944 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:40.527055 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.526991 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:40.527055 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.527002 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:40.531425 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.531403 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.531524 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.531431 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-135.ec2.internal\": node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.547631 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.547602 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-135.ec2.internal\" not found" node="ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.548636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.548615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3dd20a17073065f8963896524021e1db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal\" (UID: \"3dd20a17073065f8963896524021e1db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.548749 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.548641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd20a17073065f8963896524021e1db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal\" (UID: \"3dd20a17073065f8963896524021e1db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.548749 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.548657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9708e7c993241cc3ff8212dee587a6f6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-135.ec2.internal\" (UID: \"9708e7c993241cc3ff8212dee587a6f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.551173 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.551158 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-135.ec2.internal\" not found" node="ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.552421 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.552406 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.649805 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.649770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3dd20a17073065f8963896524021e1db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal\" (UID: \"3dd20a17073065f8963896524021e1db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.649805 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.649803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd20a17073065f8963896524021e1db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal\" (UID: \"3dd20a17073065f8963896524021e1db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.650035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.649829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9708e7c993241cc3ff8212dee587a6f6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-135.ec2.internal\" (UID: \"9708e7c993241cc3ff8212dee587a6f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.650035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.649864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3dd20a17073065f8963896524021e1db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal\" (UID: \"3dd20a17073065f8963896524021e1db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.650035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.649888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9708e7c993241cc3ff8212dee587a6f6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-135.ec2.internal\" (UID: \"9708e7c993241cc3ff8212dee587a6f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.650035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.649891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd20a17073065f8963896524021e1db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal\" (UID: \"3dd20a17073065f8963896524021e1db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.652899 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.652881 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.753466 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.753431 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.851172 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.851091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.854938 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.854338 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:40.855452 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:40.855436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" Jun 10 11:18:40.955161 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:40.955123 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:41.055773 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:41.055727 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:41.156310 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:41.156234 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:41.256774 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:41.256742 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:41.283919 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.283884 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 11:18:41.284598 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.284124 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:18:41.324152 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:41.324113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9708e7c993241cc3ff8212dee587a6f6.slice/crio-9a307021fc574b5f7777cc75b65fac016f8359cc625706e95f4e35b29eb28e9e WatchSource:0}: Error finding container 9a307021fc574b5f7777cc75b65fac016f8359cc625706e95f4e35b29eb28e9e: Status 404 returned error can't find the container with id 9a307021fc574b5f7777cc75b65fac016f8359cc625706e95f4e35b29eb28e9e Jun 10 11:18:41.324612 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:41.324591 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd20a17073065f8963896524021e1db.slice/crio-7c2ace3cefd686209810c641e1d96c8de700b31369ea730b2bcaae8a94dcadb1 WatchSource:0}: Error finding container 7c2ace3cefd686209810c641e1d96c8de700b31369ea730b2bcaae8a94dcadb1: Status 404 returned error can't find the container with id 7c2ace3cefd686209810c641e1d96c8de700b31369ea730b2bcaae8a94dcadb1 Jun 10 11:18:41.328092 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.328062 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:18:41.338888 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.338859 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:18:41.357540 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:41.357509 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:41.385704 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.385665 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:13:40 +0000 UTC" deadline="2028-02-27 23:13:04.32112145 +0000 UTC" Jun 10 11:18:41.385704 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.385701 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15059h54m22.935423865s" Jun 10 11:18:41.425644 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.425547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" event={"ID":"9708e7c993241cc3ff8212dee587a6f6","Type":"ContainerStarted","Data":"9a307021fc574b5f7777cc75b65fac016f8359cc625706e95f4e35b29eb28e9e"} Jun 10 11:18:41.426559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.426538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" event={"ID":"3dd20a17073065f8963896524021e1db","Type":"ContainerStarted","Data":"7c2ace3cefd686209810c641e1d96c8de700b31369ea730b2bcaae8a94dcadb1"} Jun 10 11:18:41.427627 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.427615 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:18:41.432823 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.432807 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:18:41.432936 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.432841 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:18:41.432936 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.432856 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:18:41.457963 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:41.457921 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-135.ec2.internal\" not found" Jun 10 11:18:41.514216 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.514181 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:18:41.546951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.546914 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" Jun 10 11:18:41.564165 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.564141 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:18:41.565162 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.565150 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" Jun 10 11:18:41.577519 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.577496 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:18:41.646523 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:41.646487 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:18:42.325744 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.325706 2576 apiserver.go:52] "Watching apiserver" Jun 10 11:18:42.334382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.334352 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 11:18:42.334823 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.334789 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-mrkj8","openshift-ovn-kubernetes/ovnkube-node-w5q29","kube-system/global-pull-secret-syncer-9b28g","kube-system/konnectivity-agent-mcsvl","openshift-cluster-node-tuning-operator/tuned-g29h7","openshift-multus/multus-additional-cni-plugins-px2tp","openshift-multus/network-metrics-daemon-v2rwg","openshift-network-diagnostics/network-check-target-czk77","openshift-network-operator/iptables-alerter-htdfd","kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb","openshift-dns/node-resolver-mr8cv","openshift-image-registry/node-ca-kdm2f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal"] Jun 10 11:18:42.336258 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.336227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.336398 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.336325 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:42.337385 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.337363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.338693 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.338591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.338693 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.338653 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:42.339593 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.339572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.340495 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.340281 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.340495 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.340307 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.340495 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.340313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ktxcl\"" Jun 10 11:18:42.340495 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.340282 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 11:18:42.340754 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.340735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.341743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.341729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.342311 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.342293 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 11:18:42.342436 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.342340 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z2szx\"" Jun 10 11:18:42.343299 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.343054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.343408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.343309 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.343408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.343337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.343515 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.343424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 11:18:42.343515 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.343505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qjrqr\"" Jun 10 11:18:42.344617 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.344274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.344617 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.344579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hdhzr\"" Jun 10 11:18:42.344788 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.344722 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.344934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.344919 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 11:18:42.345017 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.344961 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 11:18:42.345017 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.344967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 11:18:42.346072 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.345730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.346072 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.345956 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 11:18:42.346595 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.346554 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.347328 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.347310 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.347440 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.347379 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 11:18:42.348255 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.347660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5gb5m\"" Jun 10 11:18:42.348255 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.347683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 11:18:42.348255 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.347901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.348255 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.347954 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rrzv\"" Jun 10 11:18:42.348255 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.348102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:42.348255 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.348154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:42.348782 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.348759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.348912 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.348893 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 11:18:42.349771 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.349751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.349990 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.349946 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 11:18:42.350187 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.350165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 11:18:42.350579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.349751 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 11:18:42.350955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.350932 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.352559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.352538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.353275 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.353255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7kmnt\"" Jun 10 11:18:42.353589 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.353567 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.353687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.353640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.353687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.353654 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 11:18:42.354068 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.354041 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6wdbw\"" Jun 10 11:18:42.354941 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.354924 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 11:18:42.355241 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.355223 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 11:18:42.355482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.355327 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b4xv5\"" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-ovn\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-cnibin\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-cni-multus\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-run-netns\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea57aa3e-0103-4bfc-b730-35ae58e9f849-agent-certs\") pod \"konnectivity-agent-mcsvl\" (UID: \"ea57aa3e-0103-4bfc-b730-35ae58e9f849\") " pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-cni-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-multus-certs\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-cni-netd\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae2295d-969a-4623-89ca-e20bbaaf0789-host\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgfh\" (UniqueName: \"kubernetes.io/projected/2ae2295d-969a-4623-89ca-e20bbaaf0789-kube-api-access-vbgfh\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-systemd\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-sys\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-os-release\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-modprobe-d\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-socket-dir-parent\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-conf-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-slash\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-system-cni-dir\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-cnibin\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx7l8\" (UniqueName: \"kubernetes.io/projected/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-kube-api-access-hx7l8\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea57aa3e-0103-4bfc-b730-35ae58e9f849-konnectivity-ca\") pod \"konnectivity-agent-mcsvl\" (UID: \"ea57aa3e-0103-4bfc-b730-35ae58e9f849\") " pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-k8s-cni-cncf-io\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.360913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-daemon-config\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-dbus\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-var-lib-kubelet\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-etc-kubernetes\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-env-overrides\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-run\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/689b129b-8c58-4aaf-92bd-153992d5acfe-tmp\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-os-release\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.360962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-hostroot\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-kubelet\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-systemd-units\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovn-node-metrics-cert\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovnkube-script-lib\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-lib-modules\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4jpl\" (UniqueName: \"kubernetes.io/projected/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-kube-api-access-b4jpl\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.361743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-cni-binary-copy\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk85r\" (UniqueName: \"kubernetes.io/projected/196dc70c-835f-48b6-9f0f-8ec724920919-kube-api-access-sk85r\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-node-log\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-log-socket\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysconfig\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-host-slash\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfd40d15-a665-4159-aac4-e930725fd0f5-cni-binary-copy\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-netns\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-cni-bin\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mn55\" (UniqueName: \"kubernetes.io/projected/bfd40d15-a665-4159-aac4-e930725fd0f5-kube-api-access-5mn55\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysctl-d\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysctl-conf\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-kubelet\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.362606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgt4\" (UniqueName: \"kubernetes.io/projected/db437c4d-6016-498d-8754-67d3ec06d718-kube-api-access-4fgt4\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-var-lib-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovnkube-config\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbh8\" (UniqueName: \"kubernetes.io/projected/689b129b-8c58-4aaf-92bd-153992d5acfe-kube-api-access-rjbh8\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-cni-bin\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae2295d-969a-4623-89ca-e20bbaaf0789-serviceca\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-kubelet-config\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-systemd\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-etc-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-kubernetes\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-host\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-tuned\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.363579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-iptables-alerter-script\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.364743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.361958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-system-cni-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.364743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.362548 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:18:42.377329 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.377289 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qln6p" Jun 10 11:18:42.384914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.384830 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qln6p" Jun 10 11:18:42.447108 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.446890 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 11:18:42.462849 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-netns\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.462849 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bfqb\" (UniqueName: \"kubernetes.io/projected/a70c174f-b6d9-47b6-8c6f-7197717abb41-kube-api-access-6bfqb\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-cni-bin\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mn55\" (UniqueName: \"kubernetes.io/projected/bfd40d15-a665-4159-aac4-e930725fd0f5-kube-api-access-5mn55\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysctl-d\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-cni-bin\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.462999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-netns\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.463042 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:42.463069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysctl-conf\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysctl-d\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.463131 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:18:42.963093042 +0000 UTC m=+3.009269049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-kubelet\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgt4\" (UniqueName: \"kubernetes.io/projected/db437c4d-6016-498d-8754-67d3ec06d718-kube-api-access-4fgt4\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysctl-conf\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-kubelet\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.463319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-var-lib-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovnkube-config\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbh8\" (UniqueName: \"kubernetes.io/projected/689b129b-8c58-4aaf-92bd-153992d5acfe-kube-api-access-rjbh8\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-cni-bin\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae2295d-969a-4623-89ca-e20bbaaf0789-serviceca\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-var-lib-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-kubelet-config\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-systemd\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.463533 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-etc-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-socket-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.463573 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.463580 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:18:42.963565561 +0000 UTC m=+3.009741547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-registration-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-cni-bin\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-sys-fs\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-kubernetes\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-host\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-tuned\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-kubelet-config\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-iptables-alerter-script\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-system-cni-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-ovn\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-cnibin\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-cni-multus\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-run-netns\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea57aa3e-0103-4bfc-b730-35ae58e9f849-agent-certs\") pod \"konnectivity-agent-mcsvl\" (UID: \"ea57aa3e-0103-4bfc-b730-35ae58e9f849\") " pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.464048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.463951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-cni-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-multus-certs\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-cni-netd\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae2295d-969a-4623-89ca-e20bbaaf0789-serviceca\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovnkube-config\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-system-cni-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-run-netns\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-cni-netd\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae2295d-969a-4623-89ca-e20bbaaf0789-host\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-cni-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgfh\" (UniqueName: \"kubernetes.io/projected/2ae2295d-969a-4623-89ca-e20bbaaf0789-kube-api-access-vbgfh\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-ovn\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-device-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-multus-certs\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-systemd\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-cnibin\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464400 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-host\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.464548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-systemd\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae2295d-969a-4623-89ca-e20bbaaf0789-host\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-var-lib-cni-multus\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-sys\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-systemd\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-os-release\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-kubernetes\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-modprobe-d\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-socket-dir-parent\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-sys\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-conf-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-iptables-alerter-script\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-os-release\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-etc-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-slash\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-system-cni-dir\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464703 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-cnibin\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.465119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx7l8\" (UniqueName: \"kubernetes.io/projected/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-kube-api-access-hx7l8\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-modprobe-d\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-conf-dir\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-cnibin\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-socket-dir-parent\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-system-cni-dir\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-slash\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.464995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea57aa3e-0103-4bfc-b730-35ae58e9f849-konnectivity-ca\") pod \"konnectivity-agent-mcsvl\" (UID: \"ea57aa3e-0103-4bfc-b730-35ae58e9f849\") " pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-k8s-cni-cncf-io\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-daemon-config\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-dbus\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-var-lib-kubelet\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-etc-kubernetes\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-env-overrides\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-etc-selinux\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-tmp-dir\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.466176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4h28\" (UniqueName: \"kubernetes.io/projected/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-kube-api-access-t4h28\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-run\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/689b129b-8c58-4aaf-92bd-153992d5acfe-tmp\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-os-release\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.465965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-hostroot\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-kubelet\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-systemd-units\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovn-node-metrics-cert\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovnkube-script-lib\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-lib-modules\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfd40d15-a665-4159-aac4-e930725fd0f5-multus-daemon-config\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4jpl\" (UniqueName: \"kubernetes.io/projected/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-kube-api-access-b4jpl\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-host-kubelet\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-hosts-file\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-run-openvswitch\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-cni-binary-copy\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.466955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk85r\" (UniqueName: \"kubernetes.io/projected/196dc70c-835f-48b6-9f0f-8ec724920919-kube-api-access-sk85r\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-var-lib-kubelet\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-node-log\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-host-run-k8s-cni-cncf-io\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-log-socket\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysconfig\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-host-slash\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfd40d15-a665-4159-aac4-e930725fd0f5-cni-binary-copy\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea57aa3e-0103-4bfc-b730-35ae58e9f849-konnectivity-ca\") pod \"konnectivity-agent-mcsvl\" (UID: \"ea57aa3e-0103-4bfc-b730-35ae58e9f849\") " pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.466966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-dbus\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfd40d15-a665-4159-aac4-e930725fd0f5-cni-binary-copy\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-node-log\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-run\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-lib-modules\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-log-socket\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-sysconfig\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-etc-kubernetes\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.467688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfd40d15-a665-4159-aac4-e930725fd0f5-hostroot\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-os-release\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-host-slash\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-systemd-units\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/196dc70c-835f-48b6-9f0f-8ec724920919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467391 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-env-overrides\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/196dc70c-835f-48b6-9f0f-8ec724920919-cni-binary-copy\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovnkube-script-lib\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.467903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/689b129b-8c58-4aaf-92bd-153992d5acfe-etc-tuned\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.468692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.468129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea57aa3e-0103-4bfc-b730-35ae58e9f849-agent-certs\") pod \"konnectivity-agent-mcsvl\" (UID: \"ea57aa3e-0103-4bfc-b730-35ae58e9f849\") " pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.469939 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.469920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-ovn-node-metrics-cert\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.470199 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.470182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/689b129b-8c58-4aaf-92bd-153992d5acfe-tmp\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.476083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.476038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgt4\" (UniqueName: \"kubernetes.io/projected/db437c4d-6016-498d-8754-67d3ec06d718-kube-api-access-4fgt4\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.476953 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.476931 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:18:42.476953 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.476955 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:18:42.477266 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.476968 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:42.477266 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.477056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:18:42.977039972 +0000 UTC m=+3.023215977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:42.479113 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.479071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx7l8\" (UniqueName: \"kubernetes.io/projected/f7b66c2a-7012-43ee-9c66-6fc06dc5fa18-kube-api-access-hx7l8\") pod \"iptables-alerter-htdfd\" (UID: \"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18\") " pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.479405 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.479362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgfh\" (UniqueName: \"kubernetes.io/projected/2ae2295d-969a-4623-89ca-e20bbaaf0789-kube-api-access-vbgfh\") pod \"node-ca-kdm2f\" (UID: \"2ae2295d-969a-4623-89ca-e20bbaaf0789\") " pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.479611 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.479590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk85r\" (UniqueName: \"kubernetes.io/projected/196dc70c-835f-48b6-9f0f-8ec724920919-kube-api-access-sk85r\") pod \"multus-additional-cni-plugins-px2tp\" (UID: \"196dc70c-835f-48b6-9f0f-8ec724920919\") " pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.482295 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.482243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbh8\" (UniqueName: \"kubernetes.io/projected/689b129b-8c58-4aaf-92bd-153992d5acfe-kube-api-access-rjbh8\") pod \"tuned-g29h7\" (UID: \"689b129b-8c58-4aaf-92bd-153992d5acfe\") " pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.482552 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.482531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mn55\" (UniqueName: \"kubernetes.io/projected/bfd40d15-a665-4159-aac4-e930725fd0f5-kube-api-access-5mn55\") pod \"multus-mrkj8\" (UID: \"bfd40d15-a665-4159-aac4-e930725fd0f5\") " pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.483681 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.483658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4jpl\" (UniqueName: \"kubernetes.io/projected/76648a4f-b786-4daf-8cc2-0ffd57ff80ee-kube-api-access-b4jpl\") pod \"ovnkube-node-w5q29\" (UID: \"76648a4f-b786-4daf-8cc2-0ffd57ff80ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.567435 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bfqb\" (UniqueName: \"kubernetes.io/projected/a70c174f-b6d9-47b6-8c6f-7197717abb41-kube-api-access-6bfqb\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-socket-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-registration-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-sys-fs\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-device-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-etc-selinux\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-etc-selinux\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-socket-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-registration-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-tmp-dir\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-device-dir\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4h28\" (UniqueName: \"kubernetes.io/projected/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-kube-api-access-t4h28\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-hosts-file\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a70c174f-b6d9-47b6-8c6f-7197717abb41-sys-fs\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.567911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-hosts-file\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.568265 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.567967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-tmp-dir\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.577346 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.577253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4h28\" (UniqueName: \"kubernetes.io/projected/9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0-kube-api-access-t4h28\") pod \"node-resolver-mr8cv\" (UID: \"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0\") " pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.577488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.577383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bfqb\" (UniqueName: \"kubernetes.io/projected/a70c174f-b6d9-47b6-8c6f-7197717abb41-kube-api-access-6bfqb\") pod \"aws-ebs-csi-driver-node-k4mbb\" (UID: \"a70c174f-b6d9-47b6-8c6f-7197717abb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.586523 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.586496 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:18:42.651524 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.651479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kdm2f" Jun 10 11:18:42.659342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.659315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:18:42.667934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.667912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g29h7" Jun 10 11:18:42.676624 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.676597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-px2tp" Jun 10 11:18:42.686984 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.686938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htdfd" Jun 10 11:18:42.694645 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.694620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrkj8" Jun 10 11:18:42.703245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.703226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:18:42.710818 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.710798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" Jun 10 11:18:42.717329 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.717303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mr8cv" Jun 10 11:18:42.971479 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.971391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:42.971479 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:42.971431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:42.971716 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.971553 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:42.971716 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.971611 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:18:43.971598555 +0000 UTC m=+4.017774540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:42.971716 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.971553 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:42.971716 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:42.971716 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:18:43.971691874 +0000 UTC m=+4.017867877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:43.071910 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.071877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:43.072098 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.072058 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:18:43.072098 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.072082 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:18:43.072098 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.072091 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:43.072204 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.072143 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:18:44.072130923 +0000 UTC m=+4.118306909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:43.109101 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.109075 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76648a4f_b786_4daf_8cc2_0ffd57ff80ee.slice/crio-f4d489a980c7f057b2974c4dce944889e0664f128adec137f903a2ed536a069b WatchSource:0}: Error finding container f4d489a980c7f057b2974c4dce944889e0664f128adec137f903a2ed536a069b: Status 404 returned error can't find the container with id f4d489a980c7f057b2974c4dce944889e0664f128adec137f903a2ed536a069b Jun 10 11:18:43.110896 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.110868 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689b129b_8c58_4aaf_92bd_153992d5acfe.slice/crio-f728ec0d0d09bae72e72f9aefea3a7d055e7b9518fba0789b7f7f6be29b1da10 WatchSource:0}: Error finding container f728ec0d0d09bae72e72f9aefea3a7d055e7b9518fba0789b7f7f6be29b1da10: Status 404 returned error can't find the container with id f728ec0d0d09bae72e72f9aefea3a7d055e7b9518fba0789b7f7f6be29b1da10 Jun 10 11:18:43.111466 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.111442 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70c174f_b6d9_47b6_8c6f_7197717abb41.slice/crio-b40b854f5cb68074ef8d4e2f6a7f2ba12746b9dca9151912440f231d3b2f4ce9 WatchSource:0}: Error finding container b40b854f5cb68074ef8d4e2f6a7f2ba12746b9dca9151912440f231d3b2f4ce9: Status 404 returned error can't find the container with id b40b854f5cb68074ef8d4e2f6a7f2ba12746b9dca9151912440f231d3b2f4ce9 Jun 10 11:18:43.114025 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.113988 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea57aa3e_0103_4bfc_b730_35ae58e9f849.slice/crio-fb0882ca2889bf00f6405d55bf0d36cb7ace549b2a025d5a7f6f26cae91343c4 WatchSource:0}: Error finding container fb0882ca2889bf00f6405d55bf0d36cb7ace549b2a025d5a7f6f26cae91343c4: Status 404 returned error can't find the container with id fb0882ca2889bf00f6405d55bf0d36cb7ace549b2a025d5a7f6f26cae91343c4 Jun 10 11:18:43.137238 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.137211 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b66c2a_7012_43ee_9c66_6fc06dc5fa18.slice/crio-33053a3c6a76f46d00679b8c7fa5f80a7371df8b3706282098a0e5e1e4dd86c0 WatchSource:0}: Error finding container 33053a3c6a76f46d00679b8c7fa5f80a7371df8b3706282098a0e5e1e4dd86c0: Status 404 returned error can't find the container with id 33053a3c6a76f46d00679b8c7fa5f80a7371df8b3706282098a0e5e1e4dd86c0 Jun 10 11:18:43.138952 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.138681 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196dc70c_835f_48b6_9f0f_8ec724920919.slice/crio-fdcfe24ef20bd399366d1faf7bc14e08fc75236eafeacc39f542d1f57d978798 WatchSource:0}: Error finding container fdcfe24ef20bd399366d1faf7bc14e08fc75236eafeacc39f542d1f57d978798: Status 404 returned error can't find the container with id fdcfe24ef20bd399366d1faf7bc14e08fc75236eafeacc39f542d1f57d978798 Jun 10 11:18:43.139583 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.139563 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae2295d_969a_4623_89ca_e20bbaaf0789.slice/crio-83072c5e7b449636e5646028230f8c073c4f254e217f6e0629bc32d799cef64b WatchSource:0}: Error finding container 83072c5e7b449636e5646028230f8c073c4f254e217f6e0629bc32d799cef64b: Status 404 returned error can't find the container with id 83072c5e7b449636e5646028230f8c073c4f254e217f6e0629bc32d799cef64b Jun 10 11:18:43.141215 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:18:43.141193 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd40d15_a665_4159_aac4_e930725fd0f5.slice/crio-fcc7aa7d03a504427fcb0e068a87d4de312b65f1930643784133c3d6e8a356f8 WatchSource:0}: Error finding container fcc7aa7d03a504427fcb0e068a87d4de312b65f1930643784133c3d6e8a356f8: Status 404 returned error can't find the container with id fcc7aa7d03a504427fcb0e068a87d4de312b65f1930643784133c3d6e8a356f8 Jun 10 11:18:43.387291 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.387237 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:13:42 +0000 UTC" deadline="2028-02-03 22:18:47.683324846 +0000 UTC" Jun 10 11:18:43.387291 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.387284 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14483h0m4.296042954s" Jun 10 11:18:43.432001 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.431955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kdm2f" event={"ID":"2ae2295d-969a-4623-89ca-e20bbaaf0789","Type":"ContainerStarted","Data":"83072c5e7b449636e5646028230f8c073c4f254e217f6e0629bc32d799cef64b"} Jun 10 11:18:43.433104 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.433078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mcsvl" event={"ID":"ea57aa3e-0103-4bfc-b730-35ae58e9f849","Type":"ContainerStarted","Data":"fb0882ca2889bf00f6405d55bf0d36cb7ace549b2a025d5a7f6f26cae91343c4"} Jun 10 11:18:43.434126 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.434093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" event={"ID":"a70c174f-b6d9-47b6-8c6f-7197717abb41","Type":"ContainerStarted","Data":"b40b854f5cb68074ef8d4e2f6a7f2ba12746b9dca9151912440f231d3b2f4ce9"} Jun 10 11:18:43.435849 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.435826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" event={"ID":"9708e7c993241cc3ff8212dee587a6f6","Type":"ContainerStarted","Data":"86fdc68412b4b47db67ddd33fbf6e67b977e8cc0851462387a41fd000459215a"} Jun 10 11:18:43.436891 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.436864 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mr8cv" event={"ID":"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0","Type":"ContainerStarted","Data":"d15fb5bb690355c571dcc9d40bf6c3838a31b52a6c337fb1c4aa2df874ffd750"} Jun 10 11:18:43.437895 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.437873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrkj8" event={"ID":"bfd40d15-a665-4159-aac4-e930725fd0f5","Type":"ContainerStarted","Data":"fcc7aa7d03a504427fcb0e068a87d4de312b65f1930643784133c3d6e8a356f8"} Jun 10 11:18:43.438845 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.438825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htdfd" event={"ID":"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18","Type":"ContainerStarted","Data":"33053a3c6a76f46d00679b8c7fa5f80a7371df8b3706282098a0e5e1e4dd86c0"} Jun 10 11:18:43.439853 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.439830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g29h7" event={"ID":"689b129b-8c58-4aaf-92bd-153992d5acfe","Type":"ContainerStarted","Data":"f728ec0d0d09bae72e72f9aefea3a7d055e7b9518fba0789b7f7f6be29b1da10"} Jun 10 11:18:43.441143 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.441120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"f4d489a980c7f057b2974c4dce944889e0664f128adec137f903a2ed536a069b"} Jun 10 11:18:43.442989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.442809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" event={"ID":"3dd20a17073065f8963896524021e1db","Type":"ContainerStarted","Data":"5a46a02b0277c5865f3da039c84d18bcee6a94b2d659f36c4afa78606465a701"} Jun 10 11:18:43.444211 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.444190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerStarted","Data":"fdcfe24ef20bd399366d1faf7bc14e08fc75236eafeacc39f542d1f57d978798"} Jun 10 11:18:43.484913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.484208 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-135.ec2.internal" podStartSLOduration=2.484186605 podStartE2EDuration="2.484186605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:18:43.461485317 +0000 UTC m=+3.507661326" watchObservedRunningTime="2026-06-10 11:18:43.484186605 +0000 UTC m=+3.530362616" Jun 10 11:18:43.979451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.979345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:43.979451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:43.979419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:43.979660 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.979568 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:43.979660 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.979629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:18:45.979611348 +0000 UTC m=+6.025787335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:43.980062 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.980042 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:43.980146 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:43.980103 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:18:45.980085665 +0000 UTC m=+6.026261691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:44.079961 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.079921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:44.080200 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.080160 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:18:44.080200 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.080183 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:18:44.080200 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.080196 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:44.080373 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.080256 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:18:46.080238469 +0000 UTC m=+6.126414458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:44.388480 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.388343 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:13:42 +0000 UTC" deadline="2027-11-23 23:40:56.266358406 +0000 UTC" Jun 10 11:18:44.388480 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.388382 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12756h22m11.87798067s" Jun 10 11:18:44.424897 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.424857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:44.425156 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.425026 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:44.425470 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.425449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:44.425588 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.425550 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:44.425644 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.425609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:44.425712 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:44.425694 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:44.455221 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.455182 2576 generic.go:356] "Generic (PLEG): container finished" podID="3dd20a17073065f8963896524021e1db" containerID="5a46a02b0277c5865f3da039c84d18bcee6a94b2d659f36c4afa78606465a701" exitCode=0 Jun 10 11:18:44.456055 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:44.455722 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" event={"ID":"3dd20a17073065f8963896524021e1db","Type":"ContainerDied","Data":"5a46a02b0277c5865f3da039c84d18bcee6a94b2d659f36c4afa78606465a701"} Jun 10 11:18:45.470414 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:45.470326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" event={"ID":"3dd20a17073065f8963896524021e1db","Type":"ContainerStarted","Data":"883c68d54640af0501dbd18da0957c5c18b273a06892924fcc96f6f5379c916b"} Jun 10 11:18:45.995459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:45.995416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:45.995651 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:45.995481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:45.995651 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:45.995626 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:45.995787 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:45.995690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:18:49.995671095 +0000 UTC m=+10.041847086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:45.996221 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:45.996195 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:45.996340 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:45.996253 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:18:49.996235199 +0000 UTC m=+10.042411188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:46.096251 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:46.096209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:46.096437 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.096423 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:18:46.096537 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.096442 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:18:46.096537 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.096455 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:46.096537 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.096514 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:18:50.096495891 +0000 UTC m=+10.142671883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:46.423186 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:46.423098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:46.423346 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.423249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:46.423654 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:46.423632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:46.423761 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.423741 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:46.424580 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:46.424560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:46.424656 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:46.424638 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:48.422667 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:48.422629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:48.423131 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:48.422789 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:48.423184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:48.423163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:48.423411 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:48.423258 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:48.423411 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:48.423311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:48.423411 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:48.423377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:50.029274 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:50.029239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:50.029690 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:50.029294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:50.029690 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.029378 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:50.029690 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.029397 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:50.029690 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.029437 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:18:58.029422429 +0000 UTC m=+18.075598415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:50.029690 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.029452 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:18:58.029446048 +0000 UTC m=+18.075622034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:50.130257 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:50.130217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:50.130499 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.130394 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:18:50.130499 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.130416 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:18:50.130499 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.130428 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:50.130499 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.130485 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:18:58.130467075 +0000 UTC m=+18.176643076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:50.426408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:50.426330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:50.426408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:50.426369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:50.426570 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.426528 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:50.427093 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.427057 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:50.427222 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:50.427125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:50.427285 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:50.427225 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:52.423105 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:52.423064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:52.423105 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:52.423085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:52.423632 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:52.423210 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:52.423632 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:52.423234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:52.423632 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:52.423333 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:52.423632 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:52.423430 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:54.426937 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:54.426885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:54.426937 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:54.426914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:54.427419 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:54.427095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:54.427419 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:54.427187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:54.427419 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:54.427319 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:54.427561 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:54.427437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:56.423381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:56.422887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:56.423381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:56.422889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:56.423381 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:56.423048 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:56.423381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:56.422887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:56.423381 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:56.423144 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:18:56.423381 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:56.423174 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:58.086661 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:58.086621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:58.086661 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:58.086664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:58.087141 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.086756 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:58.087141 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.086761 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:58.087141 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.086800 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:19:14.086788107 +0000 UTC m=+34.132964095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:18:58.087141 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.086874 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:14.086854577 +0000 UTC m=+34.133030564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:18:58.187720 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:58.187681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:58.187893 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.187869 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:18:58.187964 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.187904 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:18:58.187964 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.187916 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:58.188098 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.187996 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:14.187960937 +0000 UTC m=+34.234136924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:18:58.422935 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:58.422838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:18:58.422935 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:58.422878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:18:58.423150 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:18:58.422841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:18:58.423150 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.423001 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:18:58.423150 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.423061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:18:58.423150 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:18:58.423115 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:00.423431 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:00.423196 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:00.423878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:00.423271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:00.423878 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:00.423542 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:00.423878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:00.423305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:00.423878 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:00.423641 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:00.423878 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:00.423704 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:02.422539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.422514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:02.423155 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.422542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:02.423155 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:02.422618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:02.423155 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.422514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:02.423155 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:02.422696 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:02.423155 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:02.422758 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:02.507295 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.507120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g29h7" event={"ID":"689b129b-8c58-4aaf-92bd-153992d5acfe","Type":"ContainerStarted","Data":"4b7dfd80824a348027ccb9cb4817e20df63b0d2203df099f994148af1befa559"} Jun 10 11:19:02.509466 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.509442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"0a0f5770311a554ed188130cbdddde01976c706435d07364879a9d765cb9c552"} Jun 10 11:19:02.509565 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.509512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"ec2060811d024c948d1ad3317c5a91463492c0df1d14738d92e98b4c78e8921d"} Jun 10 11:19:02.511775 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.511667 2576 generic.go:356] "Generic (PLEG): container finished" podID="196dc70c-835f-48b6-9f0f-8ec724920919" containerID="b9eab6e39125d2755fb2bb2a74dd0869c3569b5e7adad72ebec3d55c6c77c331" exitCode=0 Jun 10 11:19:02.511775 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.511738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerDied","Data":"b9eab6e39125d2755fb2bb2a74dd0869c3569b5e7adad72ebec3d55c6c77c331"} Jun 10 11:19:02.514663 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.514571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kdm2f" event={"ID":"2ae2295d-969a-4623-89ca-e20bbaaf0789","Type":"ContainerStarted","Data":"8ddf9caa96b965632652c9597006811056a3e03e8d8d7bb5af4297e64158971a"} Jun 10 11:19:02.516368 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.515934 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mcsvl" event={"ID":"ea57aa3e-0103-4bfc-b730-35ae58e9f849","Type":"ContainerStarted","Data":"719d877a2a0e18e570f4d7a81e33efb8c2d287087f16c61f989e84775ce13832"} Jun 10 11:19:02.520296 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.520263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" event={"ID":"a70c174f-b6d9-47b6-8c6f-7197717abb41","Type":"ContainerStarted","Data":"984d49bf53dd27827711b5a66cfa8a4bce06ae7aa617b8639ae556d43577b5cd"} Jun 10 11:19:02.521909 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.521485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mr8cv" event={"ID":"9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0","Type":"ContainerStarted","Data":"e7cd61a9c46422fae326eefb451113b4b2be04ff8f242c5c0c42934d8bc3b334"} Jun 10 11:19:02.523079 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.522642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrkj8" event={"ID":"bfd40d15-a665-4159-aac4-e930725fd0f5","Type":"ContainerStarted","Data":"cb183121f3f7ef8141c1737178c37c138466dd6ad876dd74b04025c7a7c3aa5c"} Jun 10 11:19:02.535187 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.535144 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-135.ec2.internal" podStartSLOduration=21.535130751 podStartE2EDuration="21.535130751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:18:45.490894504 +0000 UTC m=+5.537070513" watchObservedRunningTime="2026-06-10 11:19:02.535130751 +0000 UTC m=+22.581306757" Jun 10 11:19:02.552874 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.552800 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mcsvl" podStartSLOduration=11.834851346 podStartE2EDuration="22.552783217s" totalImagesPullingTime="10.717931871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:02.552379014 +0000 UTC m=+22.598555023" watchObservedRunningTime="2026-06-10 11:19:02.552783217 +0000 UTC m=+22.598959230" Jun 10 11:19:02.553013 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.552899 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g29h7" podStartSLOduration=3.476420341 podStartE2EDuration="22.552892016s" totalImagesPullingTime="19.076471675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:02.535722156 +0000 UTC m=+22.581898163" watchObservedRunningTime="2026-06-10 11:19:02.552892016 +0000 UTC m=+22.599068027" Jun 10 11:19:02.599475 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.599432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mr8cv" podStartSLOduration=3.553929896 podStartE2EDuration="22.599417022s" totalImagesPullingTime="19.045487126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:02.598728387 +0000 UTC m=+22.644904396" watchObservedRunningTime="2026-06-10 11:19:02.599417022 +0000 UTC m=+22.645593030" Jun 10 11:19:02.613515 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.613475 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kdm2f" podStartSLOduration=3.5663173329999998 podStartE2EDuration="22.613459012s" totalImagesPullingTime="19.047141679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:02.613149752 +0000 UTC m=+22.659325761" watchObservedRunningTime="2026-06-10 11:19:02.613459012 +0000 UTC m=+22.659635019" Jun 10 11:19:02.632053 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:02.631999 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mrkj8" podStartSLOduration=3.533025621 podStartE2EDuration="22.631965722s" totalImagesPullingTime="19.098940101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:02.631604691 +0000 UTC m=+22.677780698" watchObservedRunningTime="2026-06-10 11:19:02.631965722 +0000 UTC m=+22.678141729" Jun 10 11:19:03.359235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.359071 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 11:19:03.433221 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.433077 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T11:19:03.359231423Z","UUID":"fffa4f5c-50db-436a-8d78-78fb0cb62c54","Handler":null,"Name":"","Endpoint":""} Jun 10 11:19:03.435048 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.435024 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 11:19:03.435194 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.435074 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 11:19:03.526933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.526847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" event={"ID":"a70c174f-b6d9-47b6-8c6f-7197717abb41","Type":"ContainerStarted","Data":"6be04cf5a9a737989224efe2fee50f92992b02312373ad9f04177bbb6d5b3e3f"} Jun 10 11:19:03.530352 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.530314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"6a5b5288cba7cbeeec8f11eb09c281846c6df0e5c2bc184342319b8681c2bde1"} Jun 10 11:19:03.530494 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.530397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"df021ed193306c87822b61a8b54be5eac690323bd71f4f14177c9dbfda7d5bee"} Jun 10 11:19:03.530494 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.530452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"3a8875127e0fbc2a18fbacd9537436dd0ecefd0f402a129f48251beb0a85a8db"} Jun 10 11:19:03.530575 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:03.530503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"314c5b427a00deb9154c6596d91cddd18bcf554ac39208c6fdece3fafefb6893"} Jun 10 11:19:04.423655 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:04.423617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:04.423865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:04.423625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:04.423865 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:04.423767 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:04.423865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:04.423787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:04.424046 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:04.423873 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:04.424046 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:04.423936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:04.534651 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:04.534617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htdfd" event={"ID":"f7b66c2a-7012-43ee-9c66-6fc06dc5fa18","Type":"ContainerStarted","Data":"b9e144c7786bed459d8fc70567ec25d87fe605e8afacb352cad39d9107809d55"} Jun 10 11:19:04.553967 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:04.553896 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-htdfd" podStartSLOduration=5.506323781 podStartE2EDuration="24.553874136s" totalImagesPullingTime="19.047550355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:04.553199322 +0000 UTC m=+24.599375356" watchObservedRunningTime="2026-06-10 11:19:04.553874136 +0000 UTC m=+24.600050146" Jun 10 11:19:05.539934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:05.539891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" event={"ID":"a70c174f-b6d9-47b6-8c6f-7197717abb41","Type":"ContainerStarted","Data":"a34ee2d913f0b1ed8472b9201dbca27c6044233fc9d57a7170531ca13e36b16d"} Jun 10 11:19:05.543636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:05.543605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"6f5bef0d4af868ff1f719f3cbcd6ebf971249d74eed2b7cdd26aef9c24071313"} Jun 10 11:19:05.565400 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:05.565346 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4mbb" podStartSLOduration=4.467539949 podStartE2EDuration="25.56532987s" totalImagesPullingTime="21.097789921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:05.565277282 +0000 UTC m=+25.611453291" watchObservedRunningTime="2026-06-10 11:19:05.56532987 +0000 UTC m=+25.611505878" Jun 10 11:19:06.353862 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.353827 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:19:06.354456 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.354432 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:19:06.422422 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.422389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:06.422585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.422389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:06.422585 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:06.422525 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:06.422585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.422390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:06.422746 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:06.422627 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:06.422746 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:06.422716 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:06.545791 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.545745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:19:06.546557 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:06.546252 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mcsvl" Jun 10 11:19:07.552037 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:07.551658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" event={"ID":"76648a4f-b786-4daf-8cc2-0ffd57ff80ee","Type":"ContainerStarted","Data":"9f9ce89576fda5cf70856237bdc3e74467ecd58175d2973051a5339e5cde6719"} Jun 10 11:19:07.552037 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:07.551991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:19:07.553927 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:07.553900 2576 generic.go:356] "Generic (PLEG): container finished" podID="196dc70c-835f-48b6-9f0f-8ec724920919" containerID="bea316169218aa97f441ec10d7bf4e01c30667dddc68db5d321b921e6dda4c5b" exitCode=0 Jun 10 11:19:07.554083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:07.553995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerDied","Data":"bea316169218aa97f441ec10d7bf4e01c30667dddc68db5d321b921e6dda4c5b"} Jun 10 11:19:07.569622 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:07.569597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:19:07.588099 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:07.588045 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" podStartSLOduration=8.471028214 podStartE2EDuration="27.588029767s" totalImagesPullingTime="19.117001553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:07.587498431 +0000 UTC m=+27.633674440" watchObservedRunningTime="2026-06-10 11:19:07.588029767 +0000 UTC m=+27.634205775" Jun 10 11:19:08.424687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:08.424649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:08.424855 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:08.424785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:08.425203 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:08.425181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:08.425294 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:08.425273 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:08.425350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:08.425327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:08.425398 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:08.425387 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:08.556656 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:08.556630 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:19:08.557113 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:08.556721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:19:08.572514 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:08.572486 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:19:09.209715 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.209678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-czk77"] Jun 10 11:19:09.209890 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.209845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:09.209950 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:09.209933 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:09.216154 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.216115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9b28g"] Jun 10 11:19:09.216284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.216232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:09.216360 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:09.216336 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:09.216681 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.216660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v2rwg"] Jun 10 11:19:09.216779 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.216767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:09.216876 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:09.216858 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:09.561427 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.561345 2576 generic.go:356] "Generic (PLEG): container finished" podID="196dc70c-835f-48b6-9f0f-8ec724920919" containerID="43f2e673ef4b37ae30247a3e54c3682c6c25383015d9621df0edd610b95d2151" exitCode=0 Jun 10 11:19:09.561427 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:09.561381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerDied","Data":"43f2e673ef4b37ae30247a3e54c3682c6c25383015d9621df0edd610b95d2151"} Jun 10 11:19:10.423369 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:10.423333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:10.423559 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:10.423440 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:11.422189 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:11.422017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:11.422679 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:11.422052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:11.422679 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:11.422266 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:11.422679 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:11.422345 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:11.568240 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:11.568210 2576 generic.go:356] "Generic (PLEG): container finished" podID="196dc70c-835f-48b6-9f0f-8ec724920919" containerID="3df12d06c333f88a770ab8d9228a3249be4f638dd1cd964159ac10b265c15f91" exitCode=0 Jun 10 11:19:11.568415 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:11.568273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerDied","Data":"3df12d06c333f88a770ab8d9228a3249be4f638dd1cd964159ac10b265c15f91"} Jun 10 11:19:12.422878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:12.422843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:12.423381 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:12.423011 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2rwg" podUID="db437c4d-6016-498d-8754-67d3ec06d718" Jun 10 11:19:13.422191 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:13.422146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:13.422403 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:13.422262 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-czk77" podUID="0664266d-9e85-499d-88ae-9bfc58683e9d" Jun 10 11:19:13.422403 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:13.422334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:13.422522 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:13.422452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9b28g" podUID="6924a2c7-8b35-4d52-8e28-7b8d2b1027ad" Jun 10 11:19:14.102604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.102565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:14.103313 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.102622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:14.103313 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.102739 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:14.103313 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.102765 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:14.103313 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.102817 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret podName:6924a2c7-8b35-4d52-8e28-7b8d2b1027ad nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.102799267 +0000 UTC m=+66.148975256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret") pod "global-pull-secret-syncer-9b28g" (UID: "6924a2c7-8b35-4d52-8e28-7b8d2b1027ad") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:14.103313 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.102837 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs podName:db437c4d-6016-498d-8754-67d3ec06d718 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.102827311 +0000 UTC m=+66.149003303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs") pod "network-metrics-daemon-v2rwg" (UID: "db437c4d-6016-498d-8754-67d3ec06d718") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:14.203372 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.203338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:14.203570 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.203499 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:14.203570 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.203518 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:14.203570 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.203528 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtm2q for pod openshift-network-diagnostics/network-check-target-czk77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:14.203727 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.203581 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q podName:0664266d-9e85-499d-88ae-9bfc58683e9d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.203567484 +0000 UTC m=+66.249743470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtm2q" (UniqueName: "kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q") pod "network-check-target-czk77" (UID: "0664266d-9e85-499d-88ae-9bfc58683e9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:14.220606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.220577 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-135.ec2.internal" event="NodeReady" Jun 10 11:19:14.220792 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.220732 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 11:19:14.264452 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.264410 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2"] Jun 10 11:19:14.295736 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.295706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848"] Jun 10 11:19:14.295909 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.295827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:14.299714 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.299149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 11:19:14.299997 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.299957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xfvxj\"" Jun 10 11:19:14.300141 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.300119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.300213 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.300124 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.309537 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.309507 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59"] Jun 10 11:19:14.309668 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.309630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.313124 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.312777 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.313124 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.312780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p5fxr\"" Jun 10 11:19:14.313124 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.312782 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 11:19:14.313124 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.312829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 11:19:14.313124 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.312891 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.329195 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.329157 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-595fc7bbb4-4n27z"] Jun 10 11:19:14.329351 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.329285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.332339 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.332316 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.332491 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.332470 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.333554 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.333523 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 11:19:14.333554 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.333544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-btwfh\"" Jun 10 11:19:14.333701 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.333578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 11:19:14.349196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.349171 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-6jznh"] Jun 10 11:19:14.349398 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.349379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.353506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.353451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 11:19:14.353506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.353469 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 11:19:14.353506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.353482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2frgd\"" Jun 10 11:19:14.353794 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.353769 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 11:19:14.365252 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.365227 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 11:19:14.372507 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.372470 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-twh6x"] Jun 10 11:19:14.372779 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.372756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.375559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.375534 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 11:19:14.375559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.375551 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4hzgp\"" Jun 10 11:19:14.375808 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.375786 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 11:19:14.375808 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.375799 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.376068 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.376050 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.386540 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.382788 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 11:19:14.393125 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.393102 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2"] Jun 10 11:19:14.393262 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.393137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848"] Jun 10 11:19:14.393262 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.393158 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c986ff4c-bhkkh"] Jun 10 11:19:14.393262 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.393217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.396080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.396058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 11:19:14.396211 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.396170 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.396283 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.396212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.396350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.396280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7mxdq\"" Jun 10 11:19:14.396350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.396283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 11:19:14.402088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.402067 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 11:19:14.405547 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72qwm\" (UniqueName: \"kubernetes.io/projected/e860d108-9d3e-486d-ae20-20edd904f8aa-kube-api-access-72qwm\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.405631 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.405680 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqh97\" (UniqueName: \"kubernetes.io/projected/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-kube-api-access-fqh97\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:14.405735 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/838145fc-a31a-47bc-9739-5f379a8eb77c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.405787 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/838145fc-a31a-47bc-9739-5f379a8eb77c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.405787 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hdb\" (UniqueName: \"kubernetes.io/projected/838145fc-a31a-47bc-9739-5f379a8eb77c-kube-api-access-59hdb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.405871 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e860d108-9d3e-486d-ae20-20edd904f8aa-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.405929 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.405886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:14.411260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.411239 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-6jznh"] Jun 10 11:19:14.411408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.411279 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf"] Jun 10 11:19:14.411465 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.411404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.414356 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414341 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hlf6h\"" Jun 10 11:19:14.414460 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414375 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 11:19:14.414533 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.414580 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 11:19:14.414787 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414769 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 11:19:14.414890 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.415003 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.414965 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 11:19:14.434885 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.434847 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch"] Jun 10 11:19:14.435072 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.434992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" Jun 10 11:19:14.437969 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.437947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.438426 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.438404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sk62f\"" Jun 10 11:19:14.438539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.438455 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.455117 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.455095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:14.455282 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.455263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" Jun 10 11:19:14.458356 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.458335 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:19:14.458567 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.458548 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-swzhq\"" Jun 10 11:19:14.458707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.458673 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.458852 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.458836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.458965 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.458885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xq8q5\"" Jun 10 11:19:14.459428 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.459411 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r"] Jun 10 11:19:14.472020 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.471966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59"] Jun 10 11:19:14.472130 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.472050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-twh6x"] Jun 10 11:19:14.472130 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.472075 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z8gml"] Jun 10 11:19:14.473312 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.472228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.476284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.476252 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 11:19:14.476465 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.476449 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.476679 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.476662 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.476873 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.476856 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dwbfm\"" Jun 10 11:19:14.477080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.477059 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 11:19:14.488349 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.488326 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xvw65"] Jun 10 11:19:14.488468 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.488422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.491263 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.491242 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 11:19:14.491408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.491285 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 11:19:14.491584 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.491524 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zz7w7\"" Jun 10 11:19:14.491675 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.491594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 11:19:14.502764 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595fc7bbb4-4n27z"] Jun 10 11:19:14.502865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch"] Jun 10 11:19:14.502865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c986ff4c-bhkkh"] Jun 10 11:19:14.502865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502810 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r"] Jun 10 11:19:14.502865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502828 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf"] Jun 10 11:19:14.502865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z8gml"] Jun 10 11:19:14.502865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvw65"] Jun 10 11:19:14.503122 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.502869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.505605 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.505587 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 11:19:14.505739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.505721 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lr4d\"" Jun 10 11:19:14.505739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.505734 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 11:19:14.506590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-tmp\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.506698 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-default-certificate\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.506698 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.506698 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72qwm\" (UniqueName: \"kubernetes.io/projected/e860d108-9d3e-486d-ae20-20edd904f8aa-kube-api-access-72qwm\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.506835 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73725691-5faa-4eea-905c-25449811f5ee-serving-cert\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.506835 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.506835 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73725691-5faa-4eea-905c-25449811f5ee-trusted-ca\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.506835 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9z5\" (UniqueName: \"kubernetes.io/projected/73725691-5faa-4eea-905c-25449811f5ee-kube-api-access-fk9z5\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.506835 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-stats-auth\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.506835 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.506829 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:14.507085 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.506933 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls podName:e860d108-9d3e-486d-ae20-20edd904f8aa nodeName:}" failed. No retries permitted until 2026-06-10 11:19:15.006911421 +0000 UTC m=+35.053087415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qpj59" (UID: "e860d108-9d3e-486d-ae20-20edd904f8aa") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:14.507085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.506833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtwp6\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-kube-api-access-qtwp6\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73725691-5faa-4eea-905c-25449811f5ee-config\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.507085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbtg9\" (UniqueName: \"kubernetes.io/projected/58622331-f831-4d8c-8d28-968d9229a193-kube-api-access-jbtg9\") pod \"network-check-source-dbd9cf844-7kqxf\" (UID: \"58622331-f831-4d8c-8d28-968d9229a193\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" Jun 10 11:19:14.507085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45a43777-163f-47c0-a261-e875ee1bd02a-ca-trust-extracted\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-snapshots\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.507342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e860d108-9d3e-486d-ae20-20edd904f8aa-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.507342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-service-ca-bundle\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.507342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-installation-pull-secrets\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-trusted-ca-bundle\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-image-registry-private-configuration\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-registry-certificates\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jpj4\" (UniqueName: \"kubernetes.io/projected/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-kube-api-access-4jpj4\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-trusted-ca\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqh97\" (UniqueName: \"kubernetes.io/projected/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-kube-api-access-fqh97\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:14.507585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ksfx\" (UniqueName: \"kubernetes.io/projected/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-kube-api-access-2ksfx\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-bound-sa-token\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/838145fc-a31a-47bc-9739-5f379a8eb77c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/838145fc-a31a-47bc-9739-5f379a8eb77c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hdb\" (UniqueName: \"kubernetes.io/projected/838145fc-a31a-47bc-9739-5f379a8eb77c-kube-api-access-59hdb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-serving-cert\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.507908 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.507900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e860d108-9d3e-486d-ae20-20edd904f8aa-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.508373 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.508016 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:19:14.508373 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.508067 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls podName:97590d8f-dcf4-415c-a7f9-d1a41fd9ebac nodeName:}" failed. No retries permitted until 2026-06-10 11:19:15.008051132 +0000 UTC m=+35.054227125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vxmd2" (UID: "97590d8f-dcf4-415c-a7f9-d1a41fd9ebac") : secret "samples-operator-tls" not found Jun 10 11:19:14.508488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.508470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/838145fc-a31a-47bc-9739-5f379a8eb77c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.513561 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.513542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/838145fc-a31a-47bc-9739-5f379a8eb77c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.518779 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.518754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqh97\" (UniqueName: \"kubernetes.io/projected/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-kube-api-access-fqh97\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:14.519403 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.519378 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72qwm\" (UniqueName: \"kubernetes.io/projected/e860d108-9d3e-486d-ae20-20edd904f8aa-kube-api-access-72qwm\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:14.519537 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.519514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hdb\" (UniqueName: \"kubernetes.io/projected/838145fc-a31a-47bc-9739-5f379a8eb77c-kube-api-access-59hdb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6k848\" (UID: \"838145fc-a31a-47bc-9739-5f379a8eb77c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.608797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73725691-5faa-4eea-905c-25449811f5ee-serving-cert\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.608797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73725691-5faa-4eea-905c-25449811f5ee-trusted-ca\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.609026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3169442e-7553-43a5-a7c7-ba0b446387e9-config-volume\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.609026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9z5\" (UniqueName: \"kubernetes.io/projected/73725691-5faa-4eea-905c-25449811f5ee-kube-api-access-fk9z5\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.609026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-stats-auth\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.609026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfq2t\" (UniqueName: \"kubernetes.io/projected/e738674d-7b2c-422b-9ef2-170a4e1098aa-kube-api-access-wfq2t\") pod \"volume-data-source-validator-78dd696465-knvch\" (UID: \"e738674d-7b2c-422b-9ef2-170a4e1098aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" Jun 10 11:19:14.609026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.608997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.609290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtwp6\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-kube-api-access-qtwp6\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73725691-5faa-4eea-905c-25449811f5ee-config\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.609290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbtg9\" (UniqueName: \"kubernetes.io/projected/58622331-f831-4d8c-8d28-968d9229a193-kube-api-access-jbtg9\") pod \"network-check-source-dbd9cf844-7kqxf\" (UID: \"58622331-f831-4d8c-8d28-968d9229a193\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" Jun 10 11:19:14.609290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45a43777-163f-47c0-a261-e875ee1bd02a-ca-trust-extracted\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv99r\" (UniqueName: \"kubernetes.io/projected/8164122d-d08b-4215-b793-d3bc6cbb87d6-kube-api-access-lv99r\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.609290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-snapshots\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.609579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzx7x\" (UniqueName: \"kubernetes.io/projected/3169442e-7553-43a5-a7c7-ba0b446387e9-kube-api-access-dzx7x\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.609579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-service-ca-bundle\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.609579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-installation-pull-secrets\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.609579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-trusted-ca-bundle\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-image-registry-private-configuration\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-registry-certificates\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8164122d-d08b-4215-b793-d3bc6cbb87d6-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45a43777-163f-47c0-a261-e875ee1bd02a-ca-trust-extracted\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jpj4\" (UniqueName: \"kubernetes.io/projected/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-kube-api-access-4jpj4\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-trusted-ca\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lctcm\" (UniqueName: \"kubernetes.io/projected/185d1f9f-ac63-4718-ac53-05e983fdd906-kube-api-access-lctcm\") pod \"ingress-canary-z8gml\" (UID: \"185d1f9f-ac63-4718-ac53-05e983fdd906\") " pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ksfx\" (UniqueName: \"kubernetes.io/projected/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-kube-api-access-2ksfx\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-bound-sa-token\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609800 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-snapshots\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.609821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/185d1f9f-ac63-4718-ac53-05e983fdd906-cert\") pod \"ingress-canary-z8gml\" (UID: \"185d1f9f-ac63-4718-ac53-05e983fdd906\") " pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3169442e-7553-43a5-a7c7-ba0b446387e9-tmp-dir\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-serving-cert\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8164122d-d08b-4215-b793-d3bc6cbb87d6-config\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73725691-5faa-4eea-905c-25449811f5ee-trusted-ca\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.609994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-tmp\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-default-certificate\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.610232 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.610251 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595fc7bbb4-4n27z: secret "image-registry-tls" not found Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.610337 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls podName:45a43777-163f-47c0-a261-e875ee1bd02a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:15.110316835 +0000 UTC m=+35.156492824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls") pod "image-registry-595fc7bbb4-4n27z" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a") : secret "image-registry-tls" not found Jun 10 11:19:14.610354 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-tmp\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.610828 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-trusted-ca-bundle\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.610828 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-service-ca-bundle\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.610828 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.610665 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:15.110647337 +0000 UTC m=+35.156823340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : configmap references non-existent config key: service-ca.crt Jun 10 11:19:14.610960 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.610848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-registry-certificates\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.611852 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.611676 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:19:14.611852 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.611696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-trusted-ca\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.611852 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.611740 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:15.111725697 +0000 UTC m=+35.157901704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : secret "router-metrics-certs-default" not found Jun 10 11:19:14.612196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.612153 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73725691-5faa-4eea-905c-25449811f5ee-serving-cert\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.614091 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.614068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-stats-auth\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.614290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.614242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-installation-pull-secrets\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.614439 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.614414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-image-registry-private-configuration\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.614521 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.614459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-default-certificate\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.614628 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.614593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-serving-cert\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.619904 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.619882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" Jun 10 11:19:14.620869 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.620519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73725691-5faa-4eea-905c-25449811f5ee-config\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.622478 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.622446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9z5\" (UniqueName: \"kubernetes.io/projected/73725691-5faa-4eea-905c-25449811f5ee-kube-api-access-fk9z5\") pod \"console-operator-668fdbf85c-twh6x\" (UID: \"73725691-5faa-4eea-905c-25449811f5ee\") " pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.623491 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.623464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ksfx\" (UniqueName: \"kubernetes.io/projected/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-kube-api-access-2ksfx\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:14.623571 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.623562 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtwp6\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-kube-api-access-qtwp6\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.623637 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.623617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jpj4\" (UniqueName: \"kubernetes.io/projected/edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b-kube-api-access-4jpj4\") pod \"insights-operator-896549976-6jznh\" (UID: \"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b\") " pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.623769 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.623741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbtg9\" (UniqueName: \"kubernetes.io/projected/58622331-f831-4d8c-8d28-968d9229a193-kube-api-access-jbtg9\") pod \"network-check-source-dbd9cf844-7kqxf\" (UID: \"58622331-f831-4d8c-8d28-968d9229a193\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" Jun 10 11:19:14.624889 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.624783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-bound-sa-token\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:14.683964 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.683933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-6jznh" Jun 10 11:19:14.689453 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.689398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:14.704196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.704171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:14.711523 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3169442e-7553-43a5-a7c7-ba0b446387e9-config-volume\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.711676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfq2t\" (UniqueName: \"kubernetes.io/projected/e738674d-7b2c-422b-9ef2-170a4e1098aa-kube-api-access-wfq2t\") pod \"volume-data-source-validator-78dd696465-knvch\" (UID: \"e738674d-7b2c-422b-9ef2-170a4e1098aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" Jun 10 11:19:14.711676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.711676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv99r\" (UniqueName: \"kubernetes.io/projected/8164122d-d08b-4215-b793-d3bc6cbb87d6-kube-api-access-lv99r\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.711676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzx7x\" (UniqueName: \"kubernetes.io/projected/3169442e-7553-43a5-a7c7-ba0b446387e9-kube-api-access-dzx7x\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.711676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8164122d-d08b-4215-b793-d3bc6cbb87d6-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.711951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lctcm\" (UniqueName: \"kubernetes.io/projected/185d1f9f-ac63-4718-ac53-05e983fdd906-kube-api-access-lctcm\") pod \"ingress-canary-z8gml\" (UID: \"185d1f9f-ac63-4718-ac53-05e983fdd906\") " pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.711951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/185d1f9f-ac63-4718-ac53-05e983fdd906-cert\") pod \"ingress-canary-z8gml\" (UID: \"185d1f9f-ac63-4718-ac53-05e983fdd906\") " pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.711951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3169442e-7553-43a5-a7c7-ba0b446387e9-tmp-dir\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.711951 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.711750 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:19:14.711951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.711779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8164122d-d08b-4215-b793-d3bc6cbb87d6-config\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.711951 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:14.711855 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls podName:3169442e-7553-43a5-a7c7-ba0b446387e9 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:15.211841399 +0000 UTC m=+35.258017385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls") pod "dns-default-xvw65" (UID: "3169442e-7553-43a5-a7c7-ba0b446387e9") : secret "dns-default-metrics-tls" not found Jun 10 11:19:14.712361 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.712143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3169442e-7553-43a5-a7c7-ba0b446387e9-config-volume\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.712361 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.712265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3169442e-7553-43a5-a7c7-ba0b446387e9-tmp-dir\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.712722 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.712681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8164122d-d08b-4215-b793-d3bc6cbb87d6-config\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.714929 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.714907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8164122d-d08b-4215-b793-d3bc6cbb87d6-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.715228 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.715212 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/185d1f9f-ac63-4718-ac53-05e983fdd906-cert\") pod \"ingress-canary-z8gml\" (UID: \"185d1f9f-ac63-4718-ac53-05e983fdd906\") " pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.730106 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.730074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv99r\" (UniqueName: \"kubernetes.io/projected/8164122d-d08b-4215-b793-d3bc6cbb87d6-kube-api-access-lv99r\") pod \"service-ca-operator-6bc5ff68f5-2ft7r\" (UID: \"8164122d-d08b-4215-b793-d3bc6cbb87d6\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.730263 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.730076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzx7x\" (UniqueName: \"kubernetes.io/projected/3169442e-7553-43a5-a7c7-ba0b446387e9-kube-api-access-dzx7x\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:14.730581 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.730563 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lctcm\" (UniqueName: \"kubernetes.io/projected/185d1f9f-ac63-4718-ac53-05e983fdd906-kube-api-access-lctcm\") pod \"ingress-canary-z8gml\" (UID: \"185d1f9f-ac63-4718-ac53-05e983fdd906\") " pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.731572 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.731544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfq2t\" (UniqueName: \"kubernetes.io/projected/e738674d-7b2c-422b-9ef2-170a4e1098aa-kube-api-access-wfq2t\") pod \"volume-data-source-validator-78dd696465-knvch\" (UID: \"e738674d-7b2c-422b-9ef2-170a4e1098aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" Jun 10 11:19:14.744893 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.744868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" Jun 10 11:19:14.772585 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.772552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" Jun 10 11:19:14.782674 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.782648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" Jun 10 11:19:14.795727 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.795700 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:14.798625 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.798601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z8gml" Jun 10 11:19:14.891109 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.891019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:14.996175 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:14.996141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:15.013997 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.013940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:15.014188 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.014053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:15.014188 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.014114 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:19:15.014307 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.014197 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls podName:97590d8f-dcf4-415c-a7f9-d1a41fd9ebac nodeName:}" failed. No retries permitted until 2026-06-10 11:19:16.014174035 +0000 UTC m=+36.060350021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vxmd2" (UID: "97590d8f-dcf4-415c-a7f9-d1a41fd9ebac") : secret "samples-operator-tls" not found Jun 10 11:19:15.014307 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.014248 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:15.014410 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.014323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls podName:e860d108-9d3e-486d-ae20-20edd904f8aa nodeName:}" failed. No retries permitted until 2026-06-10 11:19:16.014304782 +0000 UTC m=+36.060480782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qpj59" (UID: "e860d108-9d3e-486d-ae20-20edd904f8aa") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:15.090852 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.090800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:15.114570 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.114537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.114645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.114710 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.114731 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595fc7bbb4-4n27z: secret "image-registry-tls" not found Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.114750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.114793 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls podName:45a43777-163f-47c0-a261-e875ee1bd02a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:16.114769856 +0000 UTC m=+36.160945865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls") pod "image-registry-595fc7bbb4-4n27z" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a") : secret "image-registry-tls" not found Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.114833 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:16.114814329 +0000 UTC m=+36.160990347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : configmap references non-existent config key: service-ca.crt Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.114881 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:19:15.115166 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.114932 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:16.114917774 +0000 UTC m=+36.161093762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : secret "router-metrics-certs-default" not found Jun 10 11:19:15.192113 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.192028 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:15.215266 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.215223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:15.215551 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.215530 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:19:15.215658 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:15.215594 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls podName:3169442e-7553-43a5-a7c7-ba0b446387e9 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:16.215575892 +0000 UTC m=+36.261751918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls") pod "dns-default-xvw65" (UID: "3169442e-7553-43a5-a7c7-ba0b446387e9") : secret "dns-default-metrics-tls" not found Jun 10 11:19:15.422236 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.422204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:15.422236 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.422231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:15.425545 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.425514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqxnp\"" Jun 10 11:19:15.426469 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.426451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:19:15.786960 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.786654 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:15.883698 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:15.883529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:16.024169 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.024142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:16.024298 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.024257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:16.024298 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.024285 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:19:16.024366 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.024345 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls podName:97590d8f-dcf4-415c-a7f9-d1a41fd9ebac nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.024330653 +0000 UTC m=+38.070506643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vxmd2" (UID: "97590d8f-dcf4-415c-a7f9-d1a41fd9ebac") : secret "samples-operator-tls" not found Jun 10 11:19:16.024416 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.024360 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:16.024416 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.024410 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls podName:e860d108-9d3e-486d-ae20-20edd904f8aa nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.024395678 +0000 UTC m=+38.070571665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qpj59" (UID: "e860d108-9d3e-486d-ae20-20edd904f8aa") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:16.109533 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.109491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch"] Jun 10 11:19:16.112257 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.111723 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z8gml"] Jun 10 11:19:16.118315 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.118289 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf"] Jun 10 11:19:16.121967 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.121945 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-twh6x"] Jun 10 11:19:16.124843 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.124768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:16.124952 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.124895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:16.124952 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.124929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:16.125186 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.125163 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:19:16.125285 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.125271 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.125223452 +0000 UTC m=+38.171399462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : secret "router-metrics-certs-default" not found Jun 10 11:19:16.125381 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.125333 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:19:16.125381 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.125370 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595fc7bbb4-4n27z: secret "image-registry-tls" not found Jun 10 11:19:16.125470 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.125417 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848"] Jun 10 11:19:16.125584 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.125564 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.125286947 +0000 UTC m=+38.171462938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : configmap references non-existent config key: service-ca.crt Jun 10 11:19:16.125656 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.125609 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls podName:45a43777-163f-47c0-a261-e875ee1bd02a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.125585777 +0000 UTC m=+38.171761782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls") pod "image-registry-595fc7bbb4-4n27z" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a") : secret "image-registry-tls" not found Jun 10 11:19:16.126398 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.126381 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r"] Jun 10 11:19:16.145499 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.145285 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-6jznh"] Jun 10 11:19:16.150389 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.150352 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185d1f9f_ac63_4718_ac53_05e983fdd906.slice/crio-a07cd69bac2099cbfbad4f88ba276872497c42a28d291b9b77a8894b7a34dd2b WatchSource:0}: Error finding container a07cd69bac2099cbfbad4f88ba276872497c42a28d291b9b77a8894b7a34dd2b: Status 404 returned error can't find the container with id a07cd69bac2099cbfbad4f88ba276872497c42a28d291b9b77a8894b7a34dd2b Jun 10 11:19:16.151139 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.151112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58622331_f831_4d8c_8d28_968d9229a193.slice/crio-ae290b0390b826c8ab7d5e9c48341f283a8364e09200730c25a740568e85f1f2 WatchSource:0}: Error finding container ae290b0390b826c8ab7d5e9c48341f283a8364e09200730c25a740568e85f1f2: Status 404 returned error can't find the container with id ae290b0390b826c8ab7d5e9c48341f283a8364e09200730c25a740568e85f1f2 Jun 10 11:19:16.153558 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.153406 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode738674d_7b2c_422b_9ef2_170a4e1098aa.slice/crio-4dfb76055b86973a4fc5584e6aa83727ab534285ab285e1475f85d0f064b850e WatchSource:0}: Error finding container 4dfb76055b86973a4fc5584e6aa83727ab534285ab285e1475f85d0f064b850e: Status 404 returned error can't find the container with id 4dfb76055b86973a4fc5584e6aa83727ab534285ab285e1475f85d0f064b850e Jun 10 11:19:16.155181 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.155058 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8164122d_d08b_4215_b793_d3bc6cbb87d6.slice/crio-dfd1c02b9a4c3ada8cd06a09070adbadff5c4397df4d2209ba645865db79da04 WatchSource:0}: Error finding container dfd1c02b9a4c3ada8cd06a09070adbadff5c4397df4d2209ba645865db79da04: Status 404 returned error can't find the container with id dfd1c02b9a4c3ada8cd06a09070adbadff5c4397df4d2209ba645865db79da04 Jun 10 11:19:16.164598 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.164573 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73725691_5faa_4eea_905c_25449811f5ee.slice/crio-194ad80a4b1a5929d3aefce76f39e43e965a96bddcdaa4022ef11ffdf73336aa WatchSource:0}: Error finding container 194ad80a4b1a5929d3aefce76f39e43e965a96bddcdaa4022ef11ffdf73336aa: Status 404 returned error can't find the container with id 194ad80a4b1a5929d3aefce76f39e43e965a96bddcdaa4022ef11ffdf73336aa Jun 10 11:19:16.165229 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.165206 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc9ee7d_bd2c_4e82_9f3d_0276cdc4ec2b.slice/crio-02588d418faee3f56bf14a806c7534c8dceca97b8576d1563dad6edf3f827af2 WatchSource:0}: Error finding container 02588d418faee3f56bf14a806c7534c8dceca97b8576d1563dad6edf3f827af2: Status 404 returned error can't find the container with id 02588d418faee3f56bf14a806c7534c8dceca97b8576d1563dad6edf3f827af2 Jun 10 11:19:16.166155 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:16.166116 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838145fc_a31a_47bc_9739_5f379a8eb77c.slice/crio-78efaf269bff713b9f690913acf8562c67cfb5b964ff7cf171fbc57916b1dbf9 WatchSource:0}: Error finding container 78efaf269bff713b9f690913acf8562c67cfb5b964ff7cf171fbc57916b1dbf9: Status 404 returned error can't find the container with id 78efaf269bff713b9f690913acf8562c67cfb5b964ff7cf171fbc57916b1dbf9 Jun 10 11:19:16.190896 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.190871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:16.225405 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.225372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:16.225569 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.225521 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:19:16.225605 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:16.225584 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls podName:3169442e-7553-43a5-a7c7-ba0b446387e9 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.225566723 +0000 UTC m=+38.271742711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls") pod "dns-default-xvw65" (UID: "3169442e-7553-43a5-a7c7-ba0b446387e9") : secret "dns-default-metrics-tls" not found Jun 10 11:19:16.292166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.292130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:16.586579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.586540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" event={"ID":"58622331-f831-4d8c-8d28-968d9229a193","Type":"ContainerStarted","Data":"ae290b0390b826c8ab7d5e9c48341f283a8364e09200730c25a740568e85f1f2"} Jun 10 11:19:16.588133 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.588104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" event={"ID":"e738674d-7b2c-422b-9ef2-170a4e1098aa","Type":"ContainerStarted","Data":"4dfb76055b86973a4fc5584e6aa83727ab534285ab285e1475f85d0f064b850e"} Jun 10 11:19:16.589923 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.589891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z8gml" event={"ID":"185d1f9f-ac63-4718-ac53-05e983fdd906","Type":"ContainerStarted","Data":"a07cd69bac2099cbfbad4f88ba276872497c42a28d291b9b77a8894b7a34dd2b"} Jun 10 11:19:16.591451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.591422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" event={"ID":"73725691-5faa-4eea-905c-25449811f5ee","Type":"ContainerStarted","Data":"194ad80a4b1a5929d3aefce76f39e43e965a96bddcdaa4022ef11ffdf73336aa"} Jun 10 11:19:16.594505 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.594482 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6jznh" event={"ID":"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b","Type":"ContainerStarted","Data":"02588d418faee3f56bf14a806c7534c8dceca97b8576d1563dad6edf3f827af2"} Jun 10 11:19:16.596047 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.596021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" event={"ID":"838145fc-a31a-47bc-9739-5f379a8eb77c","Type":"ContainerStarted","Data":"78efaf269bff713b9f690913acf8562c67cfb5b964ff7cf171fbc57916b1dbf9"} Jun 10 11:19:16.600340 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.600313 2576 generic.go:356] "Generic (PLEG): container finished" podID="196dc70c-835f-48b6-9f0f-8ec724920919" containerID="2052ed2c9c82107317af5b475b91f485c9de8fb7cabbd7daf0043285e0b9060d" exitCode=0 Jun 10 11:19:16.600459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.600392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerDied","Data":"2052ed2c9c82107317af5b475b91f485c9de8fb7cabbd7daf0043285e0b9060d"} Jun 10 11:19:16.602748 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:16.602724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" event={"ID":"8164122d-d08b-4215-b793-d3bc6cbb87d6","Type":"ContainerStarted","Data":"dfd1c02b9a4c3ada8cd06a09070adbadff5c4397df4d2209ba645865db79da04"} Jun 10 11:19:17.616210 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:17.615424 2576 generic.go:356] "Generic (PLEG): container finished" podID="196dc70c-835f-48b6-9f0f-8ec724920919" containerID="6b64ad1f9aab735350e9830961ef45711a5d0d4903141fdafc916d8810c6ac99" exitCode=0 Jun 10 11:19:17.616210 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:17.615684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerDied","Data":"6b64ad1f9aab735350e9830961ef45711a5d0d4903141fdafc916d8810c6ac99"} Jun 10 11:19:18.051028 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.050133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:18.051028 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.050230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:18.051028 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.050456 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:18.051028 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.050524 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls podName:e860d108-9d3e-486d-ae20-20edd904f8aa nodeName:}" failed. No retries permitted until 2026-06-10 11:19:22.050505913 +0000 UTC m=+42.096681901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qpj59" (UID: "e860d108-9d3e-486d-ae20-20edd904f8aa") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:18.051028 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.050932 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:19:18.051028 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.050999 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls podName:97590d8f-dcf4-415c-a7f9-d1a41fd9ebac nodeName:}" failed. No retries permitted until 2026-06-10 11:19:22.050965829 +0000 UTC m=+42.097141819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vxmd2" (UID: "97590d8f-dcf4-415c-a7f9-d1a41fd9ebac") : secret "samples-operator-tls" not found Jun 10 11:19:18.151493 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.151328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:18.151493 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.151457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:18.151714 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.151571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:18.151769 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.151720 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:19:18.151819 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.151788 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:22.151767733 +0000 UTC m=+42.197943733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : secret "router-metrics-certs-default" not found Jun 10 11:19:18.152199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.152011 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:22.151995392 +0000 UTC m=+42.198171398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : configmap references non-existent config key: service-ca.crt Jun 10 11:19:18.152199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.152112 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:19:18.152199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.152126 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595fc7bbb4-4n27z: secret "image-registry-tls" not found Jun 10 11:19:18.152199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.152162 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls podName:45a43777-163f-47c0-a261-e875ee1bd02a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:22.152150275 +0000 UTC m=+42.198326281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls") pod "image-registry-595fc7bbb4-4n27z" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a") : secret "image-registry-tls" not found Jun 10 11:19:18.252888 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.252846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:18.253089 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.253030 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:19:18.253157 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:18.253094 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls podName:3169442e-7553-43a5-a7c7-ba0b446387e9 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:22.253075162 +0000 UTC m=+42.299251148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls") pod "dns-default-xvw65" (UID: "3169442e-7553-43a5-a7c7-ba0b446387e9") : secret "dns-default-metrics-tls" not found Jun 10 11:19:18.622892 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.622851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px2tp" event={"ID":"196dc70c-835f-48b6-9f0f-8ec724920919","Type":"ContainerStarted","Data":"3ecb1fafdfc1e27abda9241201ade92101f70502c4a0a59c0ceac37ba50de2f8"} Jun 10 11:19:18.625423 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.625387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" event={"ID":"e738674d-7b2c-422b-9ef2-170a4e1098aa","Type":"ContainerStarted","Data":"fb1df0f59e883e295fddd26568d03776443006d2360b249791f1c93adf49d3b3"} Jun 10 11:19:18.649006 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.648910 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-px2tp" podStartSLOduration=8.743272041 podStartE2EDuration="38.648890883s" totalImagesPullingTime="29.905618842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:18.64716675 +0000 UTC m=+38.693342770" watchObservedRunningTime="2026-06-10 11:19:18.648890883 +0000 UTC m=+38.695066892" Jun 10 11:19:18.668366 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.668303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-knvch" podStartSLOduration=19.895916655 podStartE2EDuration="21.668279313s" totalImagesPullingTime="1.772362658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:18.667170651 +0000 UTC m=+38.713346660" watchObservedRunningTime="2026-06-10 11:19:18.668279313 +0000 UTC m=+38.714455299" Jun 10 11:19:18.786817 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.786779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:18.862873 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:18.862837 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:19.765471 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:19.765400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:19.827225 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:19.827193 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:20.640574 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:20.640534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:20.745388 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:20.745356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:22.085599 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:22.085562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:22.086199 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:22.085640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:22.086199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.085749 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:19:22.086199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.085798 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:22.086199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.085832 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls podName:97590d8f-dcf4-415c-a7f9-d1a41fd9ebac nodeName:}" failed. No retries permitted until 2026-06-10 11:19:30.085810863 +0000 UTC m=+50.131986851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vxmd2" (UID: "97590d8f-dcf4-415c-a7f9-d1a41fd9ebac") : secret "samples-operator-tls" not found Jun 10 11:19:22.086199 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.085860 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls podName:e860d108-9d3e-486d-ae20-20edd904f8aa nodeName:}" failed. No retries permitted until 2026-06-10 11:19:30.085843264 +0000 UTC m=+50.132019254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qpj59" (UID: "e860d108-9d3e-486d-ae20-20edd904f8aa") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:22.186603 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:22.186566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:22.186808 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:22.186674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:22.186808 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:22.186709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:22.186808 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.186751 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:30.186731609 +0000 UTC m=+50.232907613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : configmap references non-existent config key: service-ca.crt Jun 10 11:19:22.186965 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.186812 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:19:22.186965 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.186825 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595fc7bbb4-4n27z: secret "image-registry-tls" not found Jun 10 11:19:22.186965 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.186846 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:19:22.186965 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.186857 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls podName:45a43777-163f-47c0-a261-e875ee1bd02a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:30.186846966 +0000 UTC m=+50.233022952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls") pod "image-registry-595fc7bbb4-4n27z" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a") : secret "image-registry-tls" not found Jun 10 11:19:22.186965 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.186908 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:30.186895826 +0000 UTC m=+50.233071811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : secret "router-metrics-certs-default" not found Jun 10 11:19:22.287441 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:22.287401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:22.287636 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.287545 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:19:22.287636 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:22.287616 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls podName:3169442e-7553-43a5-a7c7-ba0b446387e9 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:30.287597063 +0000 UTC m=+50.333773054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls") pod "dns-default-xvw65" (UID: "3169442e-7553-43a5-a7c7-ba0b446387e9") : secret "dns-default-metrics-tls" not found Jun 10 11:19:23.444280 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.444239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:23.508417 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.508311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:23.618171 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.618129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:23.643176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.642658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" event={"ID":"58622331-f831-4d8c-8d28-968d9229a193","Type":"ContainerStarted","Data":"bdc86c74106be7bcbb81451e2ff5cd481a8dbe92e387b478e21217e34bea8dd7"} Jun 10 11:19:23.644419 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.644387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z8gml" event={"ID":"185d1f9f-ac63-4718-ac53-05e983fdd906","Type":"ContainerStarted","Data":"b9c351530d3258b2efddc8527614608c0b83b9b00a93c4d9468f9dca29fbe7bb"} Jun 10 11:19:23.646620 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.646599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/0.log" Jun 10 11:19:23.646750 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.646641 2576 generic.go:356] "Generic (PLEG): container finished" podID="73725691-5faa-4eea-905c-25449811f5ee" containerID="78e1a8d193fb1ddfc302db505551d8151d138bf15ffc9fb265ed7f59c4fd3c11" exitCode=255 Jun 10 11:19:23.646750 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.646715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" event={"ID":"73725691-5faa-4eea-905c-25449811f5ee","Type":"ContainerDied","Data":"78e1a8d193fb1ddfc302db505551d8151d138bf15ffc9fb265ed7f59c4fd3c11"} Jun 10 11:19:23.647092 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.646914 2576 scope.go:117] "RemoveContainer" containerID="78e1a8d193fb1ddfc302db505551d8151d138bf15ffc9fb265ed7f59c4fd3c11" Jun 10 11:19:23.649911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.648414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6jznh" event={"ID":"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b","Type":"ContainerStarted","Data":"cedd8824b16d38159f87f93ae3b8c6dd3cc314c6e073c4e3984b256cd9cc81df"} Jun 10 11:19:23.650928 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.650623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" event={"ID":"838145fc-a31a-47bc-9739-5f379a8eb77c","Type":"ContainerStarted","Data":"6c2c29fad921e7960fe2ff2d7cefa9e692e4df7c819e18015c3af10063ffc36e"} Jun 10 11:19:23.652114 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.652091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" event={"ID":"8164122d-d08b-4215-b793-d3bc6cbb87d6","Type":"ContainerStarted","Data":"7b3a3c104a7a1b3a16d5583b05d31d808db69c1ef6739f33fac2dfe9c9c90c24"} Jun 10 11:19:23.663363 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.663303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-7kqxf" podStartSLOduration=19.837607738 podStartE2EDuration="26.663283999s" totalImagesPullingTime="6.825676261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:23.663009729 +0000 UTC m=+43.709185740" watchObservedRunningTime="2026-06-10 11:19:23.663283999 +0000 UTC m=+43.709460007" Jun 10 11:19:23.685187 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.685125 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" podStartSLOduration=19.864179532 podStartE2EDuration="26.685103825s" totalImagesPullingTime="6.820924293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:23.684743213 +0000 UTC m=+43.730919223" watchObservedRunningTime="2026-06-10 11:19:23.685103825 +0000 UTC m=+43.731279834" Jun 10 11:19:23.706112 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.705950 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-6jznh" podStartSLOduration=19.8918518 podStartE2EDuration="26.705929138s" totalImagesPullingTime="6.814077338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:23.70545359 +0000 UTC m=+43.751629600" watchObservedRunningTime="2026-06-10 11:19:23.705929138 +0000 UTC m=+43.752105150" Jun 10 11:19:23.707538 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.706833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:23.754994 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.754638 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z8gml" podStartSLOduration=2.927897636 podStartE2EDuration="9.75461761s" totalImagesPullingTime="6.826719974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:23.753758917 +0000 UTC m=+43.799934927" watchObservedRunningTime="2026-06-10 11:19:23.75461761 +0000 UTC m=+43.800793598" Jun 10 11:19:23.775484 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.775350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" podStartSLOduration=19.950646269 podStartE2EDuration="26.775325542s" totalImagesPullingTime="6.824679273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:23.774495439 +0000 UTC m=+43.820671453" watchObservedRunningTime="2026-06-10 11:19:23.775325542 +0000 UTC m=+43.821501551" Jun 10 11:19:23.777433 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:23.777386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:24.503795 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.503702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:24.588355 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.588315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:24.658727 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.658692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:19:24.659235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.659215 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/0.log" Jun 10 11:19:24.659358 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.659258 2576 generic.go:356] "Generic (PLEG): container finished" podID="73725691-5faa-4eea-905c-25449811f5ee" containerID="296f16a6b1fde508f7f8ed12ff46c61add32c6ee790ce8bfc31c5861acb833db" exitCode=255 Jun 10 11:19:24.659358 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.659322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" event={"ID":"73725691-5faa-4eea-905c-25449811f5ee","Type":"ContainerDied","Data":"296f16a6b1fde508f7f8ed12ff46c61add32c6ee790ce8bfc31c5861acb833db"} Jun 10 11:19:24.659470 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.659390 2576 scope.go:117] "RemoveContainer" containerID="78e1a8d193fb1ddfc302db505551d8151d138bf15ffc9fb265ed7f59c4fd3c11" Jun 10 11:19:24.659774 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.659757 2576 scope.go:117] "RemoveContainer" containerID="296f16a6b1fde508f7f8ed12ff46c61add32c6ee790ce8bfc31c5861acb833db" Jun 10 11:19:24.659946 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:24.659927 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-twh6x_openshift-console-operator(73725691-5faa-4eea-905c-25449811f5ee)\"" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" podUID="73725691-5faa-4eea-905c-25449811f5ee" Jun 10 11:19:24.661740 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.661719 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:24.704901 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.704792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:24.704901 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.704871 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:24.773544 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.773459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:24.865911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:24.865877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:25.198489 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:25.198454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:25.303445 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:25.303410 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:25.664775 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:25.664750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:19:25.665161 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:25.665092 2576 scope.go:117] "RemoveContainer" containerID="296f16a6b1fde508f7f8ed12ff46c61add32c6ee790ce8bfc31c5861acb833db" Jun 10 11:19:25.665266 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:25.665245 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-twh6x_openshift-console-operator(73725691-5faa-4eea-905c-25449811f5ee)\"" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" podUID="73725691-5faa-4eea-905c-25449811f5ee" Jun 10 11:19:25.737764 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:25.737733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:25.862088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:25.862046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:26.418542 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:26.418506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:26.667732 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:26.667707 2576 scope.go:117] "RemoveContainer" containerID="296f16a6b1fde508f7f8ed12ff46c61add32c6ee790ce8bfc31c5861acb833db" Jun 10 11:19:26.668186 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:26.667901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-twh6x_openshift-console-operator(73725691-5faa-4eea-905c-25449811f5ee)\"" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" podUID="73725691-5faa-4eea-905c-25449811f5ee" Jun 10 11:19:26.678383 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:26.678301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:26.777693 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:26.777663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:26.892865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:26.892842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mr8cv_9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0/dns-node-resolver/0.log" Jun 10 11:19:26.925903 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:26.925874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:27.039378 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:27.039350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:27.747825 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:27.747787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:28.302192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:28.302163 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kdm2f_2ae2295d-969a-4623-89ca-e20bbaaf0789/node-ca/0.log" Jun 10 11:19:28.893012 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:28.892967 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z8gml_185d1f9f-ac63-4718-ac53-05e983fdd906/serve-healthcheck-canary/0.log" Jun 10 11:19:29.494722 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:29.494688 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-6k848_838145fc-a31a-47bc-9739-5f379a8eb77c/kube-storage-version-migrator-operator/0.log" Jun 10 11:19:30.162334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.162293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:30.162745 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.162359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:30.162745 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.162457 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:19:30.162745 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.162506 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:30.162745 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.162525 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls podName:97590d8f-dcf4-415c-a7f9-d1a41fd9ebac nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.162509135 +0000 UTC m=+66.208685121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vxmd2" (UID: "97590d8f-dcf4-415c-a7f9-d1a41fd9ebac") : secret "samples-operator-tls" not found Jun 10 11:19:30.162745 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.162564 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls podName:e860d108-9d3e-486d-ae20-20edd904f8aa nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.162551684 +0000 UTC m=+66.208727670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qpj59" (UID: "e860d108-9d3e-486d-ae20-20edd904f8aa") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:19:30.262786 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.262739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:30.262786 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.262788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.262858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.262904 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.262940 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.262961 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595fc7bbb4-4n27z: secret "image-registry-tls" not found Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.263017 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.262962039 +0000 UTC m=+66.309138044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : secret "router-metrics-certs-default" not found Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.263036 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls podName:45a43777-163f-47c0-a261-e875ee1bd02a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.263027494 +0000 UTC m=+66.309203485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls") pod "image-registry-595fc7bbb4-4n27z" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a") : secret "image-registry-tls" not found Jun 10 11:19:30.263090 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.263051 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle podName:b22dbb91-56d1-4bd4-b9a0-32e5f0da154d nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.263042878 +0000 UTC m=+66.309218865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle") pod "router-default-7c986ff4c-bhkkh" (UID: "b22dbb91-56d1-4bd4-b9a0-32e5f0da154d") : configmap references non-existent config key: service-ca.crt Jun 10 11:19:30.363328 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.363292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:30.363498 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.363442 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:19:30.363536 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:30.363504 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls podName:3169442e-7553-43a5-a7c7-ba0b446387e9 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:46.363485586 +0000 UTC m=+66.409661574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls") pod "dns-default-xvw65" (UID: "3169442e-7553-43a5-a7c7-ba0b446387e9") : secret "dns-default-metrics-tls" not found Jun 10 11:19:30.924684 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:30.924651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:31.324000 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:31.323940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:31.440024 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:31.439994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:31.581919 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:31.581845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:31.685196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:31.685164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:31.789307 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:31.789276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:31.883030 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:31.882929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:32.553849 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:32.553814 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:32.940549 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:32.940465 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:33.349818 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:33.349786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:33.743209 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:33.743123 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:34.135855 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:34.135806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:34.332370 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:34.332326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:34.786172 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:34.786111 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:35.130890 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:35.130792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:35.275954 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:35.275915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:35.377122 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:35.377068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:35.655716 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:35.655683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:35.756001 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:35.755943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:35.932552 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:35.932471 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:36.136396 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:36.136364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:36.196443 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:36.196363 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:36.533854 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:36.533817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:36.755287 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:36.755254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:36.939123 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:36.939036 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:37.422914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.422872 2576 scope.go:117] "RemoveContainer" containerID="296f16a6b1fde508f7f8ed12ff46c61add32c6ee790ce8bfc31c5861acb833db" Jun 10 11:19:37.702567 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.702483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:19:37.702567 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.702549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" event={"ID":"73725691-5faa-4eea-905c-25449811f5ee","Type":"ContainerStarted","Data":"06dd37c98aa294a60146ab7982e1de6954bc4ddd6bb067403e7f60777ccd8172"} Jun 10 11:19:37.702817 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.702795 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:37.723306 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.723238 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" podStartSLOduration=33.909076557 podStartE2EDuration="40.723219723s" totalImagesPullingTime="6.814143166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:37.722183229 +0000 UTC m=+57.768359239" watchObservedRunningTime="2026-06-10 11:19:37.723219723 +0000 UTC m=+57.769395730" Jun 10 11:19:37.740820 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.740787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:37.811100 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.811071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-twh6x" Jun 10 11:19:37.855689 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:37.855660 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.018730 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.018649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.118706 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.118674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.192737 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.192704 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.295830 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.295796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.476019 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.475952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.577209 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.577129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.680756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.680718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.785362 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.785319 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.932259 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.932174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:38.995529 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:38.995493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:39.148697 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:39.148662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:39.357192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:39.357157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:39.716045 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:39.715943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:39.916079 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:39.916043 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:40.110728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:40.110688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:40.175622 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:40.175585 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:40.542395 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:40.542365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:40.579194 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:40.579166 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5q29" Jun 10 11:19:40.734268 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:40.734231 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:40.835196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:40.835108 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:41.135149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:41.135068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:41.947136 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:41.947104 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:42.136829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:42.136788 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:42.334192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:42.334157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:42.544653 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:42.544615 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:44.932142 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:44.932112 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:44.998198 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:44.998158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:46.201212 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.201160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:46.201212 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.201216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:46.201778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.201250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:46.201778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.201314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:46.204867 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.204838 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:19:46.205665 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.205646 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:19:46.205740 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.205707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e860d108-9d3e-486d-ae20-20edd904f8aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qpj59\" (UID: \"e860d108-9d3e-486d-ae20-20edd904f8aa\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:46.205851 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.205825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/97590d8f-dcf4-415c-a7f9-d1a41fd9ebac-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vxmd2\" (UID: \"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:46.214629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.214597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db437c4d-6016-498d-8754-67d3ec06d718-metrics-certs\") pod \"network-metrics-daemon-v2rwg\" (UID: \"db437c4d-6016-498d-8754-67d3ec06d718\") " pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:46.214777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.214629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6924a2c7-8b35-4d52-8e28-7b8d2b1027ad-original-pull-secret\") pod \"global-pull-secret-syncer-9b28g\" (UID: \"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad\") " pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:46.269872 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.269835 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xq8q5\"" Jun 10 11:19:46.277669 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.277636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2rwg" Jun 10 11:19:46.302377 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.302333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:46.302377 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.302380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:46.302618 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.302411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:46.302618 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.302476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:46.308089 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.303511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-service-ca-bundle\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:46.308089 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.306003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b22dbb91-56d1-4bd4-b9a0-32e5f0da154d-metrics-certs\") pod \"router-default-7c986ff4c-bhkkh\" (UID: \"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d\") " pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:46.308089 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.306030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtm2q\" (UniqueName: \"kubernetes.io/projected/0664266d-9e85-499d-88ae-9bfc58683e9d-kube-api-access-rtm2q\") pod \"network-check-target-czk77\" (UID: \"0664266d-9e85-499d-88ae-9bfc58683e9d\") " pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:46.309247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.309218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"image-registry-595fc7bbb4-4n27z\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:46.337515 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.337482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqxnp\"" Jun 10 11:19:46.339959 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.339928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b28g" Jun 10 11:19:46.344426 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.344388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:46.405076 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.404412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:46.410458 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.410390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3169442e-7553-43a5-a7c7-ba0b446387e9-metrics-tls\") pod \"dns-default-xvw65\" (UID: \"3169442e-7553-43a5-a7c7-ba0b446387e9\") " pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:46.415743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.414830 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xfvxj\"" Jun 10 11:19:46.420816 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.420754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" Jun 10 11:19:46.437210 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.437174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v2rwg"] Jun 10 11:19:46.443252 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.443219 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-btwfh\"" Jun 10 11:19:46.449226 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:46.447442 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb437c4d_6016_498d_8754_67d3ec06d718.slice/crio-4eb53da6cdcb7bf9266f0eed4afa002e6d9d24a78fad8dc78f45359f9c5b757a WatchSource:0}: Error finding container 4eb53da6cdcb7bf9266f0eed4afa002e6d9d24a78fad8dc78f45359f9c5b757a: Status 404 returned error can't find the container with id 4eb53da6cdcb7bf9266f0eed4afa002e6d9d24a78fad8dc78f45359f9c5b757a Jun 10 11:19:46.450502 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.450179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" Jun 10 11:19:46.466458 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.466432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2frgd\"" Jun 10 11:19:46.474885 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.474603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:46.510754 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.510467 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9b28g"] Jun 10 11:19:46.513372 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:46.513327 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6924a2c7_8b35_4d52_8e28_7b8d2b1027ad.slice/crio-72ed34044255721fe2322b8d3d1e0499097367a3805d7e9c7f1fbb80981c07b8 WatchSource:0}: Error finding container 72ed34044255721fe2322b8d3d1e0499097367a3805d7e9c7f1fbb80981c07b8: Status 404 returned error can't find the container with id 72ed34044255721fe2322b8d3d1e0499097367a3805d7e9c7f1fbb80981c07b8 Jun 10 11:19:46.525060 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.524635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hlf6h\"" Jun 10 11:19:46.531673 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.531640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:46.537478 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.535208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-czk77"] Jun 10 11:19:46.545458 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:46.545404 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0664266d_9e85_499d_88ae_9bfc58683e9d.slice/crio-015fe51b04a039a73c1040e7612309026e99b54dc9f4998d1a2a0a2fe40a5424 WatchSource:0}: Error finding container 015fe51b04a039a73c1040e7612309026e99b54dc9f4998d1a2a0a2fe40a5424: Status 404 returned error can't find the container with id 015fe51b04a039a73c1040e7612309026e99b54dc9f4998d1a2a0a2fe40a5424 Jun 10 11:19:46.613592 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.613476 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2"] Jun 10 11:19:46.617160 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.616459 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lr4d\"" Jun 10 11:19:46.625005 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.624566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:46.653143 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.653095 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59"] Jun 10 11:19:46.672506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.672466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595fc7bbb4-4n27z"] Jun 10 11:19:46.677487 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:46.677455 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a43777_163f_47c0_a261_e875ee1bd02a.slice/crio-b4914887ed13ca9d731938271d4116553ca3d85a9d0a0838c03d456f24f3f235 WatchSource:0}: Error finding container b4914887ed13ca9d731938271d4116553ca3d85a9d0a0838c03d456f24f3f235: Status 404 returned error can't find the container with id b4914887ed13ca9d731938271d4116553ca3d85a9d0a0838c03d456f24f3f235 Jun 10 11:19:46.725832 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.725805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c986ff4c-bhkkh"] Jun 10 11:19:46.728862 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:46.728826 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22dbb91_56d1_4bd4_b9a0_32e5f0da154d.slice/crio-bf5b0403bd15b8e36122dffd69cc569408b7f1399303e2ddfd017318cab3e5eb WatchSource:0}: Error finding container bf5b0403bd15b8e36122dffd69cc569408b7f1399303e2ddfd017318cab3e5eb: Status 404 returned error can't find the container with id bf5b0403bd15b8e36122dffd69cc569408b7f1399303e2ddfd017318cab3e5eb Jun 10 11:19:46.731060 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.731015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v2rwg" event={"ID":"db437c4d-6016-498d-8754-67d3ec06d718","Type":"ContainerStarted","Data":"4eb53da6cdcb7bf9266f0eed4afa002e6d9d24a78fad8dc78f45359f9c5b757a"} Jun 10 11:19:46.732253 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.732233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" event={"ID":"45a43777-163f-47c0-a261-e875ee1bd02a","Type":"ContainerStarted","Data":"b4914887ed13ca9d731938271d4116553ca3d85a9d0a0838c03d456f24f3f235"} Jun 10 11:19:46.733449 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.733417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" event={"ID":"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac","Type":"ContainerStarted","Data":"94d5812d765ba5400c519c3f872da8e351ad89439e64405c42d20256f6504825"} Jun 10 11:19:46.735527 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.735499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-czk77" event={"ID":"0664266d-9e85-499d-88ae-9bfc58683e9d","Type":"ContainerStarted","Data":"2cf2e21badce48de9d10d75b8fb37a77eeb5f4b5a4bea6b882324c90ebbafc6d"} Jun 10 11:19:46.735618 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.735538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-czk77" event={"ID":"0664266d-9e85-499d-88ae-9bfc58683e9d","Type":"ContainerStarted","Data":"015fe51b04a039a73c1040e7612309026e99b54dc9f4998d1a2a0a2fe40a5424"} Jun 10 11:19:46.735618 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.735584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:19:46.737687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.737317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9b28g" event={"ID":"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad","Type":"ContainerStarted","Data":"72ed34044255721fe2322b8d3d1e0499097367a3805d7e9c7f1fbb80981c07b8"} Jun 10 11:19:46.738761 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.738739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" event={"ID":"e860d108-9d3e-486d-ae20-20edd904f8aa","Type":"ContainerStarted","Data":"e8f202181f37058a4ee21c7c95b6a348f7478a8a765c22f388e4d0bdbe4eb053"} Jun 10 11:19:46.756311 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.756260 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-czk77" podStartSLOduration=66.756239919 podStartE2EDuration="1m6.756239919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:46.755375835 +0000 UTC m=+66.801551844" watchObservedRunningTime="2026-06-10 11:19:46.756239919 +0000 UTC m=+66.802415926" Jun 10 11:19:46.798081 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:46.798049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvw65"] Jun 10 11:19:46.802277 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:46.802247 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3169442e_7553_43a5_a7c7_ba0b446387e9.slice/crio-faffb86427ced1147263e981996e559f17e2c7fce716d136b7352e3039fa814c WatchSource:0}: Error finding container faffb86427ced1147263e981996e559f17e2c7fce716d136b7352e3039fa814c: Status 404 returned error can't find the container with id faffb86427ced1147263e981996e559f17e2c7fce716d136b7352e3039fa814c Jun 10 11:19:47.750087 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.750047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvw65" event={"ID":"3169442e-7553-43a5-a7c7-ba0b446387e9","Type":"ContainerStarted","Data":"faffb86427ced1147263e981996e559f17e2c7fce716d136b7352e3039fa814c"} Jun 10 11:19:47.752770 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.752720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" event={"ID":"45a43777-163f-47c0-a261-e875ee1bd02a","Type":"ContainerStarted","Data":"6bdd926670f7ad1998e54468fed7df54e7a18e43460a48ef0456e2d664978160"} Jun 10 11:19:47.753672 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.753598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:19:47.757854 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.757700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" event={"ID":"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d","Type":"ContainerStarted","Data":"e51943f9a9e7e20f8bedfa551ea6ba8adfc9961085c89dd33c6cc6481fbc71ad"} Jun 10 11:19:47.757854 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.757748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" event={"ID":"b22dbb91-56d1-4bd4-b9a0-32e5f0da154d","Type":"ContainerStarted","Data":"bf5b0403bd15b8e36122dffd69cc569408b7f1399303e2ddfd017318cab3e5eb"} Jun 10 11:19:47.806159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.805574 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" podStartSLOduration=67.80554962 podStartE2EDuration="1m7.80554962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:47.781011824 +0000 UTC m=+67.827187831" watchObservedRunningTime="2026-06-10 11:19:47.80554962 +0000 UTC m=+67.851725631" Jun 10 11:19:47.806159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:47.805869 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" podStartSLOduration=50.805855067 podStartE2EDuration="50.805855067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:47.803039694 +0000 UTC m=+67.849215704" watchObservedRunningTime="2026-06-10 11:19:47.805855067 +0000 UTC m=+67.852031079" Jun 10 11:19:48.146289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.146199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:48.212721 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.212503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:48.532966 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.532926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:48.537874 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.537816 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:48.765829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.765789 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v2rwg" event={"ID":"db437c4d-6016-498d-8754-67d3ec06d718","Type":"ContainerStarted","Data":"eaf0a21d582616613403e3706f9691a9659db585eef9949c3804d37d32901b62"} Jun 10 11:19:48.766358 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.765848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v2rwg" event={"ID":"db437c4d-6016-498d-8754-67d3ec06d718","Type":"ContainerStarted","Data":"6047af7dc5df688872dc22503cefb50fd62bb95fea208588aeda64931b26d012"} Jun 10 11:19:48.766358 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.766003 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:48.767370 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.767349 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c986ff4c-bhkkh" Jun 10 11:19:48.855371 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.855255 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v2rwg" podStartSLOduration=67.658176767 podStartE2EDuration="1m8.855230507s" totalImagesPullingTime="1.19705374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:48.784996805 +0000 UTC m=+68.831172810" watchObservedRunningTime="2026-06-10 11:19:48.855230507 +0000 UTC m=+68.901406516" Jun 10 11:19:48.951013 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.950796 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-2cj7h"] Jun 10 11:19:48.951209 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.951060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:48.955557 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.954744 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:19:48.959032 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.959004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lwphc\"" Jun 10 11:19:48.959267 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.959246 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:19:48.959449 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.959432 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:19:48.972284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:48.972252 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-2cj7h"] Jun 10 11:19:49.027815 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.027664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2vrw\" (UniqueName: \"kubernetes.io/projected/ee94c9f0-311f-4fd7-a138-2f02b4a77366-kube-api-access-c2vrw\") pod \"downloads-6657875f97-2cj7h\" (UID: \"ee94c9f0-311f-4fd7-a138-2f02b4a77366\") " pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:19:49.040793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.040755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:49.060248 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.059760 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6zk8"] Jun 10 11:19:49.062602 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.062572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.067705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.067676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h5jpn\"" Jun 10 11:19:49.067876 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.067713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 11:19:49.068135 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.068114 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 11:19:49.078302 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.078274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6zk8"] Jun 10 11:19:49.127758 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.127656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:49.128637 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.128597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.128765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.128643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.128765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.128682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2vrw\" (UniqueName: \"kubernetes.io/projected/ee94c9f0-311f-4fd7-a138-2f02b4a77366-kube-api-access-c2vrw\") pod \"downloads-6657875f97-2cj7h\" (UID: \"ee94c9f0-311f-4fd7-a138-2f02b4a77366\") " pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:19:49.128765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.128718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-data-volume\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.128930 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.128773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbts\" (UniqueName: \"kubernetes.io/projected/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-kube-api-access-9gbts\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.128930 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.128834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-crio-socket\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.140387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.140345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2vrw\" (UniqueName: \"kubernetes.io/projected/ee94c9f0-311f-4fd7-a138-2f02b4a77366-kube-api-access-c2vrw\") pod \"downloads-6657875f97-2cj7h\" (UID: \"ee94c9f0-311f-4fd7-a138-2f02b4a77366\") " pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:19:49.229428 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.229636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.229636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-data-volume\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.229636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbts\" (UniqueName: \"kubernetes.io/projected/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-kube-api-access-9gbts\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.229636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-crio-socket\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.229839 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-crio-socket\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.230034 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.229952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-data-volume\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.230189 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.230139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.232807 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.232773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.250315 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.250247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbts\" (UniqueName: \"kubernetes.io/projected/e183c53a-1f89-4bdc-b1ff-38bc336bb94c-kube-api-access-9gbts\") pod \"insights-runtime-extractor-h6zk8\" (UID: \"e183c53a-1f89-4bdc-b1ff-38bc336bb94c\") " pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.265753 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.265715 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:49.267996 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.267685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:19:49.377163 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.376890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6zk8" Jun 10 11:19:49.382284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.382255 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:49.477189 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:49.476730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:50.340433 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:50.340398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:50.438750 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:50.438706 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:50.650176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:50.650081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:50.749504 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:50.749460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:51.548685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.548354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6zk8"] Jun 10 11:19:51.576925 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.576812 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-2cj7h"] Jun 10 11:19:51.582424 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:51.582343 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee94c9f0_311f_4fd7_a138_2f02b4a77366.slice/crio-0d6a167740e7507e0140eb071f5116f81ed2f1c84eea391741b5181b93a12915 WatchSource:0}: Error finding container 0d6a167740e7507e0140eb071f5116f81ed2f1c84eea391741b5181b93a12915: Status 404 returned error can't find the container with id 0d6a167740e7507e0140eb071f5116f81ed2f1c84eea391741b5181b93a12915 Jun 10 11:19:51.784459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.784411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" event={"ID":"e860d108-9d3e-486d-ae20-20edd904f8aa","Type":"ContainerStarted","Data":"d1446d8602c19fc8282fe21c5143055646867d8fc63c6865f2802403cb028c42"} Jun 10 11:19:51.786537 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.786498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6zk8" event={"ID":"e183c53a-1f89-4bdc-b1ff-38bc336bb94c","Type":"ContainerStarted","Data":"7a46524aa0f5c2a1741ea8c6eb0ce80a6bc3c27bbcebd1732751500f7c0af014"} Jun 10 11:19:51.786691 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.786559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6zk8" event={"ID":"e183c53a-1f89-4bdc-b1ff-38bc336bb94c","Type":"ContainerStarted","Data":"eb8ea2d755fc28c481f1f3a39af1798b842b2b65b2fdd9732093eb0c2eb3b59c"} Jun 10 11:19:51.789063 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.788436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvw65" event={"ID":"3169442e-7553-43a5-a7c7-ba0b446387e9","Type":"ContainerStarted","Data":"842dcdb0b8f5236bc56a117e4369be1fc9ef097caa5a3d0d421efbebce5a9e4f"} Jun 10 11:19:51.789063 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.788490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvw65" event={"ID":"3169442e-7553-43a5-a7c7-ba0b446387e9","Type":"ContainerStarted","Data":"abb6248d5f1405f57b2af225e560a155979be25c192c0597215c7112fe143145"} Jun 10 11:19:51.789301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.789128 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xvw65" Jun 10 11:19:51.792152 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.792123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" event={"ID":"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac","Type":"ContainerStarted","Data":"623e29227c7e42c25fcfd9fe1efd20180426b607561eb2939f32fbbbf960fb3c"} Jun 10 11:19:51.792270 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.792175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" event={"ID":"97590d8f-dcf4-415c-a7f9-d1a41fd9ebac","Type":"ContainerStarted","Data":"8895e546d8e5d7953e5e7744a1b17d05762d4868a95d838288513a5a0d6cd537"} Jun 10 11:19:51.793930 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.793905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-2cj7h" event={"ID":"ee94c9f0-311f-4fd7-a138-2f02b4a77366","Type":"ContainerStarted","Data":"0d6a167740e7507e0140eb071f5116f81ed2f1c84eea391741b5181b93a12915"} Jun 10 11:19:51.795541 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.795517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9b28g" event={"ID":"6924a2c7-8b35-4d52-8e28-7b8d2b1027ad","Type":"ContainerStarted","Data":"91649ad28ed83506237db308733a472032969f0d47b31e0198204998dee3b291"} Jun 10 11:19:51.815544 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.815486 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qpj59" podStartSLOduration=50.136577189 podStartE2EDuration="54.81546926s" totalImagesPullingTime="4.678892071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:51.815251579 +0000 UTC m=+71.861427590" watchObservedRunningTime="2026-06-10 11:19:51.81546926 +0000 UTC m=+71.861645269" Jun 10 11:19:51.834808 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.834729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:51.840769 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.840711 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vxmd2" podStartSLOduration=50.17944429 podStartE2EDuration="54.840695894s" totalImagesPullingTime="4.661251604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:51.84006452 +0000 UTC m=+71.886240528" watchObservedRunningTime="2026-06-10 11:19:51.840695894 +0000 UTC m=+71.886871903" Jun 10 11:19:51.885268 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.885201 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xvw65" podStartSLOduration=33.349711102 podStartE2EDuration="37.885175624s" totalImagesPullingTime="4.535464522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:51.883717592 +0000 UTC m=+71.929893598" watchObservedRunningTime="2026-06-10 11:19:51.885175624 +0000 UTC m=+71.931351637" Jun 10 11:19:51.885448 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.885342 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9b28g" podStartSLOduration=67.002799264 podStartE2EDuration="1m11.885334073s" totalImagesPullingTime="4.882534809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:51.861716229 +0000 UTC m=+71.907892237" watchObservedRunningTime="2026-06-10 11:19:51.885334073 +0000 UTC m=+71.931510062" Jun 10 11:19:51.933924 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:51.933888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:52.011273 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.011214 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69"] Jun 10 11:19:52.012029 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.011968 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:52.015288 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.015263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:52.018452 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.018019 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-76p6z\"" Jun 10 11:19:52.018452 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.018286 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 11:19:52.029914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.029869 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69"] Jun 10 11:19:52.054790 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.054709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4d76327c-3e5b-44c4-bded-f0d22fea289a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vsb69\" (UID: \"4d76327c-3e5b-44c4-bded-f0d22fea289a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:52.155568 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.155537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4d76327c-3e5b-44c4-bded-f0d22fea289a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vsb69\" (UID: \"4d76327c-3e5b-44c4-bded-f0d22fea289a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:52.155736 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:52.155670 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 11:19:52.155800 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:19:52.155745 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76327c-3e5b-44c4-bded-f0d22fea289a-tls-certificates podName:4d76327c-3e5b-44c4-bded-f0d22fea289a nodeName:}" failed. No retries permitted until 2026-06-10 11:19:52.655721899 +0000 UTC m=+72.701897888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4d76327c-3e5b-44c4-bded-f0d22fea289a-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-vsb69" (UID: "4d76327c-3e5b-44c4-bded-f0d22fea289a") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 11:19:52.233409 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.233371 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:52.660305 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.659785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4d76327c-3e5b-44c4-bded-f0d22fea289a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vsb69\" (UID: \"4d76327c-3e5b-44c4-bded-f0d22fea289a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:52.664206 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.663197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4d76327c-3e5b-44c4-bded-f0d22fea289a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vsb69\" (UID: \"4d76327c-3e5b-44c4-bded-f0d22fea289a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:52.803410 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.803364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6zk8" event={"ID":"e183c53a-1f89-4bdc-b1ff-38bc336bb94c","Type":"ContainerStarted","Data":"0517919c74ae4c09cd7a963d858795c261567af4d392bf2415d386e0967ef91c"} Jun 10 11:19:52.926797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.926713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:52.938489 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:52.938394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:53.036939 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.036832 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:53.099361 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.099314 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69"] Jun 10 11:19:53.514427 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.514369 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:53.522000 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:53.521944 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d76327c_3e5b_44c4_bded_f0d22fea289a.slice/crio-00f43dc4e52e9cbe616cf1d97d16f631007a7205db9728a115194a55d5406054 WatchSource:0}: Error finding container 00f43dc4e52e9cbe616cf1d97d16f631007a7205db9728a115194a55d5406054: Status 404 returned error can't find the container with id 00f43dc4e52e9cbe616cf1d97d16f631007a7205db9728a115194a55d5406054 Jun 10 11:19:53.614266 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.614239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:53.811437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.811396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6zk8" event={"ID":"e183c53a-1f89-4bdc-b1ff-38bc336bb94c","Type":"ContainerStarted","Data":"a4a3ba2709d05da71bfb5805e559a8a22c9c4803989e60039a8b89d96d74a6cd"} Jun 10 11:19:53.813140 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.813109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" event={"ID":"4d76327c-3e5b-44c4-bded-f0d22fea289a","Type":"ContainerStarted","Data":"00f43dc4e52e9cbe616cf1d97d16f631007a7205db9728a115194a55d5406054"} Jun 10 11:19:53.833219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:53.833165 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6zk8" podStartSLOduration=2.976491882 podStartE2EDuration="4.833148435s" totalImagesPullingTime="1.856656553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:53.831122157 +0000 UTC m=+73.877298202" watchObservedRunningTime="2026-06-10 11:19:53.833148435 +0000 UTC m=+73.879324442" Jun 10 11:19:54.144417 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.144263 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c4df7fb7-rr7gg"] Jun 10 11:19:54.155162 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.155134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.158534 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.158366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:19:54.158534 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.158497 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:19:54.158791 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.158732 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:19:54.158967 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.158947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:19:54.159085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.159056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:19:54.159148 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.159056 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c4df7fb7-rr7gg"] Jun 10 11:19:54.159461 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.159438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x9nhm\"" Jun 10 11:19:54.275747 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.275707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-service-ca\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.275747 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.275751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-serving-cert\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.276067 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.275793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-oauth-config\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.276067 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.275824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-oauth-serving-cert\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.276067 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.275851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-console-config\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.276067 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.275897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q47nf\" (UniqueName: \"kubernetes.io/projected/42e93c49-6788-4c87-8349-6845939093dc-kube-api-access-q47nf\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.377437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.376418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-oauth-config\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.377437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.376477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-oauth-serving-cert\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.377437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.376504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-console-config\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.377437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.376541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q47nf\" (UniqueName: \"kubernetes.io/projected/42e93c49-6788-4c87-8349-6845939093dc-kube-api-access-q47nf\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.377437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.376585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-service-ca\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.377437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.376613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-serving-cert\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.378132 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.377811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-console-config\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.378449 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.378421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-oauth-serving-cert\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.378942 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.378921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-service-ca\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.380234 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.380210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-oauth-config\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.380234 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.380219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-serving-cert\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.390468 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.390438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q47nf\" (UniqueName: \"kubernetes.io/projected/42e93c49-6788-4c87-8349-6845939093dc-kube-api-access-q47nf\") pod \"console-58c4df7fb7-rr7gg\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.469324 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.469232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:19:54.932899 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.932859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:54.982248 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:54.982127 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c4df7fb7-rr7gg"] Jun 10 11:19:55.025784 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.025743 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:55.150064 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:19:55.149954 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e93c49_6788_4c87_8349_6845939093dc.slice/crio-5dfc5d397c13ece805496c0013490bb47b329c6a5143954a3f6f800eb1ee97b0 WatchSource:0}: Error finding container 5dfc5d397c13ece805496c0013490bb47b329c6a5143954a3f6f800eb1ee97b0: Status 404 returned error can't find the container with id 5dfc5d397c13ece805496c0013490bb47b329c6a5143954a3f6f800eb1ee97b0 Jun 10 11:19:55.168249 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.168216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:55.241467 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.241439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:55.822872 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.822832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c4df7fb7-rr7gg" event={"ID":"42e93c49-6788-4c87-8349-6845939093dc","Type":"ContainerStarted","Data":"5dfc5d397c13ece805496c0013490bb47b329c6a5143954a3f6f800eb1ee97b0"} Jun 10 11:19:55.824610 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.824583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" event={"ID":"4d76327c-3e5b-44c4-bded-f0d22fea289a","Type":"ContainerStarted","Data":"78211c38ee625d6dfda0f6b7be9bed8456a17c9682e80d72444695c3afbc7395"} Jun 10 11:19:55.824861 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.824841 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:55.830323 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.830297 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" Jun 10 11:19:55.864772 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:55.864708 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vsb69" podStartSLOduration=3.208584692 podStartE2EDuration="4.864689275s" totalImagesPullingTime="1.656104583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:55.863783834 +0000 UTC m=+75.909959843" watchObservedRunningTime="2026-06-10 11:19:55.864689275 +0000 UTC m=+75.910865283" Jun 10 11:19:56.044909 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:56.044860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:56.138742 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:56.138653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:56.379933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:56.379890 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:56.539960 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:56.539923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:56.641131 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:56.641095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:58.840299 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:58.840259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c4df7fb7-rr7gg" event={"ID":"42e93c49-6788-4c87-8349-6845939093dc","Type":"ContainerStarted","Data":"c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132"} Jun 10 11:19:58.992777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:58.992732 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:59.861090 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:59.861055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:19:59.962690 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:19:59.962633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.068442 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.068402 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.172753 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.172681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.274629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.274573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.451086 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.451000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.534201 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.534119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.548024 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.547942 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c4df7fb7-rr7gg" podStartSLOduration=3.276930332 podStartE2EDuration="6.547919402s" totalImagesPullingTime="3.27098907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:58.861486367 +0000 UTC m=+78.907662376" watchObservedRunningTime="2026-06-10 11:20:00.547919402 +0000 UTC m=+80.594095411" Jun 10 11:20:00.548327 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.548300 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95xkq"] Jun 10 11:20:00.551688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.551667 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.554434 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.554412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 11:20:00.554582 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.554566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 11:20:00.555172 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.555152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 11:20:00.555743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.555580 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 11:20:00.556073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.556046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d9zgw\"" Jun 10 11:20:00.616308 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.616276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.631148 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-textfile\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631369 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-accelerators-collector-config\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-sys\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-tls\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631506 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5988075b-709b-4d27-a60c-09296aaca82b-metrics-client-ca\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631650 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-root\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631650 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdm4\" (UniqueName: \"kubernetes.io/projected/5988075b-709b-4d27-a60c-09296aaca82b-kube-api-access-xkdm4\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631650 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-wtmp\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.631788 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.631702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.732914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.732821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5988075b-709b-4d27-a60c-09296aaca82b-metrics-client-ca\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.732914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.732883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-root\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.732914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.732924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdm4\" (UniqueName: \"kubernetes.io/projected/5988075b-709b-4d27-a60c-09296aaca82b-kube-api-access-xkdm4\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.732957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-wtmp\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-root\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-textfile\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-accelerators-collector-config\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-wtmp\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-sys\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733522 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5988075b-709b-4d27-a60c-09296aaca82b-sys\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733522 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-tls\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733589 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5988075b-709b-4d27-a60c-09296aaca82b-metrics-client-ca\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733663 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733644 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-accelerators-collector-config\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.733818 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.733794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-textfile\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.735928 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.735906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.736529 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.736503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5988075b-709b-4d27-a60c-09296aaca82b-node-exporter-tls\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.746687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.746661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdm4\" (UniqueName: \"kubernetes.io/projected/5988075b-709b-4d27-a60c-09296aaca82b-kube-api-access-xkdm4\") pod \"node-exporter-95xkq\" (UID: \"5988075b-709b-4d27-a60c-09296aaca82b\") " pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.747689 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.747653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.840193 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.840153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:00.863662 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.863623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95xkq" Jun 10 11:20:00.876933 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:20:00.876897 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5988075b_709b_4d27_a60c_09296aaca82b.slice/crio-3516a009764065ca5a82363dba5637432175d84c21c96797e99e859064bf8717 WatchSource:0}: Error finding container 3516a009764065ca5a82363dba5637432175d84c21c96797e99e859064bf8717: Status 404 returned error can't find the container with id 3516a009764065ca5a82363dba5637432175d84c21c96797e99e859064bf8717 Jun 10 11:20:00.933559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:00.933500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:01.239751 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:01.239717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:01.448569 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:01.448528 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:01.544626 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:01.544572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:01.854412 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:01.854379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95xkq" event={"ID":"5988075b-709b-4d27-a60c-09296aaca82b","Type":"ContainerStarted","Data":"3516a009764065ca5a82363dba5637432175d84c21c96797e99e859064bf8717"} Jun 10 11:20:01.878128 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:01.878095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:02.345941 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:02.345906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:02.816080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:02.816051 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xvw65" Jun 10 11:20:02.859785 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:02.859752 2576 generic.go:356] "Generic (PLEG): container finished" podID="5988075b-709b-4d27-a60c-09296aaca82b" containerID="bb53b92fe2978d327145d6a8201d112f31b64bafda41451d0e731a9ceab3728a" exitCode=0 Jun 10 11:20:02.860036 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:02.859792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95xkq" event={"ID":"5988075b-709b-4d27-a60c-09296aaca82b","Type":"ContainerDied","Data":"bb53b92fe2978d327145d6a8201d112f31b64bafda41451d0e731a9ceab3728a"} Jun 10 11:20:03.234841 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.234731 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:03.332881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.332848 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:03.568884 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.568851 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:03.658001 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.657932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:03.858642 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.858559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:03.869195 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.869164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95xkq" event={"ID":"5988075b-709b-4d27-a60c-09296aaca82b","Type":"ContainerStarted","Data":"8b68d72f465eb3a5dfbadefc54566b6616cddbcde4c3d667ba12551fa7b70ad8"} Jun 10 11:20:03.869375 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.869217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95xkq" event={"ID":"5988075b-709b-4d27-a60c-09296aaca82b","Type":"ContainerStarted","Data":"42d00b9cc8b5a904bc75f64c08dc63d1556715c2d388ec8ce96a87b0af282e2a"} Jun 10 11:20:03.893567 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:03.893505 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95xkq" podStartSLOduration=2.853656312 podStartE2EDuration="3.893488565s" totalImagesPullingTime="954.136485ms" totalInitContainerRuntime="85.695768ms" isStatefulPod=true podCreationTimestamp="2026-06-10 11:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:03.891351257 +0000 UTC m=+83.937527289" watchObservedRunningTime="2026-06-10 11:20:03.893488565 +0000 UTC m=+83.939664551" Jun 10 11:20:04.060742 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.060702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:04.161662 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.161571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:04.261569 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.261532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:04.469707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.469615 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:20:04.469707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.469688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:20:04.475376 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.475342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:20:04.877940 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:04.877907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:20:05.051753 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.051708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:05.156620 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.156529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:05.278189 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.278150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:05.345682 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.345648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:05.464372 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.464272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:05.576582 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.576540 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:05.920148 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:05.920111 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:06.998049 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:06.998011 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:09.662085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:09.662041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:09.774881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:09.774852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:20:10.100026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:10.099951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:10.199043 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:10.199008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:10.716819 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:10.716769 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-595fc7bbb4-4n27z"] Jun 10 11:20:10.800853 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:10.800813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:10.900836 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:10.900805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:11.032739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:11.032702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:11.137552 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:11.137520 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:11.242451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:11.242402 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:12.007504 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:12.007460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:13.915655 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:13.915616 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-2cj7h" event={"ID":"ee94c9f0-311f-4fd7-a138-2f02b4a77366","Type":"ContainerStarted","Data":"71f8eb6ffdd16747e8cbcc1a8320ef0201597151025f576e63d976252e6641ca"} Jun 10 11:20:13.916117 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:13.916037 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:20:13.917545 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:13.917514 2576 patch_prober.go:28] interesting pod/downloads-6657875f97-2cj7h container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.18:8080/\": dial tcp 10.132.0.18:8080: connect: connection refused" start-of-body= Jun 10 11:20:13.917678 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:13.917571 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-2cj7h" podUID="ee94c9f0-311f-4fd7-a138-2f02b4a77366" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.18:8080/\": dial tcp 10.132.0.18:8080: connect: connection refused" Jun 10 11:20:13.940123 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:13.940057 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-2cj7h" podStartSLOduration=3.813701359 podStartE2EDuration="25.940039504s" totalImagesPullingTime="22.126338145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:13.937813171 +0000 UTC m=+93.983989183" watchObservedRunningTime="2026-06-10 11:20:13.940039504 +0000 UTC m=+93.986215490" Jun 10 11:20:14.935235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:14.935181 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-2cj7h" Jun 10 11:20:16.935075 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:16.935036 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:17.010469 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.010428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:17.035718 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.035677 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c4df7fb7-rr7gg"] Jun 10 11:20:17.180233 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.180198 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:17.281489 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.281405 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:17.383719 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.383682 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:17.486228 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.486192 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:17.761101 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:17.761066 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-czk77" Jun 10 11:20:18.210241 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:18.210200 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:18.311763 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:18.311726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:20.634866 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:20.634819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:20.717314 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:20.717277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:20.995660 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:20.995563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:21.096252 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:21.096195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:23.130367 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:23.130331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:23.226874 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:23.226840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:23.291822 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:23.291792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:29.984488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:29.984450 2576 generic.go:356] "Generic (PLEG): container finished" podID="edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b" containerID="cedd8824b16d38159f87f93ae3b8c6dd3cc314c6e073c4e3984b256cd9cc81df" exitCode=0 Jun 10 11:20:29.985008 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:29.984531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6jznh" event={"ID":"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b","Type":"ContainerDied","Data":"cedd8824b16d38159f87f93ae3b8c6dd3cc314c6e073c4e3984b256cd9cc81df"} Jun 10 11:20:29.985008 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:29.984908 2576 scope.go:117] "RemoveContainer" containerID="cedd8824b16d38159f87f93ae3b8c6dd3cc314c6e073c4e3984b256cd9cc81df" Jun 10 11:20:30.990318 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:30.990285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6jznh" event={"ID":"edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b","Type":"ContainerStarted","Data":"881487ecfd8f5b03f37a9318d3bd4a669168257fabe4624eff8920fbce99e9d0"} Jun 10 11:20:35.659370 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:35.659337 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:35.739958 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:35.739915 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" podUID="45a43777-163f-47c0-a261-e875ee1bd02a" containerName="registry" containerID="cri-o://6bdd926670f7ad1998e54468fed7df54e7a18e43460a48ef0456e2d664978160" gracePeriod=30 Jun 10 11:20:35.744833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:35.744803 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:36.010799 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.010764 2576 generic.go:356] "Generic (PLEG): container finished" podID="45a43777-163f-47c0-a261-e875ee1bd02a" containerID="6bdd926670f7ad1998e54468fed7df54e7a18e43460a48ef0456e2d664978160" exitCode=0 Jun 10 11:20:36.010950 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.010844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" event={"ID":"45a43777-163f-47c0-a261-e875ee1bd02a","Type":"ContainerDied","Data":"6bdd926670f7ad1998e54468fed7df54e7a18e43460a48ef0456e2d664978160"} Jun 10 11:20:36.010950 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.010930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" event={"ID":"45a43777-163f-47c0-a261-e875ee1bd02a","Type":"ContainerDied","Data":"b4914887ed13ca9d731938271d4116553ca3d85a9d0a0838c03d456f24f3f235"} Jun 10 11:20:36.010950 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.010945 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4914887ed13ca9d731938271d4116553ca3d85a9d0a0838c03d456f24f3f235" Jun 10 11:20:36.030776 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.030739 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:20:36.134343 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-trusted-ca\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134343 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134352 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-image-registry-private-configuration\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134372 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-installation-pull-secrets\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134422 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-bound-sa-token\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-registry-certificates\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134566 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtwp6\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-kube-api-access-qtwp6\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.134604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.134591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45a43777-163f-47c0-a261-e875ee1bd02a-ca-trust-extracted\") pod \"45a43777-163f-47c0-a261-e875ee1bd02a\" (UID: \"45a43777-163f-47c0-a261-e875ee1bd02a\") " Jun 10 11:20:36.135147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.135089 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:36.135147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.135106 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:36.137295 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.137266 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:36.137410 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.137358 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:36.137480 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.137451 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-kube-api-access-qtwp6" (OuterVolumeSpecName: "kube-api-access-qtwp6") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "kube-api-access-qtwp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:36.137544 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.137476 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:36.137597 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.137564 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:36.145332 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.145304 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a43777-163f-47c0-a261-e875ee1bd02a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "45a43777-163f-47c0-a261-e875ee1bd02a" (UID: "45a43777-163f-47c0-a261-e875ee1bd02a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236063 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-trusted-ca\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236108 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-image-registry-private-configuration\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236120 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45a43777-163f-47c0-a261-e875ee1bd02a-installation-pull-secrets\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236131 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-registry-tls\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236139 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-bound-sa-token\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236146 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45a43777-163f-47c0-a261-e875ee1bd02a-registry-certificates\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236154 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtwp6\" (UniqueName: \"kubernetes.io/projected/45a43777-163f-47c0-a261-e875ee1bd02a-kube-api-access-qtwp6\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:36.236166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:36.236163 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45a43777-163f-47c0-a261-e875ee1bd02a-ca-trust-extracted\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:37.014782 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:37.014748 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595fc7bbb4-4n27z" Jun 10 11:20:37.040489 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:37.040454 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-595fc7bbb4-4n27z"] Jun 10 11:20:37.044207 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:37.044178 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-595fc7bbb4-4n27z"] Jun 10 11:20:38.426785 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:38.426752 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45a43777-163f-47c0-a261-e875ee1bd02a" path="/var/lib/kubelet/pods/45a43777-163f-47c0-a261-e875ee1bd02a/volumes" Jun 10 11:20:42.063541 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.063491 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58c4df7fb7-rr7gg" podUID="42e93c49-6788-4c87-8349-6845939093dc" containerName="console" containerID="cri-o://c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132" gracePeriod=15 Jun 10 11:20:42.381716 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.381688 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:20:42.489720 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.489683 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-serving-cert\") pod \"42e93c49-6788-4c87-8349-6845939093dc\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " Jun 10 11:20:42.489907 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.489744 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q47nf\" (UniqueName: \"kubernetes.io/projected/42e93c49-6788-4c87-8349-6845939093dc-kube-api-access-q47nf\") pod \"42e93c49-6788-4c87-8349-6845939093dc\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " Jun 10 11:20:42.489907 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.489780 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-oauth-serving-cert\") pod \"42e93c49-6788-4c87-8349-6845939093dc\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " Jun 10 11:20:42.489907 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.489811 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-service-ca\") pod \"42e93c49-6788-4c87-8349-6845939093dc\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " Jun 10 11:20:42.489907 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.489846 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-console-config\") pod \"42e93c49-6788-4c87-8349-6845939093dc\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " Jun 10 11:20:42.490154 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.489926 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-oauth-config\") pod \"42e93c49-6788-4c87-8349-6845939093dc\" (UID: \"42e93c49-6788-4c87-8349-6845939093dc\") " Jun 10 11:20:42.490226 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.490196 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42e93c49-6788-4c87-8349-6845939093dc" (UID: "42e93c49-6788-4c87-8349-6845939093dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:42.490283 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.490257 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "42e93c49-6788-4c87-8349-6845939093dc" (UID: "42e93c49-6788-4c87-8349-6845939093dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:42.490329 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.490285 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-console-config" (OuterVolumeSpecName: "console-config") pod "42e93c49-6788-4c87-8349-6845939093dc" (UID: "42e93c49-6788-4c87-8349-6845939093dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:42.492422 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.492386 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42e93c49-6788-4c87-8349-6845939093dc" (UID: "42e93c49-6788-4c87-8349-6845939093dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:42.492550 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.492423 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42e93c49-6788-4c87-8349-6845939093dc" (UID: "42e93c49-6788-4c87-8349-6845939093dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:42.492550 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.492484 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e93c49-6788-4c87-8349-6845939093dc-kube-api-access-q47nf" (OuterVolumeSpecName: "kube-api-access-q47nf") pod "42e93c49-6788-4c87-8349-6845939093dc" (UID: "42e93c49-6788-4c87-8349-6845939093dc"). InnerVolumeSpecName "kube-api-access-q47nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:42.590705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.590624 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-oauth-config\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:42.590705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.590652 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e93c49-6788-4c87-8349-6845939093dc-console-serving-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:42.590705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.590661 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q47nf\" (UniqueName: \"kubernetes.io/projected/42e93c49-6788-4c87-8349-6845939093dc-kube-api-access-q47nf\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:42.590705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.590670 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-oauth-serving-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:42.590705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.590679 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-service-ca\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:42.590705 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:42.590686 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e93c49-6788-4c87-8349-6845939093dc-console-config\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:20:43.046014 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.045951 2576 generic.go:356] "Generic (PLEG): container finished" podID="42e93c49-6788-4c87-8349-6845939093dc" containerID="c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132" exitCode=0 Jun 10 11:20:43.046175 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.046012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c4df7fb7-rr7gg" event={"ID":"42e93c49-6788-4c87-8349-6845939093dc","Type":"ContainerDied","Data":"c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132"} Jun 10 11:20:43.046175 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.046025 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c4df7fb7-rr7gg" Jun 10 11:20:43.046175 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.046092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c4df7fb7-rr7gg" event={"ID":"42e93c49-6788-4c87-8349-6845939093dc","Type":"ContainerDied","Data":"5dfc5d397c13ece805496c0013490bb47b329c6a5143954a3f6f800eb1ee97b0"} Jun 10 11:20:43.046175 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.046113 2576 scope.go:117] "RemoveContainer" containerID="c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132" Jun 10 11:20:43.055453 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.055435 2576 scope.go:117] "RemoveContainer" containerID="c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132" Jun 10 11:20:43.055733 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:20:43.055715 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132\": container with ID starting with c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132 not found: ID does not exist" containerID="c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132" Jun 10 11:20:43.055781 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.055741 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132"} err="failed to get container status \"c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132\": rpc error: code = NotFound desc = could not find container \"c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132\": container with ID starting with c38d010a27eb134e7d1d21f50741d20234a83af3e3b7e07ea1d75268ddd2b132 not found: ID does not exist" Jun 10 11:20:43.070209 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.070182 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c4df7fb7-rr7gg"] Jun 10 11:20:43.075125 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:43.075095 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58c4df7fb7-rr7gg"] Jun 10 11:20:44.052652 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:44.052619 2576 generic.go:356] "Generic (PLEG): container finished" podID="838145fc-a31a-47bc-9739-5f379a8eb77c" containerID="6c2c29fad921e7960fe2ff2d7cefa9e692e4df7c819e18015c3af10063ffc36e" exitCode=0 Jun 10 11:20:44.052819 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:44.052689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" event={"ID":"838145fc-a31a-47bc-9739-5f379a8eb77c","Type":"ContainerDied","Data":"6c2c29fad921e7960fe2ff2d7cefa9e692e4df7c819e18015c3af10063ffc36e"} Jun 10 11:20:44.053081 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:44.053062 2576 scope.go:117] "RemoveContainer" containerID="6c2c29fad921e7960fe2ff2d7cefa9e692e4df7c819e18015c3af10063ffc36e" Jun 10 11:20:44.427626 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:44.427535 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e93c49-6788-4c87-8349-6845939093dc" path="/var/lib/kubelet/pods/42e93c49-6788-4c87-8349-6845939093dc/volumes" Jun 10 11:20:45.058960 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:45.058927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6k848" event={"ID":"838145fc-a31a-47bc-9739-5f379a8eb77c","Type":"ContainerStarted","Data":"692d9e01bc697a1bfb35a59de86257ae7f40c8eafb0dc2f05aaf12023032953d"} Jun 10 11:20:49.877524 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:49.877481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:50.312305 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:50.312269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:54.092854 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:54.092815 2576 generic.go:356] "Generic (PLEG): container finished" podID="8164122d-d08b-4215-b793-d3bc6cbb87d6" containerID="7b3a3c104a7a1b3a16d5583b05d31d808db69c1ef6739f33fac2dfe9c9c90c24" exitCode=0 Jun 10 11:20:54.092854 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:54.092860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" event={"ID":"8164122d-d08b-4215-b793-d3bc6cbb87d6","Type":"ContainerDied","Data":"7b3a3c104a7a1b3a16d5583b05d31d808db69c1ef6739f33fac2dfe9c9c90c24"} Jun 10 11:20:54.093308 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:54.093168 2576 scope.go:117] "RemoveContainer" containerID="7b3a3c104a7a1b3a16d5583b05d31d808db69c1ef6739f33fac2dfe9c9c90c24" Jun 10 11:20:55.098933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:55.098895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2ft7r" event={"ID":"8164122d-d08b-4215-b793-d3bc6cbb87d6","Type":"ContainerStarted","Data":"5a0e69f73e9971364237ecfaa1a0dc72cd1e68d651ae3027a405291ae34ed729"} Jun 10 11:20:59.003021 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.002965 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df69bfddd-r9pjk"] Jun 10 11:20:59.003387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.003252 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e93c49-6788-4c87-8349-6845939093dc" containerName="console" Jun 10 11:20:59.003387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.003262 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e93c49-6788-4c87-8349-6845939093dc" containerName="console" Jun 10 11:20:59.003387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.003278 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a43777-163f-47c0-a261-e875ee1bd02a" containerName="registry" Jun 10 11:20:59.003387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.003283 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a43777-163f-47c0-a261-e875ee1bd02a" containerName="registry" Jun 10 11:20:59.003387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.003354 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a43777-163f-47c0-a261-e875ee1bd02a" containerName="registry" Jun 10 11:20:59.003387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.003362 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e93c49-6788-4c87-8349-6845939093dc" containerName="console" Jun 10 11:20:59.023536 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.023508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.029240 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.029212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:20:59.029839 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.029818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:20:59.030782 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.030763 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:20:59.031097 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.031036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:20:59.031097 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.031036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:20:59.034962 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.034942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x9nhm\"" Jun 10 11:20:59.037247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.037223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df69bfddd-r9pjk"] Jun 10 11:20:59.039426 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.039407 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 11:20:59.069018 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.068963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:59.129399 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-serving-cert\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.129590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-trusted-ca-bundle\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.129590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nqfg\" (UniqueName: \"kubernetes.io/projected/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-kube-api-access-5nqfg\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.129590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-service-ca\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.129590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-oauth-serving-cert\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.129590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-oauth-config\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.129590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.129571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-config\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.197828 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.197792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:59.230939 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.230902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-config\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231153 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.230952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-serving-cert\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231153 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-trusted-ca-bundle\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231153 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nqfg\" (UniqueName: \"kubernetes.io/projected/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-kube-api-access-5nqfg\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231153 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-service-ca\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231399 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-oauth-serving-cert\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231399 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-oauth-config\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.231868 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-config\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.232000 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.231840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-service-ca\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.232196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.232168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-oauth-serving-cert\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.232315 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.232287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-trusted-ca-bundle\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.233693 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.233666 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-oauth-config\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.233794 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.233759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-serving-cert\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.242590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.242565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nqfg\" (UniqueName: \"kubernetes.io/projected/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-kube-api-access-5nqfg\") pod \"console-6df69bfddd-r9pjk\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.269218 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.269143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:59.333871 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.333842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:20:59.543492 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.543468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df69bfddd-r9pjk"] Jun 10 11:20:59.546078 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:20:59.546051 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa96a92d_f41b_4c3e_83de_cf18f26d5f9f.slice/crio-9ae0a310f91fce783de4199532a463c1c4261842c85a3ed88585e2f092dad879 WatchSource:0}: Error finding container 9ae0a310f91fce783de4199532a463c1c4261842c85a3ed88585e2f092dad879: Status 404 returned error can't find the container with id 9ae0a310f91fce783de4199532a463c1c4261842c85a3ed88585e2f092dad879 Jun 10 11:20:59.778336 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.778300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:20:59.879328 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:20:59.879246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:21:00.124900 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:00.124850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df69bfddd-r9pjk" event={"ID":"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f","Type":"ContainerStarted","Data":"dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df"} Jun 10 11:21:00.125300 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:00.124910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df69bfddd-r9pjk" event={"ID":"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f","Type":"ContainerStarted","Data":"9ae0a310f91fce783de4199532a463c1c4261842c85a3ed88585e2f092dad879"} Jun 10 11:21:00.156431 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:00.156320 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df69bfddd-r9pjk" podStartSLOduration=2.156291761 podStartE2EDuration="2.156291761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:21:00.155551805 +0000 UTC m=+140.201727812" watchObservedRunningTime="2026-06-10 11:21:00.156291761 +0000 UTC m=+140.202467769" Jun 10 11:21:09.334127 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:09.334078 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:21:09.334127 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:09.334143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:21:09.338909 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:09.338889 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:21:10.168711 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:10.168676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:21:10.357446 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:10.357410 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:21:10.417941 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:10.417904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:21:10.481700 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:10.481614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:21:15.007528 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:15.007493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:21:15.105963 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:15.105918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:21:31.622909 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:21:31.622827 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:00.997699 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:00.997664 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:01.098615 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:01.098584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:05.157058 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:05.157013 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:05.219026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:05.218993 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:07.510248 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:07.510203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:07.974264 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:07.974230 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8d4fcddd-xxjsn"] Jun 10 11:22:07.976783 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:07.976760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:07.992284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:07.992257 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8d4fcddd-xxjsn"] Jun 10 11:22:08.027714 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.027648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:08.061654 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-config\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.061765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f22r\" (UniqueName: \"kubernetes.io/projected/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-kube-api-access-2f22r\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.061765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-trusted-ca-bundle\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.061829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-oauth-config\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.061829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-oauth-serving-cert\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.061829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-service-ca\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.061829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.061824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-serving-cert\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.162964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f22r\" (UniqueName: \"kubernetes.io/projected/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-kube-api-access-2f22r\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-trusted-ca-bundle\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-oauth-config\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-oauth-serving-cert\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-service-ca\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-serving-cert\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-config\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.163931 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-oauth-serving-cert\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.164062 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-config\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.164139 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.163957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-service-ca\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.164365 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.164342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-trusted-ca-bundle\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.165765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.165742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-oauth-config\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.165852 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.165836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-serving-cert\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.172773 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.172746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f22r\" (UniqueName: \"kubernetes.io/projected/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-kube-api-access-2f22r\") pod \"console-5b8d4fcddd-xxjsn\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.287547 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.287513 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:08.433355 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:08.433193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8d4fcddd-xxjsn"] Jun 10 11:22:08.435915 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:22:08.435893 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ed9d6c_1f05_431a_9dfd_480ca0158fc3.slice/crio-d777c5991508bc53a1f375eb54405e9506a59359368517612c1b6dd7c46c9630 WatchSource:0}: Error finding container d777c5991508bc53a1f375eb54405e9506a59359368517612c1b6dd7c46c9630: Status 404 returned error can't find the container with id d777c5991508bc53a1f375eb54405e9506a59359368517612c1b6dd7c46c9630 Jun 10 11:22:09.385135 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:09.385090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8d4fcddd-xxjsn" event={"ID":"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3","Type":"ContainerStarted","Data":"fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593"} Jun 10 11:22:09.385530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:09.385191 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8d4fcddd-xxjsn" event={"ID":"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3","Type":"ContainerStarted","Data":"d777c5991508bc53a1f375eb54405e9506a59359368517612c1b6dd7c46c9630"} Jun 10 11:22:09.421571 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:09.421515 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b8d4fcddd-xxjsn" podStartSLOduration=2.421499268 podStartE2EDuration="2.421499268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:22:09.42009454 +0000 UTC m=+209.466270546" watchObservedRunningTime="2026-06-10 11:22:09.421499268 +0000 UTC m=+209.467675290" Jun 10 11:22:17.130609 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:17.130576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:17.226269 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:17.226243 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:18.288181 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.288138 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:18.288571 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.288204 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:18.293045 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.293022 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:18.421248 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.421222 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:22:18.477643 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.477611 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df69bfddd-r9pjk"] Jun 10 11:22:18.595131 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.595052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:18.692938 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.692907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:18.794459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:18.794431 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:20.635256 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:20.635222 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:20.735240 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:20.735206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:20.835321 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:20.835288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:22:43.505461 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.505424 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6df69bfddd-r9pjk" podUID="aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" containerName="console" containerID="cri-o://dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df" gracePeriod=15 Jun 10 11:22:43.750431 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.750405 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:22:43.849301 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849265 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-oauth-config\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-trusted-ca-bundle\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849353 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-oauth-serving-cert\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849368 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-config\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849388 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-service-ca\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849417 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nqfg\" (UniqueName: \"kubernetes.io/projected/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-kube-api-access-5nqfg\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849436 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-serving-cert\") pod \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\" (UID: \"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f\") " Jun 10 11:22:43.849882 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849852 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:22:43.849956 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849888 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:22:43.849956 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849901 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:22:43.849956 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.849913 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-config" (OuterVolumeSpecName: "console-config") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:22:43.851617 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.851587 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:22:43.851766 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.851742 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-kube-api-access-5nqfg" (OuterVolumeSpecName: "kube-api-access-5nqfg") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "kube-api-access-5nqfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:22:43.851766 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.851757 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" (UID: "aa96a92d-f41b-4c3e-83de-cf18f26d5f9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:22:43.950122 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950083 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-oauth-config\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:43.950122 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950113 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-trusted-ca-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:43.950122 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950122 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-oauth-serving-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:43.950122 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950134 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-config\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:43.950371 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950142 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-service-ca\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:43.950371 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950150 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nqfg\" (UniqueName: \"kubernetes.io/projected/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-kube-api-access-5nqfg\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:43.950371 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:43.950158 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f-console-serving-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:22:44.510822 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.510782 2576 generic.go:356] "Generic (PLEG): container finished" podID="aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" containerID="dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df" exitCode=0 Jun 10 11:22:44.511320 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.510834 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df69bfddd-r9pjk" Jun 10 11:22:44.511320 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.510869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df69bfddd-r9pjk" event={"ID":"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f","Type":"ContainerDied","Data":"dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df"} Jun 10 11:22:44.511320 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.510921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df69bfddd-r9pjk" event={"ID":"aa96a92d-f41b-4c3e-83de-cf18f26d5f9f","Type":"ContainerDied","Data":"9ae0a310f91fce783de4199532a463c1c4261842c85a3ed88585e2f092dad879"} Jun 10 11:22:44.511320 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.510942 2576 scope.go:117] "RemoveContainer" containerID="dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df" Jun 10 11:22:44.518901 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.518862 2576 scope.go:117] "RemoveContainer" containerID="dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df" Jun 10 11:22:44.519209 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:22:44.519187 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df\": container with ID starting with dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df not found: ID does not exist" containerID="dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df" Jun 10 11:22:44.519261 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.519218 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df"} err="failed to get container status \"dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df\": rpc error: code = NotFound desc = could not find container \"dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df\": container with ID starting with dde0fe063348ed0e44e38e85eac38c22231a960af60515f3119188152f73e7df not found: ID does not exist" Jun 10 11:22:44.529035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.529013 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df69bfddd-r9pjk"] Jun 10 11:22:44.532525 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:44.532498 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df69bfddd-r9pjk"] Jun 10 11:22:46.426927 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:22:46.426892 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" path="/var/lib/kubelet/pods/aa96a92d-f41b-4c3e-83de-cf18f26d5f9f/volumes" Jun 10 11:23:14.539312 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:14.539250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:14.637670 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:14.637634 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:15.145510 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.145453 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz"] Jun 10 11:23:15.145756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.145745 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" containerName="console" Jun 10 11:23:15.145798 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.145758 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" containerName="console" Jun 10 11:23:15.145836 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.145815 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa96a92d-f41b-4c3e-83de-cf18f26d5f9f" containerName="console" Jun 10 11:23:15.147707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.147693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.150453 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.150429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 11:23:15.150453 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.150444 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 11:23:15.150655 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.150513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qb58x\"" Jun 10 11:23:15.161381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.161362 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz"] Jun 10 11:23:15.281017 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.280957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nkpv\" (UniqueName: \"kubernetes.io/projected/708d19c0-c4ea-4665-af3c-70c34cdf13a9-kube-api-access-4nkpv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.281199 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.281048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.281199 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.281083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.381490 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.381449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.381490 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.381492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.381694 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.381533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nkpv\" (UniqueName: \"kubernetes.io/projected/708d19c0-c4ea-4665-af3c-70c34cdf13a9-kube-api-access-4nkpv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.381873 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.381850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.381932 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.381853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.391548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.391515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nkpv\" (UniqueName: \"kubernetes.io/projected/708d19c0-c4ea-4665-af3c-70c34cdf13a9-kube-api-access-4nkpv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.456350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.456253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:15.591795 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.591764 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz"] Jun 10 11:23:15.596149 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:23:15.596119 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708d19c0_c4ea_4665_af3c_70c34cdf13a9.slice/crio-4e049c6db364e7b144b43e3988ea4401e57ccf95c640568e6e3d4791f694110c WatchSource:0}: Error finding container 4e049c6db364e7b144b43e3988ea4401e57ccf95c640568e6e3d4791f694110c: Status 404 returned error can't find the container with id 4e049c6db364e7b144b43e3988ea4401e57ccf95c640568e6e3d4791f694110c Jun 10 11:23:15.619933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:15.619900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" event={"ID":"708d19c0-c4ea-4665-af3c-70c34cdf13a9","Type":"ContainerStarted","Data":"4e049c6db364e7b144b43e3988ea4401e57ccf95c640568e6e3d4791f694110c"} Jun 10 11:23:23.651087 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:23.651054 2576 generic.go:356] "Generic (PLEG): container finished" podID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerID="95a6f5896559e1841175b3f47ede4671527374687641a0985f00d27b03b6000d" exitCode=0 Jun 10 11:23:23.651466 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:23.651147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" event={"ID":"708d19c0-c4ea-4665-af3c-70c34cdf13a9","Type":"ContainerDied","Data":"95a6f5896559e1841175b3f47ede4671527374687641a0985f00d27b03b6000d"} Jun 10 11:23:26.664197 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:26.664161 2576 generic.go:356] "Generic (PLEG): container finished" podID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerID="8467562ff7313312325c8640a56500bd99f56bc93c7910a8cb22b73cb4cd5cbd" exitCode=0 Jun 10 11:23:26.664581 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:26.664207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" event={"ID":"708d19c0-c4ea-4665-af3c-70c34cdf13a9","Type":"ContainerDied","Data":"8467562ff7313312325c8640a56500bd99f56bc93c7910a8cb22b73cb4cd5cbd"} Jun 10 11:23:34.700688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:34.700650 2576 generic.go:356] "Generic (PLEG): container finished" podID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerID="d75968eecf1fe6156b8ace7072aa15733bd07318cc2c0be34e1284d6adb7c00f" exitCode=0 Jun 10 11:23:34.701128 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:34.700749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" event={"ID":"708d19c0-c4ea-4665-af3c-70c34cdf13a9","Type":"ContainerDied","Data":"d75968eecf1fe6156b8ace7072aa15733bd07318cc2c0be34e1284d6adb7c00f"} Jun 10 11:23:35.824654 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.824630 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:35.957540 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.957427 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nkpv\" (UniqueName: \"kubernetes.io/projected/708d19c0-c4ea-4665-af3c-70c34cdf13a9-kube-api-access-4nkpv\") pod \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " Jun 10 11:23:35.957540 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.957478 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-bundle\") pod \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " Jun 10 11:23:35.957540 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.957521 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-util\") pod \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\" (UID: \"708d19c0-c4ea-4665-af3c-70c34cdf13a9\") " Jun 10 11:23:35.958220 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.958193 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-bundle" (OuterVolumeSpecName: "bundle") pod "708d19c0-c4ea-4665-af3c-70c34cdf13a9" (UID: "708d19c0-c4ea-4665-af3c-70c34cdf13a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:23:35.959856 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.959837 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708d19c0-c4ea-4665-af3c-70c34cdf13a9-kube-api-access-4nkpv" (OuterVolumeSpecName: "kube-api-access-4nkpv") pod "708d19c0-c4ea-4665-af3c-70c34cdf13a9" (UID: "708d19c0-c4ea-4665-af3c-70c34cdf13a9"). InnerVolumeSpecName "kube-api-access-4nkpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:23:35.962041 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:35.962021 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-util" (OuterVolumeSpecName: "util") pod "708d19c0-c4ea-4665-af3c-70c34cdf13a9" (UID: "708d19c0-c4ea-4665-af3c-70c34cdf13a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:23:36.058677 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:36.058647 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:23:36.058677 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:36.058673 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nkpv\" (UniqueName: \"kubernetes.io/projected/708d19c0-c4ea-4665-af3c-70c34cdf13a9-kube-api-access-4nkpv\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:23:36.058677 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:36.058682 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/708d19c0-c4ea-4665-af3c-70c34cdf13a9-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:23:36.710431 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:36.710342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" event={"ID":"708d19c0-c4ea-4665-af3c-70c34cdf13a9","Type":"ContainerDied","Data":"4e049c6db364e7b144b43e3988ea4401e57ccf95c640568e6e3d4791f694110c"} Jun 10 11:23:36.710431 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:36.710371 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtcxpz" Jun 10 11:23:36.710431 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:36.710393 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e049c6db364e7b144b43e3988ea4401e57ccf95c640568e6e3d4791f694110c" Jun 10 11:23:40.372516 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:40.372263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:23:40.373410 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:40.373382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:23:40.383227 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:40.383202 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 11:23:41.502987 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:41.502933 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:42.822652 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:42.822579 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:43.416475 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416434 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt"] Jun 10 11:23:43.416781 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416764 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="util" Jun 10 11:23:43.416859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416784 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="util" Jun 10 11:23:43.416859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416801 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="extract" Jun 10 11:23:43.416859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416809 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="extract" Jun 10 11:23:43.416859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416826 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="pull" Jun 10 11:23:43.416859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416834 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="pull" Jun 10 11:23:43.417169 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.416914 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="708d19c0-c4ea-4665-af3c-70c34cdf13a9" containerName="extract" Jun 10 11:23:43.418672 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.418649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.421877 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.421851 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-l85tp\"" Jun 10 11:23:43.422299 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.422279 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:23:43.422427 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.422307 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 11:23:43.435533 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.435511 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt"] Jun 10 11:23:43.517650 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.517616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fef58ffc-2658-4de3-92c3-aa70549e33ba-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-chmnt\" (UID: \"fef58ffc-2658-4de3-92c3-aa70549e33ba\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.517828 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.517674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpl2\" (UniqueName: \"kubernetes.io/projected/fef58ffc-2658-4de3-92c3-aa70549e33ba-kube-api-access-2bpl2\") pod \"cert-manager-operator-controller-manager-57757f7cfc-chmnt\" (UID: \"fef58ffc-2658-4de3-92c3-aa70549e33ba\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.618398 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.618353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fef58ffc-2658-4de3-92c3-aa70549e33ba-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-chmnt\" (UID: \"fef58ffc-2658-4de3-92c3-aa70549e33ba\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.618572 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.618420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpl2\" (UniqueName: \"kubernetes.io/projected/fef58ffc-2658-4de3-92c3-aa70549e33ba-kube-api-access-2bpl2\") pod \"cert-manager-operator-controller-manager-57757f7cfc-chmnt\" (UID: \"fef58ffc-2658-4de3-92c3-aa70549e33ba\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.618746 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.618727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fef58ffc-2658-4de3-92c3-aa70549e33ba-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-chmnt\" (UID: \"fef58ffc-2658-4de3-92c3-aa70549e33ba\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.627646 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.627624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpl2\" (UniqueName: \"kubernetes.io/projected/fef58ffc-2658-4de3-92c3-aa70549e33ba-kube-api-access-2bpl2\") pod \"cert-manager-operator-controller-manager-57757f7cfc-chmnt\" (UID: \"fef58ffc-2658-4de3-92c3-aa70549e33ba\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.727934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.727843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" Jun 10 11:23:43.865110 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.865071 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt"] Jun 10 11:23:43.869329 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:23:43.869305 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef58ffc_2658_4de3_92c3_aa70549e33ba.slice/crio-43759cf97bd67d7db8ac4b6d52f4d5cfeef2433b2dde24e1a24c529bc5d750f8 WatchSource:0}: Error finding container 43759cf97bd67d7db8ac4b6d52f4d5cfeef2433b2dde24e1a24c529bc5d750f8: Status 404 returned error can't find the container with id 43759cf97bd67d7db8ac4b6d52f4d5cfeef2433b2dde24e1a24c529bc5d750f8 Jun 10 11:23:43.872119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:43.872102 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:23:44.742744 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:44.742710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" event={"ID":"fef58ffc-2658-4de3-92c3-aa70549e33ba","Type":"ContainerStarted","Data":"43759cf97bd67d7db8ac4b6d52f4d5cfeef2433b2dde24e1a24c529bc5d750f8"} Jun 10 11:23:45.282368 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:45.282333 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:45.341270 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:45.341234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:47.758621 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:47.758511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" event={"ID":"fef58ffc-2658-4de3-92c3-aa70549e33ba","Type":"ContainerStarted","Data":"f86b1df327367e08bbe49ca6069a6d2099dfcd754e5d06d785b056404fcda53f"} Jun 10 11:23:47.784456 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:47.784407 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-chmnt" podStartSLOduration=1.268770408 podStartE2EDuration="4.784391541s" totalImagesPullingTime="3.515621133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:23:47.782957285 +0000 UTC m=+307.829133294" watchObservedRunningTime="2026-06-10 11:23:47.784391541 +0000 UTC m=+307.830567552" Jun 10 11:23:48.061676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.061640 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:48.167739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.167687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:48.260699 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.260668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:48.413028 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.412933 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh"] Jun 10 11:23:48.416185 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.416167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.420128 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.420103 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qb58x\"" Jun 10 11:23:48.420250 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.420104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 11:23:48.421466 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.421448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 11:23:48.431050 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.431030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh"] Jun 10 11:23:48.452784 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.452754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8n52\" (UniqueName: \"kubernetes.io/projected/7920e229-62f2-4365-826d-4e48f5eb1040-kube-api-access-q8n52\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.452784 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.452786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.452964 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.452867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.553278 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.553244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8n52\" (UniqueName: \"kubernetes.io/projected/7920e229-62f2-4365-826d-4e48f5eb1040-kube-api-access-q8n52\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.553278 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.553284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.553497 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.553341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.553692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.553677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.553760 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.553718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.571889 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.571861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8n52\" (UniqueName: \"kubernetes.io/projected/7920e229-62f2-4365-826d-4e48f5eb1040-kube-api-access-q8n52\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.726472 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.726381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:48.889773 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:23:48.889741 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7920e229_62f2_4365_826d_4e48f5eb1040.slice/crio-53e1c9bab2e268b9e2b2b3d7ab5b63d77912a818cfcc2390fd66f744e05321a3 WatchSource:0}: Error finding container 53e1c9bab2e268b9e2b2b3d7ab5b63d77912a818cfcc2390fd66f744e05321a3: Status 404 returned error can't find the container with id 53e1c9bab2e268b9e2b2b3d7ab5b63d77912a818cfcc2390fd66f744e05321a3 Jun 10 11:23:48.893070 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:48.893042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh"] Jun 10 11:23:49.769202 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:49.769159 2576 generic.go:356] "Generic (PLEG): container finished" podID="7920e229-62f2-4365-826d-4e48f5eb1040" containerID="fe93f5221c8fcc57549142f179ea9fe2a808963364907e8b21ec7f11f8c95aa0" exitCode=0 Jun 10 11:23:49.769375 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:49.769212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" event={"ID":"7920e229-62f2-4365-826d-4e48f5eb1040","Type":"ContainerDied","Data":"fe93f5221c8fcc57549142f179ea9fe2a808963364907e8b21ec7f11f8c95aa0"} Jun 10 11:23:49.769375 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:49.769258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" event={"ID":"7920e229-62f2-4365-826d-4e48f5eb1040","Type":"ContainerStarted","Data":"53e1c9bab2e268b9e2b2b3d7ab5b63d77912a818cfcc2390fd66f744e05321a3"} Jun 10 11:23:51.345461 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:51.345426 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:51.877989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:51.877940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:51.978501 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:51.978469 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:53.714631 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.714594 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vbht5"] Jun 10 11:23:53.717946 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.717926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:53.721092 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.721066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 11:23:53.721191 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.721102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 11:23:53.722291 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.722273 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5d7lc\"" Jun 10 11:23:53.726557 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.726539 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vbht5"] Jun 10 11:23:53.783889 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.783859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbw2d\" (UniqueName: \"kubernetes.io/projected/6ca73b71-d57f-4a78-ba64-f05e74e1d267-kube-api-access-rbw2d\") pod \"cert-manager-cainjector-5d99449ffd-vbht5\" (UID: \"6ca73b71-d57f-4a78-ba64-f05e74e1d267\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:53.784080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.783916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ca73b71-d57f-4a78-ba64-f05e74e1d267-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vbht5\" (UID: \"6ca73b71-d57f-4a78-ba64-f05e74e1d267\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:53.884643 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.884602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ca73b71-d57f-4a78-ba64-f05e74e1d267-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vbht5\" (UID: \"6ca73b71-d57f-4a78-ba64-f05e74e1d267\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:53.884834 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.884656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbw2d\" (UniqueName: \"kubernetes.io/projected/6ca73b71-d57f-4a78-ba64-f05e74e1d267-kube-api-access-rbw2d\") pod \"cert-manager-cainjector-5d99449ffd-vbht5\" (UID: \"6ca73b71-d57f-4a78-ba64-f05e74e1d267\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:53.895147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.895118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ca73b71-d57f-4a78-ba64-f05e74e1d267-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vbht5\" (UID: \"6ca73b71-d57f-4a78-ba64-f05e74e1d267\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:53.896013 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:53.895992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbw2d\" (UniqueName: \"kubernetes.io/projected/6ca73b71-d57f-4a78-ba64-f05e74e1d267-kube-api-access-rbw2d\") pod \"cert-manager-cainjector-5d99449ffd-vbht5\" (UID: \"6ca73b71-d57f-4a78-ba64-f05e74e1d267\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:54.032674 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:54.032593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" Jun 10 11:23:54.181952 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:54.181902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vbht5"] Jun 10 11:23:54.184019 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:23:54.183992 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ca73b71_d57f_4a78_ba64_f05e74e1d267.slice/crio-89d0a180ebb3ab8e50f14fe085df0fd1459d97ef04e0845a0872f6256b06f1e4 WatchSource:0}: Error finding container 89d0a180ebb3ab8e50f14fe085df0fd1459d97ef04e0845a0872f6256b06f1e4: Status 404 returned error can't find the container with id 89d0a180ebb3ab8e50f14fe085df0fd1459d97ef04e0845a0872f6256b06f1e4 Jun 10 11:23:54.794542 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:54.794500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" event={"ID":"6ca73b71-d57f-4a78-ba64-f05e74e1d267","Type":"ContainerStarted","Data":"89d0a180ebb3ab8e50f14fe085df0fd1459d97ef04e0845a0872f6256b06f1e4"} Jun 10 11:23:55.802587 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:55.802543 2576 generic.go:356] "Generic (PLEG): container finished" podID="7920e229-62f2-4365-826d-4e48f5eb1040" containerID="733dcfef6b2e6a8e4c4014659f72971ecfc77368b51cf431bc8b041b6c1e86cc" exitCode=0 Jun 10 11:23:55.802587 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:55.802580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" event={"ID":"7920e229-62f2-4365-826d-4e48f5eb1040","Type":"ContainerDied","Data":"733dcfef6b2e6a8e4c4014659f72971ecfc77368b51cf431bc8b041b6c1e86cc"} Jun 10 11:23:56.810041 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:56.809997 2576 generic.go:356] "Generic (PLEG): container finished" podID="7920e229-62f2-4365-826d-4e48f5eb1040" containerID="6e2028dedf2991019bc6c77549e1e295d67e33fa766c848fa1c6237a64388599" exitCode=0 Jun 10 11:23:56.810041 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:56.810018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" event={"ID":"7920e229-62f2-4365-826d-4e48f5eb1040","Type":"ContainerDied","Data":"6e2028dedf2991019bc6c77549e1e295d67e33fa766c848fa1c6237a64388599"} Jun 10 11:23:57.815697 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:57.815658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" event={"ID":"6ca73b71-d57f-4a78-ba64-f05e74e1d267","Type":"ContainerStarted","Data":"3e78f9f3d89b4e10257e19ffa3f92e633fd975222a76f03c67e3d831ff39c627"} Jun 10 11:23:57.835681 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:57.835633 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vbht5" podStartSLOduration=2.074160142 podStartE2EDuration="4.83561612s" totalImagesPullingTime="2.761455978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:23:57.834136749 +0000 UTC m=+317.880312756" watchObservedRunningTime="2026-06-10 11:23:57.83561612 +0000 UTC m=+317.881792126" Jun 10 11:23:57.943745 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:57.943722 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:58.022494 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.022445 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8n52\" (UniqueName: \"kubernetes.io/projected/7920e229-62f2-4365-826d-4e48f5eb1040-kube-api-access-q8n52\") pod \"7920e229-62f2-4365-826d-4e48f5eb1040\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " Jun 10 11:23:58.022494 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.022500 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-bundle\") pod \"7920e229-62f2-4365-826d-4e48f5eb1040\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " Jun 10 11:23:58.022723 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.022523 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-util\") pod \"7920e229-62f2-4365-826d-4e48f5eb1040\" (UID: \"7920e229-62f2-4365-826d-4e48f5eb1040\") " Jun 10 11:23:58.022915 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.022880 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-bundle" (OuterVolumeSpecName: "bundle") pod "7920e229-62f2-4365-826d-4e48f5eb1040" (UID: "7920e229-62f2-4365-826d-4e48f5eb1040"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:23:58.024739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.024711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7920e229-62f2-4365-826d-4e48f5eb1040-kube-api-access-q8n52" (OuterVolumeSpecName: "kube-api-access-q8n52") pod "7920e229-62f2-4365-826d-4e48f5eb1040" (UID: "7920e229-62f2-4365-826d-4e48f5eb1040"). InnerVolumeSpecName "kube-api-access-q8n52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:23:58.027430 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.027409 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-util" (OuterVolumeSpecName: "util") pod "7920e229-62f2-4365-826d-4e48f5eb1040" (UID: "7920e229-62f2-4365-826d-4e48f5eb1040"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:23:58.123840 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.123753 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8n52\" (UniqueName: \"kubernetes.io/projected/7920e229-62f2-4365-826d-4e48f5eb1040-kube-api-access-q8n52\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:23:58.123840 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.123784 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:23:58.123840 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.123795 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7920e229-62f2-4365-826d-4e48f5eb1040-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:23:58.821644 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.821616 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" Jun 10 11:23:58.822080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.821644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm8xdh" event={"ID":"7920e229-62f2-4365-826d-4e48f5eb1040","Type":"ContainerDied","Data":"53e1c9bab2e268b9e2b2b3d7ab5b63d77912a818cfcc2390fd66f744e05321a3"} Jun 10 11:23:58.822080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:58.821686 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53e1c9bab2e268b9e2b2b3d7ab5b63d77912a818cfcc2390fd66f744e05321a3" Jun 10 11:23:59.182943 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:59.182860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:59.282959 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:59.282877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:23:59.950698 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:23:59.950665 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:00.538444 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538401 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gdkqf"] Jun 10 11:24:00.538755 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538738 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="pull" Jun 10 11:24:00.538827 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538758 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="pull" Jun 10 11:24:00.538827 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538769 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="extract" Jun 10 11:24:00.538827 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538778 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="extract" Jun 10 11:24:00.538827 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538805 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="util" Jun 10 11:24:00.538827 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538813 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="util" Jun 10 11:24:00.539098 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.538884 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7920e229-62f2-4365-826d-4e48f5eb1040" containerName="extract" Jun 10 11:24:00.541777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.541757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.544407 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.544389 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8tccx\"" Jun 10 11:24:00.556390 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.556368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gdkqf"] Jun 10 11:24:00.643588 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.643554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjspz\" (UniqueName: \"kubernetes.io/projected/f22b612a-22bd-4c5b-bbc0-e3faed0f37db-kube-api-access-pjspz\") pod \"cert-manager-59c77684cc-gdkqf\" (UID: \"f22b612a-22bd-4c5b-bbc0-e3faed0f37db\") " pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.643764 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.643595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f22b612a-22bd-4c5b-bbc0-e3faed0f37db-bound-sa-token\") pod \"cert-manager-59c77684cc-gdkqf\" (UID: \"f22b612a-22bd-4c5b-bbc0-e3faed0f37db\") " pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.744447 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.744411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjspz\" (UniqueName: \"kubernetes.io/projected/f22b612a-22bd-4c5b-bbc0-e3faed0f37db-kube-api-access-pjspz\") pod \"cert-manager-59c77684cc-gdkqf\" (UID: \"f22b612a-22bd-4c5b-bbc0-e3faed0f37db\") " pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.744447 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.744451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f22b612a-22bd-4c5b-bbc0-e3faed0f37db-bound-sa-token\") pod \"cert-manager-59c77684cc-gdkqf\" (UID: \"f22b612a-22bd-4c5b-bbc0-e3faed0f37db\") " pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.754991 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.754954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f22b612a-22bd-4c5b-bbc0-e3faed0f37db-bound-sa-token\") pod \"cert-manager-59c77684cc-gdkqf\" (UID: \"f22b612a-22bd-4c5b-bbc0-e3faed0f37db\") " pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.755178 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.755161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjspz\" (UniqueName: \"kubernetes.io/projected/f22b612a-22bd-4c5b-bbc0-e3faed0f37db-kube-api-access-pjspz\") pod \"cert-manager-59c77684cc-gdkqf\" (UID: \"f22b612a-22bd-4c5b-bbc0-e3faed0f37db\") " pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.850963 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.850865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gdkqf" Jun 10 11:24:00.983340 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:00.983232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gdkqf"] Jun 10 11:24:00.986053 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:00.986014 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf22b612a_22bd_4c5b_bbc0_e3faed0f37db.slice/crio-9971f56bdd1c4b40da6d0d07022aa6f70fb9382c1b0f3046f4a8633b9b3fa32a WatchSource:0}: Error finding container 9971f56bdd1c4b40da6d0d07022aa6f70fb9382c1b0f3046f4a8633b9b3fa32a: Status 404 returned error can't find the container with id 9971f56bdd1c4b40da6d0d07022aa6f70fb9382c1b0f3046f4a8633b9b3fa32a Jun 10 11:24:01.834488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:01.834451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gdkqf" event={"ID":"f22b612a-22bd-4c5b-bbc0-e3faed0f37db","Type":"ContainerStarted","Data":"7d5a0091ccc9f1ebf0f58dc4d2d50c4b39e74eb554c866b3b2497d759bf61de5"} Jun 10 11:24:01.834488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:01.834491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gdkqf" event={"ID":"f22b612a-22bd-4c5b-bbc0-e3faed0f37db","Type":"ContainerStarted","Data":"9971f56bdd1c4b40da6d0d07022aa6f70fb9382c1b0f3046f4a8633b9b3fa32a"} Jun 10 11:24:01.861328 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:01.861276 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gdkqf" podStartSLOduration=1.861261981 podStartE2EDuration="1.861261981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:01.859992042 +0000 UTC m=+321.906168041" watchObservedRunningTime="2026-06-10 11:24:01.861261981 +0000 UTC m=+321.907437987" Jun 10 11:24:04.662986 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:04.662948 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:04.763444 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:04.763411 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:06.439899 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.439865 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh"] Jun 10 11:24:06.444408 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.444389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.447300 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.447245 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 11:24:06.447433 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.447369 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qb58x\"" Jun 10 11:24:06.448367 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.448353 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 11:24:06.453744 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.453722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh"] Jun 10 11:24:06.487253 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.487215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.487437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.487275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzqx\" (UniqueName: \"kubernetes.io/projected/c5f43242-bc82-49dc-8326-e6c53af412a2-kube-api-access-2wzqx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.487437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.487332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.588217 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.588180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.588393 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.588230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzqx\" (UniqueName: \"kubernetes.io/projected/c5f43242-bc82-49dc-8326-e6c53af412a2-kube-api-access-2wzqx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.588393 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.588342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.588587 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.588569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.588679 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.588661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.597787 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.597758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzqx\" (UniqueName: \"kubernetes.io/projected/c5f43242-bc82-49dc-8326-e6c53af412a2-kube-api-access-2wzqx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.633932 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.633900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:06.754127 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.754044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:06.889131 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:06.888912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh"] Jun 10 11:24:06.891933 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:06.891894 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f43242_bc82_49dc_8326_e6c53af412a2.slice/crio-008c24debd9855d210271699e0557c4d8e882fe10130644edeb42cd24bd5b976 WatchSource:0}: Error finding container 008c24debd9855d210271699e0557c4d8e882fe10130644edeb42cd24bd5b976: Status 404 returned error can't find the container with id 008c24debd9855d210271699e0557c4d8e882fe10130644edeb42cd24bd5b976 Jun 10 11:24:07.862579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:07.862497 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerID="f210a5cdebcaa1332e6519b0cec2ac510919423651f62d39f5863bfaa02ee188" exitCode=0 Jun 10 11:24:07.862579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:07.862540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" event={"ID":"c5f43242-bc82-49dc-8326-e6c53af412a2","Type":"ContainerDied","Data":"f210a5cdebcaa1332e6519b0cec2ac510919423651f62d39f5863bfaa02ee188"} Jun 10 11:24:07.863004 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:07.862597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" event={"ID":"c5f43242-bc82-49dc-8326-e6c53af412a2","Type":"ContainerStarted","Data":"008c24debd9855d210271699e0557c4d8e882fe10130644edeb42cd24bd5b976"} Jun 10 11:24:08.868801 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:08.868766 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerID="3df7ff4a25aee82f2b6faa951cd2cdc68ddbda0684d5caebb4c567af4c79d193" exitCode=0 Jun 10 11:24:08.869225 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:08.868853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" event={"ID":"c5f43242-bc82-49dc-8326-e6c53af412a2","Type":"ContainerDied","Data":"3df7ff4a25aee82f2b6faa951cd2cdc68ddbda0684d5caebb4c567af4c79d193"} Jun 10 11:24:09.875337 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:09.875307 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerID="c972e865d5b3f2b5261ef40a67bf8ea55d22caba9f8a98e0d663894a2fc53ef3" exitCode=0 Jun 10 11:24:09.875721 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:09.875357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" event={"ID":"c5f43242-bc82-49dc-8326-e6c53af412a2","Type":"ContainerDied","Data":"c972e865d5b3f2b5261ef40a67bf8ea55d22caba9f8a98e0d663894a2fc53ef3"} Jun 10 11:24:10.775938 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:10.775898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:11.018870 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.018847 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:11.122752 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.122718 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-util\") pod \"c5f43242-bc82-49dc-8326-e6c53af412a2\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " Jun 10 11:24:11.122752 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.122756 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-bundle\") pod \"c5f43242-bc82-49dc-8326-e6c53af412a2\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " Jun 10 11:24:11.123053 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.122807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wzqx\" (UniqueName: \"kubernetes.io/projected/c5f43242-bc82-49dc-8326-e6c53af412a2-kube-api-access-2wzqx\") pod \"c5f43242-bc82-49dc-8326-e6c53af412a2\" (UID: \"c5f43242-bc82-49dc-8326-e6c53af412a2\") " Jun 10 11:24:11.123531 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.123504 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-bundle" (OuterVolumeSpecName: "bundle") pod "c5f43242-bc82-49dc-8326-e6c53af412a2" (UID: "c5f43242-bc82-49dc-8326-e6c53af412a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:24:11.125072 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.125045 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f43242-bc82-49dc-8326-e6c53af412a2-kube-api-access-2wzqx" (OuterVolumeSpecName: "kube-api-access-2wzqx") pod "c5f43242-bc82-49dc-8326-e6c53af412a2" (UID: "c5f43242-bc82-49dc-8326-e6c53af412a2"). InnerVolumeSpecName "kube-api-access-2wzqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:24:11.128108 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.128081 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-util" (OuterVolumeSpecName: "util") pod "c5f43242-bc82-49dc-8326-e6c53af412a2" (UID: "c5f43242-bc82-49dc-8326-e6c53af412a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:24:11.223683 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.223646 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wzqx\" (UniqueName: \"kubernetes.io/projected/c5f43242-bc82-49dc-8326-e6c53af412a2-kube-api-access-2wzqx\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:24:11.223683 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.223678 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:24:11.223683 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.223688 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f43242-bc82-49dc-8326-e6c53af412a2-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:24:11.885488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.885460 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" Jun 10 11:24:11.885488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.885465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhf5dh" event={"ID":"c5f43242-bc82-49dc-8326-e6c53af412a2","Type":"ContainerDied","Data":"008c24debd9855d210271699e0557c4d8e882fe10130644edeb42cd24bd5b976"} Jun 10 11:24:11.885695 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:11.885513 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="008c24debd9855d210271699e0557c4d8e882fe10130644edeb42cd24bd5b976" Jun 10 11:24:23.321934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:23.321861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:23.416621 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:23.416585 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:23.928875 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:23.928840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.116110 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.116079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.214275 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.214194 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.244719 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.244684 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87"] Jun 10 11:24:24.244963 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.244953 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="util" Jun 10 11:24:24.245033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.244966 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="util" Jun 10 11:24:24.245033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.244993 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="extract" Jun 10 11:24:24.245033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.244999 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="extract" Jun 10 11:24:24.245033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.245013 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="pull" Jun 10 11:24:24.245033 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.245018 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="pull" Jun 10 11:24:24.245181 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.245067 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f43242-bc82-49dc-8326-e6c53af412a2" containerName="extract" Jun 10 11:24:24.247861 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.247845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.250914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.250894 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 11:24:24.250914 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.250903 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vltlh\"" Jun 10 11:24:24.251121 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.250958 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 11:24:24.251319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.251300 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 11:24:24.251410 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.251334 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 11:24:24.259639 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.259616 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87"] Jun 10 11:24:24.328749 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.328711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmx9t\" (UniqueName: \"kubernetes.io/projected/91193c3c-a28b-422d-9a32-36fda13d0d5f-kube-api-access-hmx9t\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.329151 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.328757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91193c3c-a28b-422d-9a32-36fda13d0d5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.329151 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.328779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/91193c3c-a28b-422d-9a32-36fda13d0d5f-manifests\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.329151 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.328875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91193c3c-a28b-422d-9a32-36fda13d0d5f-tmp\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.329151 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.328908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/91193c3c-a28b-422d-9a32-36fda13d0d5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.402079 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.402048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.429350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.429313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91193c3c-a28b-422d-9a32-36fda13d0d5f-tmp\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.429350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.429354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/91193c3c-a28b-422d-9a32-36fda13d0d5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.429539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.429380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmx9t\" (UniqueName: \"kubernetes.io/projected/91193c3c-a28b-422d-9a32-36fda13d0d5f-kube-api-access-hmx9t\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.429539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.429416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91193c3c-a28b-422d-9a32-36fda13d0d5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.429539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.429437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/91193c3c-a28b-422d-9a32-36fda13d0d5f-manifests\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.429841 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.429810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/91193c3c-a28b-422d-9a32-36fda13d0d5f-manifests\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.431774 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.431754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91193c3c-a28b-422d-9a32-36fda13d0d5f-tmp\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.431894 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.431877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/91193c3c-a28b-422d-9a32-36fda13d0d5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.431940 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.431913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91193c3c-a28b-422d-9a32-36fda13d0d5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.439524 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.439493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmx9t\" (UniqueName: \"kubernetes.io/projected/91193c3c-a28b-422d-9a32-36fda13d0d5f-kube-api-access-hmx9t\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-mhh87\" (UID: \"91193c3c-a28b-422d-9a32-36fda13d0d5f\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.502620 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.502535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.558482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.558453 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:24.603419 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.603387 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.697848 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.697811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87"] Jun 10 11:24:24.701352 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:24.701325 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91193c3c_a28b_422d_9a32_36fda13d0d5f.slice/crio-5012de8a1e1f8f01cde0a5a3fc2e9ec7eca8a23e430b4236dac1da5e52cf3c25 WatchSource:0}: Error finding container 5012de8a1e1f8f01cde0a5a3fc2e9ec7eca8a23e430b4236dac1da5e52cf3c25: Status 404 returned error can't find the container with id 5012de8a1e1f8f01cde0a5a3fc2e9ec7eca8a23e430b4236dac1da5e52cf3c25 Jun 10 11:24:24.709687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.709657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.771676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.771591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.871793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.871756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:24.942605 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.942572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" event={"ID":"91193c3c-a28b-422d-9a32-36fda13d0d5f","Type":"ContainerStarted","Data":"5012de8a1e1f8f01cde0a5a3fc2e9ec7eca8a23e430b4236dac1da5e52cf3c25"} Jun 10 11:24:24.971396 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:24.971369 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:27.960335 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:27.960249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" event={"ID":"91193c3c-a28b-422d-9a32-36fda13d0d5f","Type":"ContainerStarted","Data":"055de4e82522eee2557cfa0315a64ac066ddc5c0999e149446d466793b6e6537"} Jun 10 11:24:28.965836 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:28.965751 2576 generic.go:356] "Generic (PLEG): container finished" podID="91193c3c-a28b-422d-9a32-36fda13d0d5f" containerID="055de4e82522eee2557cfa0315a64ac066ddc5c0999e149446d466793b6e6537" exitCode=0 Jun 10 11:24:28.966217 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:28.965839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" event={"ID":"91193c3c-a28b-422d-9a32-36fda13d0d5f","Type":"ContainerDied","Data":"055de4e82522eee2557cfa0315a64ac066ddc5c0999e149446d466793b6e6537"} Jun 10 11:24:29.972296 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:29.972261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" event={"ID":"91193c3c-a28b-422d-9a32-36fda13d0d5f","Type":"ContainerStarted","Data":"a8f7f8068cfa75ebf09d5ea44e3d8818ae1bccb7e27db21c4afd1df6272b3b47"} Jun 10 11:24:29.972736 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:29.972411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:30.006968 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:30.006909 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" podStartSLOduration=1.714501654 podStartE2EDuration="6.00689163s" totalImagesPullingTime="3.298376913s" totalInitContainerRuntime="994.013063ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:30.004757098 +0000 UTC m=+350.050933107" watchObservedRunningTime="2026-06-10 11:24:30.00689163 +0000 UTC m=+350.053067636" Jun 10 11:24:35.273747 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:35.273711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:35.367589 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:35.367558 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:36.626542 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:36.626508 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:40.979724 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:40.979693 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-mhh87" Jun 10 11:24:42.804184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:42.804151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:42.909716 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:42.909687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:43.193594 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.193512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:43.292784 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.292752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:43.342290 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.342254 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78f5c998b9-52svm"] Jun 10 11:24:43.350612 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.350588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.360530 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:24:43.360497 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-78f5c998b9-52svm\" is forbidden: User \"system:node:ip-10-0-130-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-135.ec2.internal' and this object" podUID="d662deb9-2026-46a2-ab24-918965f1d6d7" pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.360530 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:24:43.360508 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-130-135.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" Jun 10 11:24:43.366110 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:24:43.366072 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-130-135.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" Jun 10 11:24:43.377423 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:24:43.377390 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-bkqkk\" is forbidden: User \"system:node:ip-10-0-130-135.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bkqkk\"" type="*v1.Secret" Jun 10 11:24:43.492429 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.492325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d662deb9-2026-46a2-ab24-918965f1d6d7-tmp\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.492429 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.492374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d662deb9-2026-46a2-ab24-918965f1d6d7-tls-certs\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.492610 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.492463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76ppg\" (UniqueName: \"kubernetes.io/projected/d662deb9-2026-46a2-ab24-918965f1d6d7-kube-api-access-76ppg\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.547423 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.547392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78f5c998b9-52svm"] Jun 10 11:24:43.590778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.590746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:43.593836 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.593812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d662deb9-2026-46a2-ab24-918965f1d6d7-tmp\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.593911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.593846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d662deb9-2026-46a2-ab24-918965f1d6d7-tls-certs\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.593911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.593883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76ppg\" (UniqueName: \"kubernetes.io/projected/d662deb9-2026-46a2-ab24-918965f1d6d7-kube-api-access-76ppg\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.596236 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.596202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d662deb9-2026-46a2-ab24-918965f1d6d7-tmp\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:43.633892 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:43.633861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76ppg\" (UniqueName: \"kubernetes.io/projected/d662deb9-2026-46a2-ab24-918965f1d6d7-kube-api-access-76ppg\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:44.104635 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.104602 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-j6f9f"] Jun 10 11:24:44.107878 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.107863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.111007 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.110990 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lb47k\"" Jun 10 11:24:44.111428 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.111413 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 11:24:44.119848 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.119826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-j6f9f"] Jun 10 11:24:44.125858 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.125833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:44.185958 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.185927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:44.199565 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.199509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44914785-3531-411d-834d-f39b937ba789-cert\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.199965 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.199943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc8mz\" (UniqueName: \"kubernetes.io/projected/44914785-3531-411d-834d-f39b937ba789-kube-api-access-nc8mz\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.291649 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.291613 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:44.300892 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.300857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc8mz\" (UniqueName: \"kubernetes.io/projected/44914785-3531-411d-834d-f39b937ba789-kube-api-access-nc8mz\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.301044 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.300907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44914785-3531-411d-834d-f39b937ba789-cert\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.301044 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:24:44.301033 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 11:24:44.301120 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:24:44.301090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44914785-3531-411d-834d-f39b937ba789-cert podName:44914785-3531-411d-834d-f39b937ba789 nodeName:}" failed. No retries permitted until 2026-06-10 11:24:44.801071674 +0000 UTC m=+364.847247676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/44914785-3531-411d-834d-f39b937ba789-cert") pod "odh-model-controller-6dc94f689f-j6f9f" (UID: "44914785-3531-411d-834d-f39b937ba789") : secret "odh-model-controller-webhook-cert" not found Jun 10 11:24:44.315249 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.315219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc8mz\" (UniqueName: \"kubernetes.io/projected/44914785-3531-411d-834d-f39b937ba789-kube-api-access-nc8mz\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.514570 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.514486 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:44.542614 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.542591 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 11:24:44.546935 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.546917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d662deb9-2026-46a2-ab24-918965f1d6d7-tls-certs\") pod \"kube-auth-proxy-78f5c998b9-52svm\" (UID: \"d662deb9-2026-46a2-ab24-918965f1d6d7\") " pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:44.692298 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.692270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 11:24:44.806291 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.806256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44914785-3531-411d-834d-f39b937ba789-cert\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.808793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.808774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44914785-3531-411d-834d-f39b937ba789-cert\") pod \"odh-model-controller-6dc94f689f-j6f9f\" (UID: \"44914785-3531-411d-834d-f39b937ba789\") " pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:44.848249 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.848218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:44.852735 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.852706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-bzzc6"] Jun 10 11:24:44.856133 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.856115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:44.860720 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.860701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mnjrt\"" Jun 10 11:24:44.860941 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.860925 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 11:24:44.873179 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.873152 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-bzzc6"] Jun 10 11:24:44.899565 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.899536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bkqkk\"" Jun 10 11:24:44.909597 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:44.909574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" Jun 10 11:24:45.007558 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.007522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766766bf-1dc8-4376-9488-9a8e46f6e523-tls-certs\") pod \"model-serving-api-5dd488fc48-bzzc6\" (UID: \"766766bf-1dc8-4376-9488-9a8e46f6e523\") " pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.007711 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.007599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxb4\" (UniqueName: \"kubernetes.io/projected/766766bf-1dc8-4376-9488-9a8e46f6e523-kube-api-access-lpxb4\") pod \"model-serving-api-5dd488fc48-bzzc6\" (UID: \"766766bf-1dc8-4376-9488-9a8e46f6e523\") " pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.018141 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.018105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:45.066526 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.066324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78f5c998b9-52svm"] Jun 10 11:24:45.069121 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:45.069087 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd662deb9_2026_46a2_ab24_918965f1d6d7.slice/crio-7853e13a2b42d99ce719cf46b0b0cd13003507a7131a02d723547fe9385d648d WatchSource:0}: Error finding container 7853e13a2b42d99ce719cf46b0b0cd13003507a7131a02d723547fe9385d648d: Status 404 returned error can't find the container with id 7853e13a2b42d99ce719cf46b0b0cd13003507a7131a02d723547fe9385d648d Jun 10 11:24:45.105751 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.105721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:45.108412 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.108388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxb4\" (UniqueName: \"kubernetes.io/projected/766766bf-1dc8-4376-9488-9a8e46f6e523-kube-api-access-lpxb4\") pod \"model-serving-api-5dd488fc48-bzzc6\" (UID: \"766766bf-1dc8-4376-9488-9a8e46f6e523\") " pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.108516 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.108491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766766bf-1dc8-4376-9488-9a8e46f6e523-tls-certs\") pod \"model-serving-api-5dd488fc48-bzzc6\" (UID: \"766766bf-1dc8-4376-9488-9a8e46f6e523\") " pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.111135 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.111110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766766bf-1dc8-4376-9488-9a8e46f6e523-tls-certs\") pod \"model-serving-api-5dd488fc48-bzzc6\" (UID: \"766766bf-1dc8-4376-9488-9a8e46f6e523\") " pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.122153 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.122131 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxb4\" (UniqueName: \"kubernetes.io/projected/766766bf-1dc8-4376-9488-9a8e46f6e523-kube-api-access-lpxb4\") pod \"model-serving-api-5dd488fc48-bzzc6\" (UID: \"766766bf-1dc8-4376-9488-9a8e46f6e523\") " pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.166493 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.166450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:45.173261 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.173235 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-j6f9f"] Jun 10 11:24:45.177359 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:45.177320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44914785_3531_411d_834d_f39b937ba789.slice/crio-63781f733f1e9bf289601a1dfeeb141ba006f103620dd43c22962ae78e2f0394 WatchSource:0}: Error finding container 63781f733f1e9bf289601a1dfeeb141ba006f103620dd43c22962ae78e2f0394: Status 404 returned error can't find the container with id 63781f733f1e9bf289601a1dfeeb141ba006f103620dd43c22962ae78e2f0394 Jun 10 11:24:45.309633 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.309548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-bzzc6"] Jun 10 11:24:45.311885 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:45.311851 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766766bf_1dc8_4376_9488_9a8e46f6e523.slice/crio-a441cf0c6e79334fef40e6619be23fc9afe2c6a05ff8b9549627b22b83cbbf88 WatchSource:0}: Error finding container a441cf0c6e79334fef40e6619be23fc9afe2c6a05ff8b9549627b22b83cbbf88: Status 404 returned error can't find the container with id a441cf0c6e79334fef40e6619be23fc9afe2c6a05ff8b9549627b22b83cbbf88 Jun 10 11:24:45.393387 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.393306 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2"] Jun 10 11:24:45.398076 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.398056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.402289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.402265 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 11:24:45.402688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.402674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qb58x\"" Jun 10 11:24:45.405412 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.405393 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 11:24:45.413086 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.413062 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2"] Jun 10 11:24:45.512160 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.512124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.512160 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.512157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.512384 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.512232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6klc5\" (UniqueName: \"kubernetes.io/projected/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-kube-api-access-6klc5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.612708 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.612660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6klc5\" (UniqueName: \"kubernetes.io/projected/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-kube-api-access-6klc5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.612891 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.612735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.612891 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.612754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.613138 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.613122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.613192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.613152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.623714 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.623648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6klc5\" (UniqueName: \"kubernetes.io/projected/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-kube-api-access-6klc5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.708117 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.708023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:45.897559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:45.896181 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2"] Jun 10 11:24:45.903094 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:45.903053 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0c0a66_2fb2_488b_8936_8d267cbe12d8.slice/crio-c9bd250df9662917da68c65a1d42b7cb8e07fe8cae86002e7b9dc79d7545eca8 WatchSource:0}: Error finding container c9bd250df9662917da68c65a1d42b7cb8e07fe8cae86002e7b9dc79d7545eca8: Status 404 returned error can't find the container with id c9bd250df9662917da68c65a1d42b7cb8e07fe8cae86002e7b9dc79d7545eca8 Jun 10 11:24:46.055782 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:46.055684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" event={"ID":"44914785-3531-411d-834d-f39b937ba789","Type":"ContainerStarted","Data":"63781f733f1e9bf289601a1dfeeb141ba006f103620dd43c22962ae78e2f0394"} Jun 10 11:24:46.061355 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:46.061284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" event={"ID":"d662deb9-2026-46a2-ab24-918965f1d6d7","Type":"ContainerStarted","Data":"7853e13a2b42d99ce719cf46b0b0cd13003507a7131a02d723547fe9385d648d"} Jun 10 11:24:46.065833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:46.065797 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" event={"ID":"766766bf-1dc8-4376-9488-9a8e46f6e523","Type":"ContainerStarted","Data":"a441cf0c6e79334fef40e6619be23fc9afe2c6a05ff8b9549627b22b83cbbf88"} Jun 10 11:24:46.068162 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:46.068124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" event={"ID":"9c0c0a66-2fb2-488b-8936-8d267cbe12d8","Type":"ContainerStarted","Data":"ec888ff80f2b19543bd88258d5e324fa8195d1252ed4c6bae44a7eb875c574ba"} Jun 10 11:24:46.068284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:46.068170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" event={"ID":"9c0c0a66-2fb2-488b-8936-8d267cbe12d8","Type":"ContainerStarted","Data":"c9bd250df9662917da68c65a1d42b7cb8e07fe8cae86002e7b9dc79d7545eca8"} Jun 10 11:24:47.087212 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:47.086332 2576 generic.go:356] "Generic (PLEG): container finished" podID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerID="ec888ff80f2b19543bd88258d5e324fa8195d1252ed4c6bae44a7eb875c574ba" exitCode=0 Jun 10 11:24:47.087212 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:47.086405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" event={"ID":"9c0c0a66-2fb2-488b-8936-8d267cbe12d8","Type":"ContainerDied","Data":"ec888ff80f2b19543bd88258d5e324fa8195d1252ed4c6bae44a7eb875c574ba"} Jun 10 11:24:50.104194 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.104110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" event={"ID":"766766bf-1dc8-4376-9488-9a8e46f6e523","Type":"ContainerStarted","Data":"ee329bf1876ef57c8df66bb8010118f38dfa95fa070818df2a04476b66c007f9"} Jun 10 11:24:50.104595 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.104231 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:24:50.106065 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.106043 2576 generic.go:356] "Generic (PLEG): container finished" podID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerID="492a8ef86565800b9edf6f080396d30df010730beb0287234f8e85d75566e9e3" exitCode=0 Jun 10 11:24:50.106168 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.106132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" event={"ID":"9c0c0a66-2fb2-488b-8936-8d267cbe12d8","Type":"ContainerDied","Data":"492a8ef86565800b9edf6f080396d30df010730beb0287234f8e85d75566e9e3"} Jun 10 11:24:50.107736 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.107694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" event={"ID":"44914785-3531-411d-834d-f39b937ba789","Type":"ContainerStarted","Data":"d73405bf9a1faeec26345d4a373e7dbcd0f565e3e575e836c1c43660408ec170"} Jun 10 11:24:50.107829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.107754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:24:50.109359 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.109331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" event={"ID":"d662deb9-2026-46a2-ab24-918965f1d6d7","Type":"ContainerStarted","Data":"c033cc4c8dfcae872ef9dad97a6fd1c82551b43410019d9d4909dd16508fb551"} Jun 10 11:24:50.129946 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.129900 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" podStartSLOduration=1.523279607 podStartE2EDuration="6.129886912s" totalImagesPullingTime="4.606607305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:50.128177687 +0000 UTC m=+370.174353694" watchObservedRunningTime="2026-06-10 11:24:50.129886912 +0000 UTC m=+370.176062918" Jun 10 11:24:50.149527 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.149485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78f5c998b9-52svm" podStartSLOduration=2.303773906 podStartE2EDuration="7.149469719s" totalImagesPullingTime="4.845695813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:50.148432551 +0000 UTC m=+370.194608558" watchObservedRunningTime="2026-06-10 11:24:50.149469719 +0000 UTC m=+370.195645725" Jun 10 11:24:50.168200 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:50.168155 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" podStartSLOduration=1.3892378 podStartE2EDuration="6.1681393s" totalImagesPullingTime="4.7789015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:50.167040325 +0000 UTC m=+370.213216335" watchObservedRunningTime="2026-06-10 11:24:50.1681393 +0000 UTC m=+370.214315306" Jun 10 11:24:51.115936 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:51.115902 2576 generic.go:356] "Generic (PLEG): container finished" podID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerID="02824c78dfe4d05804283aa78d58dc47357efb94e995ac79d793b147c29cb0c7" exitCode=0 Jun 10 11:24:51.116352 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:51.116007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" event={"ID":"9c0c0a66-2fb2-488b-8936-8d267cbe12d8","Type":"ContainerDied","Data":"02824c78dfe4d05804283aa78d58dc47357efb94e995ac79d793b147c29cb0c7"} Jun 10 11:24:52.252091 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.252061 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:52.272967 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.272934 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6klc5\" (UniqueName: \"kubernetes.io/projected/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-kube-api-access-6klc5\") pod \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " Jun 10 11:24:52.275168 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.275140 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-kube-api-access-6klc5" (OuterVolumeSpecName: "kube-api-access-6klc5") pod "9c0c0a66-2fb2-488b-8936-8d267cbe12d8" (UID: "9c0c0a66-2fb2-488b-8936-8d267cbe12d8"). InnerVolumeSpecName "kube-api-access-6klc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:24:52.374308 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.374217 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-util\") pod \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " Jun 10 11:24:52.374308 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.374272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-bundle\") pod \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\" (UID: \"9c0c0a66-2fb2-488b-8936-8d267cbe12d8\") " Jun 10 11:24:52.374484 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.374415 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6klc5\" (UniqueName: \"kubernetes.io/projected/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-kube-api-access-6klc5\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:24:52.375146 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.375120 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-bundle" (OuterVolumeSpecName: "bundle") pod "9c0c0a66-2fb2-488b-8936-8d267cbe12d8" (UID: "9c0c0a66-2fb2-488b-8936-8d267cbe12d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:24:52.378668 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.378645 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-util" (OuterVolumeSpecName: "util") pod "9c0c0a66-2fb2-488b-8936-8d267cbe12d8" (UID: "9c0c0a66-2fb2-488b-8936-8d267cbe12d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:24:52.474796 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.474762 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:24:52.474796 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:52.474792 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0c0a66-2fb2-488b-8936-8d267cbe12d8-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:24:53.127776 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.127742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" event={"ID":"9c0c0a66-2fb2-488b-8936-8d267cbe12d8","Type":"ContainerDied","Data":"c9bd250df9662917da68c65a1d42b7cb8e07fe8cae86002e7b9dc79d7545eca8"} Jun 10 11:24:53.127934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.127789 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9bd250df9662917da68c65a1d42b7cb8e07fe8cae86002e7b9dc79d7545eca8" Jun 10 11:24:53.127934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.127791 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06dtdg2" Jun 10 11:24:53.866709 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.866674 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw"] Jun 10 11:24:53.867073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867016 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="pull" Jun 10 11:24:53.867073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867028 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="pull" Jun 10 11:24:53.867073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867039 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="extract" Jun 10 11:24:53.867073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867044 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="extract" Jun 10 11:24:53.867073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867052 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="util" Jun 10 11:24:53.867073 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867057 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="util" Jun 10 11:24:53.867251 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.867120 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0c0a66-2fb2-488b-8936-8d267cbe12d8" containerName="extract" Jun 10 11:24:53.869070 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.869049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.871716 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.871693 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:24:53.871820 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.871773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 11:24:53.872924 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.872906 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 11:24:53.872924 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.872918 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 11:24:53.873102 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.872920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 11:24:53.873102 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.872913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rxfg8\"" Jun 10 11:24:53.884955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.884932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw"] Jun 10 11:24:53.886822 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.886791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82xwt\" (UniqueName: \"kubernetes.io/projected/994c04ad-051c-44ef-a1de-fd3ab0113f46-kube-api-access-82xwt\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.886917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.886828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994c04ad-051c-44ef-a1de-fd3ab0113f46-cert\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.886917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.886858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/994c04ad-051c-44ef-a1de-fd3ab0113f46-manager-config\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.887052 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.886926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/994c04ad-051c-44ef-a1de-fd3ab0113f46-metrics-cert\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.988193 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.988149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/994c04ad-051c-44ef-a1de-fd3ab0113f46-metrics-cert\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.988417 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.988218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82xwt\" (UniqueName: \"kubernetes.io/projected/994c04ad-051c-44ef-a1de-fd3ab0113f46-kube-api-access-82xwt\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.988417 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.988256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994c04ad-051c-44ef-a1de-fd3ab0113f46-cert\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.988417 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.988396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/994c04ad-051c-44ef-a1de-fd3ab0113f46-manager-config\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.989055 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.989035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/994c04ad-051c-44ef-a1de-fd3ab0113f46-manager-config\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.990951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.990928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994c04ad-051c-44ef-a1de-fd3ab0113f46-cert\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.991038 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.991000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/994c04ad-051c-44ef-a1de-fd3ab0113f46-metrics-cert\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:53.998313 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:53.998293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82xwt\" (UniqueName: \"kubernetes.io/projected/994c04ad-051c-44ef-a1de-fd3ab0113f46-kube-api-access-82xwt\") pod \"lws-controller-manager-7665f65bcf-fbgqw\" (UID: \"994c04ad-051c-44ef-a1de-fd3ab0113f46\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:54.178098 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:54.178011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:54.315154 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:54.315117 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw"] Jun 10 11:24:54.317562 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:24:54.317534 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994c04ad_051c_44ef_a1de_fd3ab0113f46.slice/crio-c572885e43142c48a0d48e9675deb87c022500f378780d21fcfb3a0c34f19d69 WatchSource:0}: Error finding container c572885e43142c48a0d48e9675deb87c022500f378780d21fcfb3a0c34f19d69: Status 404 returned error can't find the container with id c572885e43142c48a0d48e9675deb87c022500f378780d21fcfb3a0c34f19d69 Jun 10 11:24:54.356925 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:54.356572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:54.439717 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:54.439628 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:54.506741 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:54.506708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:54.576900 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:54.576864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:55.139886 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:55.139846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" event={"ID":"994c04ad-051c-44ef-a1de-fd3ab0113f46","Type":"ContainerStarted","Data":"c572885e43142c48a0d48e9675deb87c022500f378780d21fcfb3a0c34f19d69"} Jun 10 11:24:55.646036 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:55.646001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:55.744517 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:55.744488 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:56.146294 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:56.146262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" event={"ID":"994c04ad-051c-44ef-a1de-fd3ab0113f46","Type":"ContainerStarted","Data":"0c0e84192cdcc4b52ca660d49da33bba1a9599785933f5f2f70beac2350f7192"} Jun 10 11:24:56.146687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:56.146326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:24:56.224578 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:56.224523 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" podStartSLOduration=1.84890961 podStartE2EDuration="3.224508122s" totalImagesPullingTime="1.375598512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:56.223003026 +0000 UTC m=+376.269179033" watchObservedRunningTime="2026-06-10 11:24:56.224508122 +0000 UTC m=+376.270684128" Jun 10 11:24:58.918848 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:58.918810 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:24:59.022777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:24:59.022744 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:00.408919 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.408882 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc"] Jun 10 11:25:00.512888 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.512853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.519411 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.519384 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 11:25:00.519577 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.519542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qb58x\"" Jun 10 11:25:00.520240 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.520217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc"] Jun 10 11:25:00.520692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.520673 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 11:25:00.546446 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.546411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.546609 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.546455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqsnn\" (UniqueName: \"kubernetes.io/projected/301f9ef9-3be3-433f-a0b6-fe835021920a-kube-api-access-lqsnn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.546609 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.546475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.647573 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.647540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.647720 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.647582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqsnn\" (UniqueName: \"kubernetes.io/projected/301f9ef9-3be3-433f-a0b6-fe835021920a-kube-api-access-lqsnn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.647720 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.647611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.648045 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.648024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.648109 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.648024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.661196 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.661128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:00.665062 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.665040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqsnn\" (UniqueName: \"kubernetes.io/projected/301f9ef9-3be3-433f-a0b6-fe835021920a-kube-api-access-lqsnn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.791577 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.791517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:00.825507 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.825465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:00.957469 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:00.957436 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:01.056834 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:25:01.056806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301f9ef9_3be3_433f_a0b6_fe835021920a.slice/crio-1ac961a93935293107727823fa8a0a973e8aa7df7af5729dcf680c0cd07cf225 WatchSource:0}: Error finding container 1ac961a93935293107727823fa8a0a973e8aa7df7af5729dcf680c0cd07cf225: Status 404 returned error can't find the container with id 1ac961a93935293107727823fa8a0a973e8aa7df7af5729dcf680c0cd07cf225 Jun 10 11:25:01.057391 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:01.057356 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc"] Jun 10 11:25:01.118229 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:01.118206 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-j6f9f" Jun 10 11:25:01.120433 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:01.120411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-bzzc6" Jun 10 11:25:01.172232 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:01.172208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" event={"ID":"301f9ef9-3be3-433f-a0b6-fe835021920a","Type":"ContainerStarted","Data":"1ac961a93935293107727823fa8a0a973e8aa7df7af5729dcf680c0cd07cf225"} Jun 10 11:25:01.179343 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:01.179285 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:01.651663 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:01.651629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:02.177801 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:02.177767 2576 generic.go:356] "Generic (PLEG): container finished" podID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerID="44f619c059cd051db0bdd377b633f0c540ed06da50979155e3aa38b14b200262" exitCode=0 Jun 10 11:25:02.178042 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:02.177854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" event={"ID":"301f9ef9-3be3-433f-a0b6-fe835021920a","Type":"ContainerDied","Data":"44f619c059cd051db0bdd377b633f0c540ed06da50979155e3aa38b14b200262"} Jun 10 11:25:04.189632 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:04.189591 2576 generic.go:356] "Generic (PLEG): container finished" podID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerID="4467d26a1321953cac7caea90a625e819bd855e3c68a08f38195d35c7445be89" exitCode=0 Jun 10 11:25:04.190087 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:04.189639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" event={"ID":"301f9ef9-3be3-433f-a0b6-fe835021920a","Type":"ContainerDied","Data":"4467d26a1321953cac7caea90a625e819bd855e3c68a08f38195d35c7445be89"} Jun 10 11:25:05.197163 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:05.197130 2576 generic.go:356] "Generic (PLEG): container finished" podID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerID="52d33e4067422665ce9ed34ba1b3d09570873a39d677b2be532f62e44557931f" exitCode=0 Jun 10 11:25:05.197596 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:05.197179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" event={"ID":"301f9ef9-3be3-433f-a0b6-fe835021920a","Type":"ContainerDied","Data":"52d33e4067422665ce9ed34ba1b3d09570873a39d677b2be532f62e44557931f"} Jun 10 11:25:06.341076 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.340959 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:06.397800 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.397769 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-util\") pod \"301f9ef9-3be3-433f-a0b6-fe835021920a\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " Jun 10 11:25:06.398013 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.397813 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqsnn\" (UniqueName: \"kubernetes.io/projected/301f9ef9-3be3-433f-a0b6-fe835021920a-kube-api-access-lqsnn\") pod \"301f9ef9-3be3-433f-a0b6-fe835021920a\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " Jun 10 11:25:06.398013 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.397837 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-bundle\") pod \"301f9ef9-3be3-433f-a0b6-fe835021920a\" (UID: \"301f9ef9-3be3-433f-a0b6-fe835021920a\") " Jun 10 11:25:06.398989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.398949 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-bundle" (OuterVolumeSpecName: "bundle") pod "301f9ef9-3be3-433f-a0b6-fe835021920a" (UID: "301f9ef9-3be3-433f-a0b6-fe835021920a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:25:06.399923 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.399899 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301f9ef9-3be3-433f-a0b6-fe835021920a-kube-api-access-lqsnn" (OuterVolumeSpecName: "kube-api-access-lqsnn") pod "301f9ef9-3be3-433f-a0b6-fe835021920a" (UID: "301f9ef9-3be3-433f-a0b6-fe835021920a"). InnerVolumeSpecName "kube-api-access-lqsnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:25:06.403725 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.403690 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-util" (OuterVolumeSpecName: "util") pod "301f9ef9-3be3-433f-a0b6-fe835021920a" (UID: "301f9ef9-3be3-433f-a0b6-fe835021920a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:25:06.498821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.498727 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:25:06.498821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.498760 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqsnn\" (UniqueName: \"kubernetes.io/projected/301f9ef9-3be3-433f-a0b6-fe835021920a-kube-api-access-lqsnn\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:25:06.498821 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:06.498770 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301f9ef9-3be3-433f-a0b6-fe835021920a-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:25:07.153787 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:07.153753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-fbgqw" Jun 10 11:25:07.208753 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:07.208719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" event={"ID":"301f9ef9-3be3-433f-a0b6-fe835021920a","Type":"ContainerDied","Data":"1ac961a93935293107727823fa8a0a973e8aa7df7af5729dcf680c0cd07cf225"} Jun 10 11:25:07.208753 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:07.208767 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ac961a93935293107727823fa8a0a973e8aa7df7af5729dcf680c0cd07cf225" Jun 10 11:25:07.209025 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:07.208782 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arg9wc" Jun 10 11:25:11.973022 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:11.972917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:12.071911 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:12.071874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:19.425719 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:19.425687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:32.113864 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:32.113824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:32.212888 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:32.212852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:32.755068 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:32.755034 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:35.953781 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:35.953742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:36.054360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:36.054332 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:36.246869 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:36.246787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:36.418961 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:36.418927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:36.677302 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:36.677268 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:37.198748 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:37.198707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:44.849180 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:44.849143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:44.947845 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:44.947809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:45.069548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:45.069517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:45.828521 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:45.828480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:25:46.001873 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:25:46.001824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:00.607015 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.606919 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz"] Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607256 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="util" Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607268 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="util" Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607279 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="pull" Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607285 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="pull" Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607291 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="extract" Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607296 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="extract" Jun 10 11:26:00.607459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.607348 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="301f9ef9-3be3-433f-a0b6-fe835021920a" containerName="extract" Jun 10 11:26:00.610546 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.610529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.613474 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.613452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 11:26:00.613606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.613451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cz97\"" Jun 10 11:26:00.613606 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.613454 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 11:26:00.620390 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.620365 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz"] Jun 10 11:26:00.649685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.649653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.649863 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.649702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjdr\" (UniqueName: \"kubernetes.io/projected/26fd2ee3-09cc-4718-b18d-1f77fc99585b-kube-api-access-tqjdr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.649863 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.649762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.750672 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.750617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjdr\" (UniqueName: \"kubernetes.io/projected/26fd2ee3-09cc-4718-b18d-1f77fc99585b-kube-api-access-tqjdr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.750672 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.750685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.750895 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.750738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.751217 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.751196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.751272 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.751206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.760703 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.760681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjdr\" (UniqueName: \"kubernetes.io/projected/26fd2ee3-09cc-4718-b18d-1f77fc99585b-kube-api-access-tqjdr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:00.920115 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:00.920028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:01.000935 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.000896 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx"] Jun 10 11:26:01.004953 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.004931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.019785 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.019738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx"] Jun 10 11:26:01.053456 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.053425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.053624 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.053474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.053624 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.053495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2b2d\" (UniqueName: \"kubernetes.io/projected/7c98271d-3276-4914-9c63-aff8256aae2e-kube-api-access-s2b2d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.063689 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.063657 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz"] Jun 10 11:26:01.065195 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:26:01.065168 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fd2ee3_09cc_4718_b18d_1f77fc99585b.slice/crio-7afd3efd5e43c56985dd763a8f6c47c6f666130576fa27aa65c4dd2a961e37eb WatchSource:0}: Error finding container 7afd3efd5e43c56985dd763a8f6c47c6f666130576fa27aa65c4dd2a961e37eb: Status 404 returned error can't find the container with id 7afd3efd5e43c56985dd763a8f6c47c6f666130576fa27aa65c4dd2a961e37eb Jun 10 11:26:01.154411 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.154372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.154623 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.154430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.154623 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.154448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2b2d\" (UniqueName: \"kubernetes.io/projected/7c98271d-3276-4914-9c63-aff8256aae2e-kube-api-access-s2b2d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.154784 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.154762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.154836 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.154813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.164217 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.164185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2b2d\" (UniqueName: \"kubernetes.io/projected/7c98271d-3276-4914-9c63-aff8256aae2e-kube-api-access-s2b2d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.327822 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.327787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:01.414934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.414898 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg"] Jun 10 11:26:01.419192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.419167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.428054 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.427837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg"] Jun 10 11:26:01.457350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.457264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.457350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.457339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.457539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.457365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxcm\" (UniqueName: \"kubernetes.io/projected/469705dc-5c80-4315-91b8-9230c30eb241-kube-api-access-hbxcm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.465717 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.465694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx"] Jun 10 11:26:01.467362 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:26:01.467335 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c98271d_3276_4914_9c63_aff8256aae2e.slice/crio-0fbcd8d171894fc9769b1d5a9ae9e6d1aecdf1fd44948e7a04a66886615d2721 WatchSource:0}: Error finding container 0fbcd8d171894fc9769b1d5a9ae9e6d1aecdf1fd44948e7a04a66886615d2721: Status 404 returned error can't find the container with id 0fbcd8d171894fc9769b1d5a9ae9e6d1aecdf1fd44948e7a04a66886615d2721 Jun 10 11:26:01.469404 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.469371 2576 generic.go:356] "Generic (PLEG): container finished" podID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerID="714407f27503a7d66c2fbab1c626f0d7a084fdf5ababee3508a1f12c41b322cd" exitCode=0 Jun 10 11:26:01.469492 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.469430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" event={"ID":"26fd2ee3-09cc-4718-b18d-1f77fc99585b","Type":"ContainerDied","Data":"714407f27503a7d66c2fbab1c626f0d7a084fdf5ababee3508a1f12c41b322cd"} Jun 10 11:26:01.469492 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.469469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" event={"ID":"26fd2ee3-09cc-4718-b18d-1f77fc99585b","Type":"ContainerStarted","Data":"7afd3efd5e43c56985dd763a8f6c47c6f666130576fa27aa65c4dd2a961e37eb"} Jun 10 11:26:01.558002 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.557954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.558189 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.558041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.558189 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.558060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxcm\" (UniqueName: \"kubernetes.io/projected/469705dc-5c80-4315-91b8-9230c30eb241-kube-api-access-hbxcm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.558348 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.558328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.558476 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.558453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.568852 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.568825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxcm\" (UniqueName: \"kubernetes.io/projected/469705dc-5c80-4315-91b8-9230c30eb241-kube-api-access-hbxcm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.731412 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.731327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:01.822777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.822739 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z"] Jun 10 11:26:01.826833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.826809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.835579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.835186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z"] Jun 10 11:26:01.860211 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.860182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwvk\" (UniqueName: \"kubernetes.io/projected/fe0b8d4c-a1b6-4646-9937-337e86beac85-kube-api-access-kdwvk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.860342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.860244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.860342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.860284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.875152 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.875126 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg"] Jun 10 11:26:01.876770 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:26:01.876733 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469705dc_5c80_4315_91b8_9230c30eb241.slice/crio-0c6234e6abfc5b07592c648cc3f1cdb693b6064f70df130e21aaa41b46e9a7df WatchSource:0}: Error finding container 0c6234e6abfc5b07592c648cc3f1cdb693b6064f70df130e21aaa41b46e9a7df: Status 404 returned error can't find the container with id 0c6234e6abfc5b07592c648cc3f1cdb693b6064f70df130e21aaa41b46e9a7df Jun 10 11:26:01.961620 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.961591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.961769 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.961642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.961769 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.961687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwvk\" (UniqueName: \"kubernetes.io/projected/fe0b8d4c-a1b6-4646-9937-337e86beac85-kube-api-access-kdwvk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.961989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.961957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.962120 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.962097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:01.972282 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:01.972260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwvk\" (UniqueName: \"kubernetes.io/projected/fe0b8d4c-a1b6-4646-9937-337e86beac85-kube-api-access-kdwvk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:02.139728 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.139695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:02.366797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.366773 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z"] Jun 10 11:26:02.368804 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:26:02.368778 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0b8d4c_a1b6_4646_9937_337e86beac85.slice/crio-940590284eba5dd6923cd53ca9a52dd8ef00817893ff0c4dd3e9682a6a4238dc WatchSource:0}: Error finding container 940590284eba5dd6923cd53ca9a52dd8ef00817893ff0c4dd3e9682a6a4238dc: Status 404 returned error can't find the container with id 940590284eba5dd6923cd53ca9a52dd8ef00817893ff0c4dd3e9682a6a4238dc Jun 10 11:26:02.476117 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.476062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" event={"ID":"fe0b8d4c-a1b6-4646-9937-337e86beac85","Type":"ContainerStarted","Data":"4f40c5e9e74d7b2d2174c5b9d87fe581098ce05b1bdb865e6c772b31c491c87f"} Jun 10 11:26:02.476265 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.476150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" event={"ID":"fe0b8d4c-a1b6-4646-9937-337e86beac85","Type":"ContainerStarted","Data":"940590284eba5dd6923cd53ca9a52dd8ef00817893ff0c4dd3e9682a6a4238dc"} Jun 10 11:26:02.478337 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.478308 2576 generic.go:356] "Generic (PLEG): container finished" podID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerID="28c34b385dcf129f82d9ad31e4044840f1b9060f4785404aa9d45b26857bd14b" exitCode=0 Jun 10 11:26:02.478470 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.478413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" event={"ID":"26fd2ee3-09cc-4718-b18d-1f77fc99585b","Type":"ContainerDied","Data":"28c34b385dcf129f82d9ad31e4044840f1b9060f4785404aa9d45b26857bd14b"} Jun 10 11:26:02.479987 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.479952 2576 generic.go:356] "Generic (PLEG): container finished" podID="469705dc-5c80-4315-91b8-9230c30eb241" containerID="1d2bcb77d287e71895de28a333f5942970c4be463a872eecd460363fadef8f20" exitCode=0 Jun 10 11:26:02.480050 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.480013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" event={"ID":"469705dc-5c80-4315-91b8-9230c30eb241","Type":"ContainerDied","Data":"1d2bcb77d287e71895de28a333f5942970c4be463a872eecd460363fadef8f20"} Jun 10 11:26:02.480112 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.480061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" event={"ID":"469705dc-5c80-4315-91b8-9230c30eb241","Type":"ContainerStarted","Data":"0c6234e6abfc5b07592c648cc3f1cdb693b6064f70df130e21aaa41b46e9a7df"} Jun 10 11:26:02.481599 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.481575 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c98271d-3276-4914-9c63-aff8256aae2e" containerID="44654f0e82713132b8acfa45b6432614d629449d6a79d23f2218510b5238299d" exitCode=0 Jun 10 11:26:02.481692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.481643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" event={"ID":"7c98271d-3276-4914-9c63-aff8256aae2e","Type":"ContainerDied","Data":"44654f0e82713132b8acfa45b6432614d629449d6a79d23f2218510b5238299d"} Jun 10 11:26:02.481692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:02.481674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" event={"ID":"7c98271d-3276-4914-9c63-aff8256aae2e","Type":"ContainerStarted","Data":"0fbcd8d171894fc9769b1d5a9ae9e6d1aecdf1fd44948e7a04a66886615d2721"} Jun 10 11:26:03.155272 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.155231 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:03.220714 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.220686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:03.489748 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.489716 2576 generic.go:356] "Generic (PLEG): container finished" podID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerID="4f40c5e9e74d7b2d2174c5b9d87fe581098ce05b1bdb865e6c772b31c491c87f" exitCode=0 Jun 10 11:26:03.489902 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.489799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" event={"ID":"fe0b8d4c-a1b6-4646-9937-337e86beac85","Type":"ContainerDied","Data":"4f40c5e9e74d7b2d2174c5b9d87fe581098ce05b1bdb865e6c772b31c491c87f"} Jun 10 11:26:03.492519 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.492493 2576 generic.go:356] "Generic (PLEG): container finished" podID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerID="ac7d2ee1dcdbbbfef061b70701873707cab0878ef0fbe65abe086ba6bb923604" exitCode=0 Jun 10 11:26:03.492638 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.492600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" event={"ID":"26fd2ee3-09cc-4718-b18d-1f77fc99585b","Type":"ContainerDied","Data":"ac7d2ee1dcdbbbfef061b70701873707cab0878ef0fbe65abe086ba6bb923604"} Jun 10 11:26:03.494650 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.494613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" event={"ID":"469705dc-5c80-4315-91b8-9230c30eb241","Type":"ContainerStarted","Data":"52cf29822249a43bff64d09b3250273b7a5b880b5b7395d2201fec6ddb6da7ce"} Jun 10 11:26:03.496629 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.496590 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c98271d-3276-4914-9c63-aff8256aae2e" containerID="56ca1ec232d09aa342bd940ecf980c6aadfb7e37023b4420a1299870468fc59d" exitCode=0 Jun 10 11:26:03.496875 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:03.496628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" event={"ID":"7c98271d-3276-4914-9c63-aff8256aae2e","Type":"ContainerDied","Data":"56ca1ec232d09aa342bd940ecf980c6aadfb7e37023b4420a1299870468fc59d"} Jun 10 11:26:04.503364 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.503331 2576 generic.go:356] "Generic (PLEG): container finished" podID="469705dc-5c80-4315-91b8-9230c30eb241" containerID="52cf29822249a43bff64d09b3250273b7a5b880b5b7395d2201fec6ddb6da7ce" exitCode=0 Jun 10 11:26:04.503793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.503404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" event={"ID":"469705dc-5c80-4315-91b8-9230c30eb241","Type":"ContainerDied","Data":"52cf29822249a43bff64d09b3250273b7a5b880b5b7395d2201fec6ddb6da7ce"} Jun 10 11:26:04.505592 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.505570 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c98271d-3276-4914-9c63-aff8256aae2e" containerID="2faf66870101dda244c399f3acb0db767a1db1980bfe16ff788857d55518b42e" exitCode=0 Jun 10 11:26:04.505692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.505644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" event={"ID":"7c98271d-3276-4914-9c63-aff8256aae2e","Type":"ContainerDied","Data":"2faf66870101dda244c399f3acb0db767a1db1980bfe16ff788857d55518b42e"} Jun 10 11:26:04.507349 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.507327 2576 generic.go:356] "Generic (PLEG): container finished" podID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerID="38ec8f8aa3ce0fdf50e8d25ba609eba48a53d2bc55b605007b0886d291477bc5" exitCode=0 Jun 10 11:26:04.507433 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.507361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" event={"ID":"fe0b8d4c-a1b6-4646-9937-337e86beac85","Type":"ContainerDied","Data":"38ec8f8aa3ce0fdf50e8d25ba609eba48a53d2bc55b605007b0886d291477bc5"} Jun 10 11:26:04.636294 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.636240 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:04.688271 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.688235 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqjdr\" (UniqueName: \"kubernetes.io/projected/26fd2ee3-09cc-4718-b18d-1f77fc99585b-kube-api-access-tqjdr\") pod \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " Jun 10 11:26:04.688271 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.688278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-util\") pod \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " Jun 10 11:26:04.688505 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.688327 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-bundle\") pod \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\" (UID: \"26fd2ee3-09cc-4718-b18d-1f77fc99585b\") " Jun 10 11:26:04.688790 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.688765 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-bundle" (OuterVolumeSpecName: "bundle") pod "26fd2ee3-09cc-4718-b18d-1f77fc99585b" (UID: "26fd2ee3-09cc-4718-b18d-1f77fc99585b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:04.690425 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.690399 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fd2ee3-09cc-4718-b18d-1f77fc99585b-kube-api-access-tqjdr" (OuterVolumeSpecName: "kube-api-access-tqjdr") pod "26fd2ee3-09cc-4718-b18d-1f77fc99585b" (UID: "26fd2ee3-09cc-4718-b18d-1f77fc99585b"). InnerVolumeSpecName "kube-api-access-tqjdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:04.694209 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.694169 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-util" (OuterVolumeSpecName: "util") pod "26fd2ee3-09cc-4718-b18d-1f77fc99585b" (UID: "26fd2ee3-09cc-4718-b18d-1f77fc99585b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:04.789237 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.789198 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqjdr\" (UniqueName: \"kubernetes.io/projected/26fd2ee3-09cc-4718-b18d-1f77fc99585b-kube-api-access-tqjdr\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:04.789237 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.789229 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:04.789237 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:04.789241 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fd2ee3-09cc-4718-b18d-1f77fc99585b-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:05.513892 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.513861 2576 generic.go:356] "Generic (PLEG): container finished" podID="469705dc-5c80-4315-91b8-9230c30eb241" containerID="2d7181d06d64846334a90fd4cee730a303042ea4cfc6b02a7989b30abb67a2a3" exitCode=0 Jun 10 11:26:05.514336 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.513960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" event={"ID":"469705dc-5c80-4315-91b8-9230c30eb241","Type":"ContainerDied","Data":"2d7181d06d64846334a90fd4cee730a303042ea4cfc6b02a7989b30abb67a2a3"} Jun 10 11:26:05.515787 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.515761 2576 generic.go:356] "Generic (PLEG): container finished" podID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerID="cc5925660700fa38f7d2a5e91553edc0132e67788ca484d147c400a5b37dc58c" exitCode=0 Jun 10 11:26:05.515880 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.515840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" event={"ID":"fe0b8d4c-a1b6-4646-9937-337e86beac85","Type":"ContainerDied","Data":"cc5925660700fa38f7d2a5e91553edc0132e67788ca484d147c400a5b37dc58c"} Jun 10 11:26:05.517651 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.517627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" event={"ID":"26fd2ee3-09cc-4718-b18d-1f77fc99585b","Type":"ContainerDied","Data":"7afd3efd5e43c56985dd763a8f6c47c6f666130576fa27aa65c4dd2a961e37eb"} Jun 10 11:26:05.517651 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.517646 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz" Jun 10 11:26:05.517797 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.517665 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7afd3efd5e43c56985dd763a8f6c47c6f666130576fa27aa65c4dd2a961e37eb" Jun 10 11:26:05.651951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.651927 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:05.697101 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.697066 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-util\") pod \"7c98271d-3276-4914-9c63-aff8256aae2e\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " Jun 10 11:26:05.697259 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.697161 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-bundle\") pod \"7c98271d-3276-4914-9c63-aff8256aae2e\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " Jun 10 11:26:05.697259 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.697221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2b2d\" (UniqueName: \"kubernetes.io/projected/7c98271d-3276-4914-9c63-aff8256aae2e-kube-api-access-s2b2d\") pod \"7c98271d-3276-4914-9c63-aff8256aae2e\" (UID: \"7c98271d-3276-4914-9c63-aff8256aae2e\") " Jun 10 11:26:05.697703 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.697669 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-bundle" (OuterVolumeSpecName: "bundle") pod "7c98271d-3276-4914-9c63-aff8256aae2e" (UID: "7c98271d-3276-4914-9c63-aff8256aae2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:05.699501 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.699470 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c98271d-3276-4914-9c63-aff8256aae2e-kube-api-access-s2b2d" (OuterVolumeSpecName: "kube-api-access-s2b2d") pod "7c98271d-3276-4914-9c63-aff8256aae2e" (UID: "7c98271d-3276-4914-9c63-aff8256aae2e"). InnerVolumeSpecName "kube-api-access-s2b2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:05.702319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.702288 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-util" (OuterVolumeSpecName: "util") pod "7c98271d-3276-4914-9c63-aff8256aae2e" (UID: "7c98271d-3276-4914-9c63-aff8256aae2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:05.798155 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.798127 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2b2d\" (UniqueName: \"kubernetes.io/projected/7c98271d-3276-4914-9c63-aff8256aae2e-kube-api-access-s2b2d\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:05.798155 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.798153 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:05.798337 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:05.798163 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c98271d-3276-4914-9c63-aff8256aae2e-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:06.524936 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.524907 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" Jun 10 11:26:06.524936 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.524923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx" event={"ID":"7c98271d-3276-4914-9c63-aff8256aae2e","Type":"ContainerDied","Data":"0fbcd8d171894fc9769b1d5a9ae9e6d1aecdf1fd44948e7a04a66886615d2721"} Jun 10 11:26:06.525503 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.524995 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fbcd8d171894fc9769b1d5a9ae9e6d1aecdf1fd44948e7a04a66886615d2721" Jun 10 11:26:06.681402 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.681372 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:06.683460 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.683444 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:06.807750 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.807719 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbxcm\" (UniqueName: \"kubernetes.io/projected/469705dc-5c80-4315-91b8-9230c30eb241-kube-api-access-hbxcm\") pod \"469705dc-5c80-4315-91b8-9230c30eb241\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " Jun 10 11:26:06.807930 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.807767 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-bundle\") pod \"469705dc-5c80-4315-91b8-9230c30eb241\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " Jun 10 11:26:06.807930 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.807807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-bundle\") pod \"fe0b8d4c-a1b6-4646-9937-337e86beac85\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " Jun 10 11:26:06.808099 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.807921 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-util\") pod \"fe0b8d4c-a1b6-4646-9937-337e86beac85\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " Jun 10 11:26:06.808099 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.807961 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-util\") pod \"469705dc-5c80-4315-91b8-9230c30eb241\" (UID: \"469705dc-5c80-4315-91b8-9230c30eb241\") " Jun 10 11:26:06.808099 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.808043 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdwvk\" (UniqueName: \"kubernetes.io/projected/fe0b8d4c-a1b6-4646-9937-337e86beac85-kube-api-access-kdwvk\") pod \"fe0b8d4c-a1b6-4646-9937-337e86beac85\" (UID: \"fe0b8d4c-a1b6-4646-9937-337e86beac85\") " Jun 10 11:26:06.808489 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.808432 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-bundle" (OuterVolumeSpecName: "bundle") pod "fe0b8d4c-a1b6-4646-9937-337e86beac85" (UID: "fe0b8d4c-a1b6-4646-9937-337e86beac85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:06.808489 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.808472 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-bundle" (OuterVolumeSpecName: "bundle") pod "469705dc-5c80-4315-91b8-9230c30eb241" (UID: "469705dc-5c80-4315-91b8-9230c30eb241"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:06.810245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.810220 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0b8d4c-a1b6-4646-9937-337e86beac85-kube-api-access-kdwvk" (OuterVolumeSpecName: "kube-api-access-kdwvk") pod "fe0b8d4c-a1b6-4646-9937-337e86beac85" (UID: "fe0b8d4c-a1b6-4646-9937-337e86beac85"). InnerVolumeSpecName "kube-api-access-kdwvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:06.810469 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.810445 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469705dc-5c80-4315-91b8-9230c30eb241-kube-api-access-hbxcm" (OuterVolumeSpecName: "kube-api-access-hbxcm") pod "469705dc-5c80-4315-91b8-9230c30eb241" (UID: "469705dc-5c80-4315-91b8-9230c30eb241"). InnerVolumeSpecName "kube-api-access-hbxcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:06.814662 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.814622 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-util" (OuterVolumeSpecName: "util") pod "469705dc-5c80-4315-91b8-9230c30eb241" (UID: "469705dc-5c80-4315-91b8-9230c30eb241"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:06.816557 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.816527 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-util" (OuterVolumeSpecName: "util") pod "fe0b8d4c-a1b6-4646-9937-337e86beac85" (UID: "fe0b8d4c-a1b6-4646-9937-337e86beac85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:06.909235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.909180 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:06.909235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.909227 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b8d4c-a1b6-4646-9937-337e86beac85-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:06.909235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.909237 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:06.909235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.909246 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdwvk\" (UniqueName: \"kubernetes.io/projected/fe0b8d4c-a1b6-4646-9937-337e86beac85-kube-api-access-kdwvk\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:06.909235 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.909256 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbxcm\" (UniqueName: \"kubernetes.io/projected/469705dc-5c80-4315-91b8-9230c30eb241-kube-api-access-hbxcm\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:06.909645 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:06.909264 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469705dc-5c80-4315-91b8-9230c30eb241-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:07.531435 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:07.531407 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" Jun 10 11:26:07.531826 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:07.531440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg" event={"ID":"469705dc-5c80-4315-91b8-9230c30eb241","Type":"ContainerDied","Data":"0c6234e6abfc5b07592c648cc3f1cdb693b6064f70df130e21aaa41b46e9a7df"} Jun 10 11:26:07.531826 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:07.531487 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c6234e6abfc5b07592c648cc3f1cdb693b6064f70df130e21aaa41b46e9a7df" Jun 10 11:26:07.533267 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:07.533247 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" Jun 10 11:26:07.533381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:07.533245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z" event={"ID":"fe0b8d4c-a1b6-4646-9937-337e86beac85","Type":"ContainerDied","Data":"940590284eba5dd6923cd53ca9a52dd8ef00817893ff0c4dd3e9682a6a4238dc"} Jun 10 11:26:07.533381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:07.533351 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="940590284eba5dd6923cd53ca9a52dd8ef00817893ff0c4dd3e9682a6a4238dc" Jun 10 11:26:13.596781 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:13.596737 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:13.638063 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:13.638029 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8d4fcddd-xxjsn"] Jun 10 11:26:13.761848 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:13.761817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:13.862326 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:13.862223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:13.965661 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:13.965629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:14.063132 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:14.063090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:14.204433 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:14.204338 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:15.239108 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:15.239053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:15.338644 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:15.338590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:18.821956 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:18.821916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:21.614149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:21.614112 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:21.857703 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:21.857665 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:24.033957 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:24.033923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:24.194859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:24.194825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:26.645804 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:26.645768 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:29.201128 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:29.201091 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:29.301951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:29.301918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:29.409856 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:29.409815 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:29.508030 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:29.507910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:33.012887 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:33.012847 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:33.114303 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:33.114263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:35.419439 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:35.419386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:37.408321 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.408269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:37.510156 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.510102 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:37.511777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.511752 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj"] Jun 10 11:26:37.512095 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512081 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="util" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512096 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="util" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512107 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="extract" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512112 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="extract" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512121 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="util" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512126 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="util" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512132 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="util" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512136 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="util" Jun 10 11:26:37.512149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512148 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512155 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512161 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512165 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512175 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512179 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512185 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="util" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512190 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="util" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512194 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512199 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512204 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512209 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="pull" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512213 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512217 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512227 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512231 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512283 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0b8d4c-a1b6-4646-9937-337e86beac85" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512289 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="469705dc-5c80-4315-91b8-9230c30eb241" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512296 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c98271d-3276-4914-9c63-aff8256aae2e" containerName="extract" Jun 10 11:26:37.512418 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.512303 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fd2ee3-09cc-4718-b18d-1f77fc99585b" containerName="extract" Jun 10 11:26:37.518672 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.516084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.521897 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.521861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 11:26:37.521897 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.521881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cz97\"" Jun 10 11:26:37.522148 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.521912 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 11:26:37.522148 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.521923 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 11:26:37.522289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.522272 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 11:26:37.524332 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.524310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj"] Jun 10 11:26:37.591884 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.591849 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:37.675686 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.675604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c72fa1-1327-46f8-87e8-8d1b37f60038-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.675686 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.675677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fc4\" (UniqueName: \"kubernetes.io/projected/50c72fa1-1327-46f8-87e8-8d1b37f60038-kube-api-access-f4fc4\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.675869 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.675705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50c72fa1-1327-46f8-87e8-8d1b37f60038-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.776068 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.776031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50c72fa1-1327-46f8-87e8-8d1b37f60038-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.776247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.776077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c72fa1-1327-46f8-87e8-8d1b37f60038-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.776247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.776148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fc4\" (UniqueName: \"kubernetes.io/projected/50c72fa1-1327-46f8-87e8-8d1b37f60038-kube-api-access-f4fc4\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.776247 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:26:37.776204 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 11:26:37.776376 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:26:37.776273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c72fa1-1327-46f8-87e8-8d1b37f60038-plugin-serving-cert podName:50c72fa1-1327-46f8-87e8-8d1b37f60038 nodeName:}" failed. No retries permitted until 2026-06-10 11:26:38.276257194 +0000 UTC m=+478.322433180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/50c72fa1-1327-46f8-87e8-8d1b37f60038-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-gwxgj" (UID: "50c72fa1-1327-46f8-87e8-8d1b37f60038") : secret "plugin-serving-cert" not found Jun 10 11:26:37.776614 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.776597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50c72fa1-1327-46f8-87e8-8d1b37f60038-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:37.790482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:37.790448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fc4\" (UniqueName: \"kubernetes.io/projected/50c72fa1-1327-46f8-87e8-8d1b37f60038-kube-api-access-f4fc4\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:38.023636 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.023526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:38.117583 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.117547 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:38.282064 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.281952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c72fa1-1327-46f8-87e8-8d1b37f60038-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:38.284492 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.284472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50c72fa1-1327-46f8-87e8-8d1b37f60038-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gwxgj\" (UID: \"50c72fa1-1327-46f8-87e8-8d1b37f60038\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:38.427195 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.427165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" Jun 10 11:26:38.563653 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.563626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj"] Jun 10 11:26:38.565704 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:26:38.565657 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50c72fa1_1327_46f8_87e8_8d1b37f60038.slice/crio-a6e1787225839b6fe6d2f678565fffe5cf175d1d36346d0baf1a6294853f8a6d WatchSource:0}: Error finding container a6e1787225839b6fe6d2f678565fffe5cf175d1d36346d0baf1a6294853f8a6d: Status 404 returned error can't find the container with id a6e1787225839b6fe6d2f678565fffe5cf175d1d36346d0baf1a6294853f8a6d Jun 10 11:26:38.660480 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.660439 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b8d4fcddd-xxjsn" podUID="b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" containerName="console" containerID="cri-o://fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593" gracePeriod=15 Jun 10 11:26:38.689121 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.689086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" event={"ID":"50c72fa1-1327-46f8-87e8-8d1b37f60038","Type":"ContainerStarted","Data":"a6e1787225839b6fe6d2f678565fffe5cf175d1d36346d0baf1a6294853f8a6d"} Jun 10 11:26:38.910335 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.910311 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:26:38.988176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.988134 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f22r\" (UniqueName: \"kubernetes.io/projected/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-kube-api-access-2f22r\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:38.988176 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.988178 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-oauth-serving-cert\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:38.988391 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.988204 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-service-ca\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:38.988579 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.988555 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:26:38.988643 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.988594 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:26:38.990543 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:38.990519 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-kube-api-access-2f22r" (OuterVolumeSpecName: "kube-api-access-2f22r") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "kube-api-access-2f22r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:39.088756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.088653 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-serving-cert\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:39.088756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.088742 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-config\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:39.089039 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.088845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-trusted-ca-bundle\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:39.089039 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.088883 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-oauth-config\") pod \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\" (UID: \"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3\") " Jun 10 11:26:39.089159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.089069 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-config" (OuterVolumeSpecName: "console-config") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:26:39.089159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.089088 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-service-ca\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.089159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.089133 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f22r\" (UniqueName: \"kubernetes.io/projected/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-kube-api-access-2f22r\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.089159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.089149 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-oauth-serving-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.089310 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.089273 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:26:39.091001 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.090961 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:26:39.091091 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.091004 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" (UID: "b7ed9d6c-1f05-431a-9dfd-480ca0158fc3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:26:39.189687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.189650 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-config\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.189687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.189680 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-trusted-ca-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.189687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.189690 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-oauth-config\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.189924 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.189702 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3-console-serving-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:26:39.697676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.697640 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" containerID="fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593" exitCode=0 Jun 10 11:26:39.698192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.697699 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8d4fcddd-xxjsn" Jun 10 11:26:39.698192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.697730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8d4fcddd-xxjsn" event={"ID":"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3","Type":"ContainerDied","Data":"fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593"} Jun 10 11:26:39.698192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.697788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8d4fcddd-xxjsn" event={"ID":"b7ed9d6c-1f05-431a-9dfd-480ca0158fc3","Type":"ContainerDied","Data":"d777c5991508bc53a1f375eb54405e9506a59359368517612c1b6dd7c46c9630"} Jun 10 11:26:39.698192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.697819 2576 scope.go:117] "RemoveContainer" containerID="fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593" Jun 10 11:26:39.708844 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.708826 2576 scope.go:117] "RemoveContainer" containerID="fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593" Jun 10 11:26:39.709142 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:26:39.709119 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593\": container with ID starting with fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593 not found: ID does not exist" containerID="fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593" Jun 10 11:26:39.709219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.709150 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593"} err="failed to get container status \"fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593\": rpc error: code = NotFound desc = could not find container \"fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593\": container with ID starting with fbe1e643e623bebee73aac915a9a6440b9c10146f8099f0e53dd5ed66fd03593 not found: ID does not exist" Jun 10 11:26:39.729793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.729762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8d4fcddd-xxjsn"] Jun 10 11:26:39.736727 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:39.736695 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8d4fcddd-xxjsn"] Jun 10 11:26:40.394748 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:40.394715 2576 scope.go:117] "RemoveContainer" containerID="6bdd926670f7ad1998e54468fed7df54e7a18e43460a48ef0456e2d664978160" Jun 10 11:26:40.429527 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:40.429500 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" path="/var/lib/kubelet/pods/b7ed9d6c-1f05-431a-9dfd-480ca0158fc3/volumes" Jun 10 11:26:40.558095 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:40.558045 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:40.659097 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:40.658998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:48.606379 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:48.606338 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:48.703541 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:48.703509 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:49.221414 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:49.221374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:49.329590 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:49.329552 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:52.992993 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:52.992948 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:53.096200 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:53.096165 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:56.996232 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:56.996186 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:26:57.092259 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:26:57.092223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:00.395353 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:00.395318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:00.493635 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:00.493597 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:01.833567 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:01.833529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" event={"ID":"50c72fa1-1327-46f8-87e8-8d1b37f60038","Type":"ContainerStarted","Data":"84e6fac6648b58748ad4626484179f56eefe1c68b2caa87f618cb8d8a27af933"} Jun 10 11:27:01.853504 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:01.853432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gwxgj" podStartSLOduration=2.472496152 podStartE2EDuration="24.853418716s" totalImagesPullingTime="22.380922564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:27:01.852224715 +0000 UTC m=+501.898400722" watchObservedRunningTime="2026-06-10 11:27:01.853418716 +0000 UTC m=+501.899594722" Jun 10 11:27:19.331958 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:19.331928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:19.397703 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:19.397668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:22.448799 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:22.448760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:33.702409 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:33.702364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:33.813638 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:33.813603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:33.877749 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:33.877717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:34.594274 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.594238 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ts5pc"] Jun 10 11:27:34.594588 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.594565 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" containerName="console" Jun 10 11:27:34.594588 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.594582 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" containerName="console" Jun 10 11:27:34.594790 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.594660 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7ed9d6c-1f05-431a-9dfd-480ca0158fc3" containerName="console" Jun 10 11:27:34.604586 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.604559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:34.610223 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.610199 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m787j\"" Jun 10 11:27:34.616076 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.616051 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts5pc"] Jun 10 11:27:34.640265 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.640233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:34.737933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.737900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:34.749913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.749881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz5gx\" (UniqueName: \"kubernetes.io/projected/2b537ab4-39f3-43a9-8486-6c1debd2eb4b-kube-api-access-tz5gx\") pod \"authorino-58cd955675-ts5pc\" (UID: \"2b537ab4-39f3-43a9-8486-6c1debd2eb4b\") " pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:34.811741 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.811702 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwrmz"] Jun 10 11:27:34.813784 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.813767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:27:34.826534 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.826508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwrmz"] Jun 10 11:27:34.851391 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.851304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz5gx\" (UniqueName: \"kubernetes.io/projected/2b537ab4-39f3-43a9-8486-6c1debd2eb4b-kube-api-access-tz5gx\") pod \"authorino-58cd955675-ts5pc\" (UID: \"2b537ab4-39f3-43a9-8486-6c1debd2eb4b\") " pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:34.864661 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.864634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz5gx\" (UniqueName: \"kubernetes.io/projected/2b537ab4-39f3-43a9-8486-6c1debd2eb4b-kube-api-access-tz5gx\") pod \"authorino-58cd955675-ts5pc\" (UID: \"2b537ab4-39f3-43a9-8486-6c1debd2eb4b\") " pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:34.913380 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.913338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:34.951916 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:34.951881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv94w\" (UniqueName: \"kubernetes.io/projected/4794ef06-d4eb-4bc0-b46c-69829fc16591-kube-api-access-hv94w\") pod \"authorino-75d556bd77-hwrmz\" (UID: \"4794ef06-d4eb-4bc0-b46c-69829fc16591\") " pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:27:35.053391 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:35.053337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv94w\" (UniqueName: \"kubernetes.io/projected/4794ef06-d4eb-4bc0-b46c-69829fc16591-kube-api-access-hv94w\") pod \"authorino-75d556bd77-hwrmz\" (UID: \"4794ef06-d4eb-4bc0-b46c-69829fc16591\") " pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:27:35.063953 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:35.063873 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts5pc"] Jun 10 11:27:35.066621 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:27:35.066589 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b537ab4_39f3_43a9_8486_6c1debd2eb4b.slice/crio-fdcfe6e490c6139d108ef573aed7b97004e72d8301d2b6fcf7e1a1317d9e33f3 WatchSource:0}: Error finding container fdcfe6e490c6139d108ef573aed7b97004e72d8301d2b6fcf7e1a1317d9e33f3: Status 404 returned error can't find the container with id fdcfe6e490c6139d108ef573aed7b97004e72d8301d2b6fcf7e1a1317d9e33f3 Jun 10 11:27:35.067247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:35.067224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv94w\" (UniqueName: \"kubernetes.io/projected/4794ef06-d4eb-4bc0-b46c-69829fc16591-kube-api-access-hv94w\") pod \"authorino-75d556bd77-hwrmz\" (UID: \"4794ef06-d4eb-4bc0-b46c-69829fc16591\") " pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:27:35.123262 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:35.123173 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:27:35.258321 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:35.258296 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwrmz"] Jun 10 11:27:35.260087 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:27:35.260056 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4794ef06_d4eb_4bc0_b46c_69829fc16591.slice/crio-1529e1a326ab52e9bf080709f371db7fe4346bf03a29275de01edbf3c2fc3dc0 WatchSource:0}: Error finding container 1529e1a326ab52e9bf080709f371db7fe4346bf03a29275de01edbf3c2fc3dc0: Status 404 returned error can't find the container with id 1529e1a326ab52e9bf080709f371db7fe4346bf03a29275de01edbf3c2fc3dc0 Jun 10 11:27:36.010881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:36.010841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts5pc" event={"ID":"2b537ab4-39f3-43a9-8486-6c1debd2eb4b","Type":"ContainerStarted","Data":"fdcfe6e490c6139d108ef573aed7b97004e72d8301d2b6fcf7e1a1317d9e33f3"} Jun 10 11:27:36.012736 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:36.012700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwrmz" event={"ID":"4794ef06-d4eb-4bc0-b46c-69829fc16591","Type":"ContainerStarted","Data":"1529e1a326ab52e9bf080709f371db7fe4346bf03a29275de01edbf3c2fc3dc0"} Jun 10 11:27:39.031711 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:39.031603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts5pc" event={"ID":"2b537ab4-39f3-43a9-8486-6c1debd2eb4b","Type":"ContainerStarted","Data":"6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b"} Jun 10 11:27:39.034255 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:39.034227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwrmz" event={"ID":"4794ef06-d4eb-4bc0-b46c-69829fc16591","Type":"ContainerStarted","Data":"efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9"} Jun 10 11:27:39.049451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:39.049400 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ts5pc" podStartSLOduration=1.571765676 podStartE2EDuration="5.049386823s" totalImagesPullingTime="3.477621147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:27:39.048780827 +0000 UTC m=+539.094956833" watchObservedRunningTime="2026-06-10 11:27:39.049386823 +0000 UTC m=+539.095562829" Jun 10 11:27:39.065952 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:39.065901 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hwrmz" podStartSLOduration=1.778285215 podStartE2EDuration="5.065887713s" totalImagesPullingTime="3.287602498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:27:39.063842594 +0000 UTC m=+539.110018605" watchObservedRunningTime="2026-06-10 11:27:39.065887713 +0000 UTC m=+539.112063719" Jun 10 11:27:39.094962 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:39.094930 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts5pc"] Jun 10 11:27:41.044144 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:41.044095 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ts5pc" podUID="2b537ab4-39f3-43a9-8486-6c1debd2eb4b" containerName="authorino" containerID="cri-o://6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b" gracePeriod=30 Jun 10 11:27:41.285710 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:41.285679 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:41.411271 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:41.411176 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz5gx\" (UniqueName: \"kubernetes.io/projected/2b537ab4-39f3-43a9-8486-6c1debd2eb4b-kube-api-access-tz5gx\") pod \"2b537ab4-39f3-43a9-8486-6c1debd2eb4b\" (UID: \"2b537ab4-39f3-43a9-8486-6c1debd2eb4b\") " Jun 10 11:27:41.413420 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:41.413386 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b537ab4-39f3-43a9-8486-6c1debd2eb4b-kube-api-access-tz5gx" (OuterVolumeSpecName: "kube-api-access-tz5gx") pod "2b537ab4-39f3-43a9-8486-6c1debd2eb4b" (UID: "2b537ab4-39f3-43a9-8486-6c1debd2eb4b"). InnerVolumeSpecName "kube-api-access-tz5gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:27:41.511708 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:41.511674 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz5gx\" (UniqueName: \"kubernetes.io/projected/2b537ab4-39f3-43a9-8486-6c1debd2eb4b-kube-api-access-tz5gx\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:27:42.050307 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.050273 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b537ab4-39f3-43a9-8486-6c1debd2eb4b" containerID="6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b" exitCode=0 Jun 10 11:27:42.050696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.050318 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts5pc" Jun 10 11:27:42.050696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.050363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts5pc" event={"ID":"2b537ab4-39f3-43a9-8486-6c1debd2eb4b","Type":"ContainerDied","Data":"6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b"} Jun 10 11:27:42.050696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.050405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts5pc" event={"ID":"2b537ab4-39f3-43a9-8486-6c1debd2eb4b","Type":"ContainerDied","Data":"fdcfe6e490c6139d108ef573aed7b97004e72d8301d2b6fcf7e1a1317d9e33f3"} Jun 10 11:27:42.050696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.050421 2576 scope.go:117] "RemoveContainer" containerID="6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b" Jun 10 11:27:42.066782 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.066754 2576 scope.go:117] "RemoveContainer" containerID="6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b" Jun 10 11:27:42.067191 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:27:42.067161 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b\": container with ID starting with 6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b not found: ID does not exist" containerID="6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b" Jun 10 11:27:42.067282 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.067204 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b"} err="failed to get container status \"6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b\": rpc error: code = NotFound desc = could not find container \"6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b\": container with ID starting with 6e9ded1196f5bd9d5789894b6296f237a81ebdb05a13ccffcc4e460a70bfb76b not found: ID does not exist" Jun 10 11:27:42.078461 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.078428 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts5pc"] Jun 10 11:27:42.082166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.082145 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts5pc"] Jun 10 11:27:42.428139 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:42.428051 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b537ab4-39f3-43a9-8486-6c1debd2eb4b" path="/var/lib/kubelet/pods/2b537ab4-39f3-43a9-8486-6c1debd2eb4b/volumes" Jun 10 11:27:50.063056 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:50.063015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:27:54.658866 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:27:54.658826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:05.861894 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:05.861847 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:05.960951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:05.960911 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:06.108324 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:06.108291 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:07.092778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.092740 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd"] Jun 10 11:28:07.093166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.093056 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b537ab4-39f3-43a9-8486-6c1debd2eb4b" containerName="authorino" Jun 10 11:28:07.093166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.093068 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b537ab4-39f3-43a9-8486-6c1debd2eb4b" containerName="authorino" Jun 10 11:28:07.093166 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.093136 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b537ab4-39f3-43a9-8486-6c1debd2eb4b" containerName="authorino" Jun 10 11:28:07.096416 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.096398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.099123 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.099102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 11:28:07.099123 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.099111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qb58x\"" Jun 10 11:28:07.100256 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.100240 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 11:28:07.105206 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.105183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd"] Jun 10 11:28:07.219757 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.219722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.219757 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.219760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.220014 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.219798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rbt\" (UniqueName: \"kubernetes.io/projected/0df77237-46b4-48dc-b669-e12f3ca2a1cf-kube-api-access-c5rbt\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.320876 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.320833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rbt\" (UniqueName: \"kubernetes.io/projected/0df77237-46b4-48dc-b669-e12f3ca2a1cf-kube-api-access-c5rbt\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.321088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.320929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.321088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.320955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.321367 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.321344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.321437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.321365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.331599 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.331571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rbt\" (UniqueName: \"kubernetes.io/projected/0df77237-46b4-48dc-b669-e12f3ca2a1cf-kube-api-access-c5rbt\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.406251 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.406163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:07.541846 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:07.541820 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd"] Jun 10 11:28:07.543867 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:28:07.543840 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df77237_46b4_48dc_b669_e12f3ca2a1cf.slice/crio-a0870c5044508c5b80e811d7c668662f700475df04c64f0672bf95a9e3684033 WatchSource:0}: Error finding container a0870c5044508c5b80e811d7c668662f700475df04c64f0672bf95a9e3684033: Status 404 returned error can't find the container with id a0870c5044508c5b80e811d7c668662f700475df04c64f0672bf95a9e3684033 Jun 10 11:28:08.186889 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:08.186855 2576 generic.go:356] "Generic (PLEG): container finished" podID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerID="b20da438159b8e35224f179526ac18ee920c8b5388c4a56b6801aa0acaeccf64" exitCode=0 Jun 10 11:28:08.187303 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:08.186906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" event={"ID":"0df77237-46b4-48dc-b669-e12f3ca2a1cf","Type":"ContainerDied","Data":"b20da438159b8e35224f179526ac18ee920c8b5388c4a56b6801aa0acaeccf64"} Jun 10 11:28:08.187303 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:08.186956 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" event={"ID":"0df77237-46b4-48dc-b669-e12f3ca2a1cf","Type":"ContainerStarted","Data":"a0870c5044508c5b80e811d7c668662f700475df04c64f0672bf95a9e3684033"} Jun 10 11:28:09.193863 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:09.193778 2576 generic.go:356] "Generic (PLEG): container finished" podID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerID="16e7a55cb92fea96dd48a0392394e04e5382d956a8b59e1d9772d4ce483c06fd" exitCode=0 Jun 10 11:28:09.194236 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:09.193863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" event={"ID":"0df77237-46b4-48dc-b669-e12f3ca2a1cf","Type":"ContainerDied","Data":"16e7a55cb92fea96dd48a0392394e04e5382d956a8b59e1d9772d4ce483c06fd"} Jun 10 11:28:10.200824 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:10.200784 2576 generic.go:356] "Generic (PLEG): container finished" podID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerID="9f98d215505199c9df9507f57d640ba084fdec0e9f3f8047c27260a04c055d72" exitCode=0 Jun 10 11:28:10.201276 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:10.200874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" event={"ID":"0df77237-46b4-48dc-b669-e12f3ca2a1cf","Type":"ContainerDied","Data":"9f98d215505199c9df9507f57d640ba084fdec0e9f3f8047c27260a04c055d72"} Jun 10 11:28:11.349604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.349572 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:11.454630 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.454590 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-util\") pod \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " Jun 10 11:28:11.454798 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.454668 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-bundle\") pod \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " Jun 10 11:28:11.454798 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.454706 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5rbt\" (UniqueName: \"kubernetes.io/projected/0df77237-46b4-48dc-b669-e12f3ca2a1cf-kube-api-access-c5rbt\") pod \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\" (UID: \"0df77237-46b4-48dc-b669-e12f3ca2a1cf\") " Jun 10 11:28:11.455202 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.455180 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-bundle" (OuterVolumeSpecName: "bundle") pod "0df77237-46b4-48dc-b669-e12f3ca2a1cf" (UID: "0df77237-46b4-48dc-b669-e12f3ca2a1cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:28:11.457008 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.456928 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df77237-46b4-48dc-b669-e12f3ca2a1cf-kube-api-access-c5rbt" (OuterVolumeSpecName: "kube-api-access-c5rbt") pod "0df77237-46b4-48dc-b669-e12f3ca2a1cf" (UID: "0df77237-46b4-48dc-b669-e12f3ca2a1cf"). InnerVolumeSpecName "kube-api-access-c5rbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:28:11.461169 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.461138 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-util" (OuterVolumeSpecName: "util") pod "0df77237-46b4-48dc-b669-e12f3ca2a1cf" (UID: "0df77237-46b4-48dc-b669-e12f3ca2a1cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:28:11.555881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.555846 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5rbt\" (UniqueName: \"kubernetes.io/projected/0df77237-46b4-48dc-b669-e12f3ca2a1cf-kube-api-access-c5rbt\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:28:11.555881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.555873 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-util\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:28:11.555881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:11.555887 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df77237-46b4-48dc-b669-e12f3ca2a1cf-bundle\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:28:12.212605 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:12.212569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" event={"ID":"0df77237-46b4-48dc-b669-e12f3ca2a1cf","Type":"ContainerDied","Data":"a0870c5044508c5b80e811d7c668662f700475df04c64f0672bf95a9e3684033"} Jun 10 11:28:12.212778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:12.212627 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0870c5044508c5b80e811d7c668662f700475df04c64f0672bf95a9e3684033" Jun 10 11:28:12.212778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:12.212584 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g5whd" Jun 10 11:28:29.584874 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:29.584841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:29.688862 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:29.688826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:30.076690 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.076651 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:28:30.077002 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.076969 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="extract" Jun 10 11:28:30.077002 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.076997 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="extract" Jun 10 11:28:30.077083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.077009 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="util" Jun 10 11:28:30.077083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.077014 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="util" Jun 10 11:28:30.077083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.077023 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="pull" Jun 10 11:28:30.077083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.077028 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="pull" Jun 10 11:28:30.077205 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.077085 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df77237-46b4-48dc-b669-e12f3ca2a1cf" containerName="extract" Jun 10 11:28:30.080092 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.080077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:30.082756 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.082732 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 11:28:30.082912 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.082819 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 11:28:30.084042 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.084022 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wxx6v\"" Jun 10 11:28:30.084174 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.084029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 11:28:30.095067 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.095039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:28:30.213916 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.213869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjgz6\" (UniqueName: \"kubernetes.io/projected/1feb060a-0985-4cab-99a9-87014f3ab2e9-kube-api-access-rjgz6\") pod \"maas-keycloak-0\" (UID: \"1feb060a-0985-4cab-99a9-87014f3ab2e9\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:30.314945 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.314908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjgz6\" (UniqueName: \"kubernetes.io/projected/1feb060a-0985-4cab-99a9-87014f3ab2e9-kube-api-access-rjgz6\") pod \"maas-keycloak-0\" (UID: \"1feb060a-0985-4cab-99a9-87014f3ab2e9\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:30.325062 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.325029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjgz6\" (UniqueName: \"kubernetes.io/projected/1feb060a-0985-4cab-99a9-87014f3ab2e9-kube-api-access-rjgz6\") pod \"maas-keycloak-0\" (UID: \"1feb060a-0985-4cab-99a9-87014f3ab2e9\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:30.389014 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.388891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:30.527201 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:30.527174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:28:30.528505 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:28:30.528478 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1feb060a_0985_4cab_99a9_87014f3ab2e9.slice/crio-21b2f4986e25f5948cf4ebcc4ee09a1a1e1c3155253376ad004ba085c52977c6 WatchSource:0}: Error finding container 21b2f4986e25f5948cf4ebcc4ee09a1a1e1c3155253376ad004ba085c52977c6: Status 404 returned error can't find the container with id 21b2f4986e25f5948cf4ebcc4ee09a1a1e1c3155253376ad004ba085c52977c6 Jun 10 11:28:31.315960 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:31.315918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1feb060a-0985-4cab-99a9-87014f3ab2e9","Type":"ContainerStarted","Data":"21b2f4986e25f5948cf4ebcc4ee09a1a1e1c3155253376ad004ba085c52977c6"} Jun 10 11:28:36.354340 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:36.354293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1feb060a-0985-4cab-99a9-87014f3ab2e9","Type":"ContainerStarted","Data":"0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02"} Jun 10 11:28:36.377989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:36.377920 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.297026614 podStartE2EDuration="6.377897598s" totalImagesPullingTime="5.080870984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:28:36.374810324 +0000 UTC m=+596.420986343" watchObservedRunningTime="2026-06-10 11:28:36.377897598 +0000 UTC m=+596.424073605" Jun 10 11:28:36.389072 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:36.389030 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:36.390687 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:36.390646 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:37.390076 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:37.390022 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:38.389366 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:38.389327 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:39.389652 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:39.389610 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:40.390558 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:40.389892 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:40.392443 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:40.392387 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:40.427179 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:40.427149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:28:40.434359 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:40.434331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:28:40.586203 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:40.586166 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:40.686212 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:40.686114 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:41.389801 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:41.389460 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:42.389716 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:42.389670 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:43.390451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:43.390403 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:44.390428 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:44.390375 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:45.390287 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:45.390236 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:46.390225 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:46.390174 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:47.389932 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:47.389882 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 10 11:28:48.485863 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:48.485806 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:48.499369 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:48.499323 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 11:28:58.492099 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:58.492012 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 11:28:59.156676 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.156647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:28:59.408490 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.408411 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vdk9"] Jun 10 11:28:59.411858 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.411840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:28:59.431884 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.431857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vdk9"] Jun 10 11:28:59.486896 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.486857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rbhw\" (UniqueName: \"kubernetes.io/projected/2b3e034f-3ada-467b-af38-107968d6a1ef-kube-api-access-9rbhw\") pod \"authorino-5d4b67c446-2vdk9\" (UID: \"2b3e034f-3ada-467b-af38-107968d6a1ef\") " pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:28:59.587696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.587657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rbhw\" (UniqueName: \"kubernetes.io/projected/2b3e034f-3ada-467b-af38-107968d6a1ef-kube-api-access-9rbhw\") pod \"authorino-5d4b67c446-2vdk9\" (UID: \"2b3e034f-3ada-467b-af38-107968d6a1ef\") " pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:28:59.597147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.597123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rbhw\" (UniqueName: \"kubernetes.io/projected/2b3e034f-3ada-467b-af38-107968d6a1ef-kube-api-access-9rbhw\") pod \"authorino-5d4b67c446-2vdk9\" (UID: \"2b3e034f-3ada-467b-af38-107968d6a1ef\") " pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:28:59.632695 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.631780 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vdk9"] Jun 10 11:28:59.632695 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.632398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:28:59.657767 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.657730 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6455dd4794-khzgv"] Jun 10 11:28:59.662292 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.662226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:28:59.668881 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.668847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6455dd4794-khzgv"] Jun 10 11:28:59.776995 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.776953 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vdk9"] Jun 10 11:28:59.778844 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:28:59.778808 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b3e034f_3ada_467b_af38_107968d6a1ef.slice/crio-1b712b40f36d49d9082682535d6e149c25ac43ee663effba2696cb73c9c6b0b1 WatchSource:0}: Error finding container 1b712b40f36d49d9082682535d6e149c25ac43ee663effba2696cb73c9c6b0b1: Status 404 returned error can't find the container with id 1b712b40f36d49d9082682535d6e149c25ac43ee663effba2696cb73c9c6b0b1 Jun 10 11:28:59.780184 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.780163 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:28:59.789526 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.789503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4fh\" (UniqueName: \"kubernetes.io/projected/a465fbef-b812-4b9d-a972-9b9649914f8d-kube-api-access-5h4fh\") pod \"authorino-6455dd4794-khzgv\" (UID: \"a465fbef-b812-4b9d-a972-9b9649914f8d\") " pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:28:59.844463 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.844429 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6455dd4794-khzgv"] Jun 10 11:28:59.844677 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:28:59.844657 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5h4fh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6455dd4794-khzgv" podUID="a465fbef-b812-4b9d-a972-9b9649914f8d" Jun 10 11:28:59.874793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.874755 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bf7c66f7d-6jc8z"] Jun 10 11:28:59.878351 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.878332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:28:59.881256 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.881234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 11:28:59.887955 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.887931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bf7c66f7d-6jc8z"] Jun 10 11:28:59.889946 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.889923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4fh\" (UniqueName: \"kubernetes.io/projected/a465fbef-b812-4b9d-a972-9b9649914f8d-kube-api-access-5h4fh\") pod \"authorino-6455dd4794-khzgv\" (UID: \"a465fbef-b812-4b9d-a972-9b9649914f8d\") " pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:28:59.899261 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.899233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4fh\" (UniqueName: \"kubernetes.io/projected/a465fbef-b812-4b9d-a972-9b9649914f8d-kube-api-access-5h4fh\") pod \"authorino-6455dd4794-khzgv\" (UID: \"a465fbef-b812-4b9d-a972-9b9649914f8d\") " pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:28:59.991183 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.991074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2c0b340-11c7-4662-87cc-4b1da134573c-tls-cert\") pod \"authorino-bf7c66f7d-6jc8z\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:28:59.991342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:28:59.991209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnb5w\" (UniqueName: \"kubernetes.io/projected/d2c0b340-11c7-4662-87cc-4b1da134573c-kube-api-access-mnb5w\") pod \"authorino-bf7c66f7d-6jc8z\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:29:00.092653 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.092629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnb5w\" (UniqueName: \"kubernetes.io/projected/d2c0b340-11c7-4662-87cc-4b1da134573c-kube-api-access-mnb5w\") pod \"authorino-bf7c66f7d-6jc8z\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:29:00.092739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.092677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2c0b340-11c7-4662-87cc-4b1da134573c-tls-cert\") pod \"authorino-bf7c66f7d-6jc8z\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:29:00.095248 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.095219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2c0b340-11c7-4662-87cc-4b1da134573c-tls-cert\") pod \"authorino-bf7c66f7d-6jc8z\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:29:00.101702 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.101674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnb5w\" (UniqueName: \"kubernetes.io/projected/d2c0b340-11c7-4662-87cc-4b1da134573c-kube-api-access-mnb5w\") pod \"authorino-bf7c66f7d-6jc8z\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:29:00.188388 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.188350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:29:00.305223 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.305188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:00.330503 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.330476 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bf7c66f7d-6jc8z"] Jun 10 11:29:00.331726 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:29:00.331690 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2c0b340_11c7_4662_87cc_4b1da134573c.slice/crio-437c3fdde97ee7f69af9ba5347673f047428e90148cd47f54e0d853e9a8c9acd WatchSource:0}: Error finding container 437c3fdde97ee7f69af9ba5347673f047428e90148cd47f54e0d853e9a8c9acd: Status 404 returned error can't find the container with id 437c3fdde97ee7f69af9ba5347673f047428e90148cd47f54e0d853e9a8c9acd Jun 10 11:29:00.518612 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.518506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" event={"ID":"d2c0b340-11c7-4662-87cc-4b1da134573c","Type":"ContainerStarted","Data":"437c3fdde97ee7f69af9ba5347673f047428e90148cd47f54e0d853e9a8c9acd"} Jun 10 11:29:00.519942 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.519912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" event={"ID":"2b3e034f-3ada-467b-af38-107968d6a1ef","Type":"ContainerStarted","Data":"569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842"} Jun 10 11:29:00.519942 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.519931 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" podUID="2b3e034f-3ada-467b-af38-107968d6a1ef" containerName="authorino" containerID="cri-o://569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842" gracePeriod=30 Jun 10 11:29:00.520202 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.519947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:29:00.520202 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.519952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" event={"ID":"2b3e034f-3ada-467b-af38-107968d6a1ef","Type":"ContainerStarted","Data":"1b712b40f36d49d9082682535d6e149c25ac43ee663effba2696cb73c9c6b0b1"} Jun 10 11:29:00.528688 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.528665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:29:00.537795 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.537751 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" podStartSLOduration=1.239266159 podStartE2EDuration="1.537736136s" totalImagesPullingTime="298.469977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:00.536525009 +0000 UTC m=+620.582701019" watchObservedRunningTime="2026-06-10 11:29:00.537736136 +0000 UTC m=+620.583912143" Jun 10 11:29:00.596809 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.596778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h4fh\" (UniqueName: \"kubernetes.io/projected/a465fbef-b812-4b9d-a972-9b9649914f8d-kube-api-access-5h4fh\") pod \"a465fbef-b812-4b9d-a972-9b9649914f8d\" (UID: \"a465fbef-b812-4b9d-a972-9b9649914f8d\") " Jun 10 11:29:00.599016 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.598968 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a465fbef-b812-4b9d-a972-9b9649914f8d-kube-api-access-5h4fh" (OuterVolumeSpecName: "kube-api-access-5h4fh") pod "a465fbef-b812-4b9d-a972-9b9649914f8d" (UID: "a465fbef-b812-4b9d-a972-9b9649914f8d"). InnerVolumeSpecName "kube-api-access-5h4fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:29:00.697570 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.697543 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h4fh\" (UniqueName: \"kubernetes.io/projected/a465fbef-b812-4b9d-a972-9b9649914f8d-kube-api-access-5h4fh\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:29:00.786765 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.786743 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:29:00.898947 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.898912 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rbhw\" (UniqueName: \"kubernetes.io/projected/2b3e034f-3ada-467b-af38-107968d6a1ef-kube-api-access-9rbhw\") pod \"2b3e034f-3ada-467b-af38-107968d6a1ef\" (UID: \"2b3e034f-3ada-467b-af38-107968d6a1ef\") " Jun 10 11:29:00.901116 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:00.901090 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3e034f-3ada-467b-af38-107968d6a1ef-kube-api-access-9rbhw" (OuterVolumeSpecName: "kube-api-access-9rbhw") pod "2b3e034f-3ada-467b-af38-107968d6a1ef" (UID: "2b3e034f-3ada-467b-af38-107968d6a1ef"). InnerVolumeSpecName "kube-api-access-9rbhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:29:01.000535 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.000494 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rbhw\" (UniqueName: \"kubernetes.io/projected/2b3e034f-3ada-467b-af38-107968d6a1ef-kube-api-access-9rbhw\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:29:01.527025 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.526961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" event={"ID":"d2c0b340-11c7-4662-87cc-4b1da134573c","Type":"ContainerStarted","Data":"1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178"} Jun 10 11:29:01.528164 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.528135 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b3e034f-3ada-467b-af38-107968d6a1ef" containerID="569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842" exitCode=0 Jun 10 11:29:01.528164 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.528164 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" Jun 10 11:29:01.528334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.528215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" event={"ID":"2b3e034f-3ada-467b-af38-107968d6a1ef","Type":"ContainerDied","Data":"569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842"} Jun 10 11:29:01.528334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.528252 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vdk9" event={"ID":"2b3e034f-3ada-467b-af38-107968d6a1ef","Type":"ContainerDied","Data":"1b712b40f36d49d9082682535d6e149c25ac43ee663effba2696cb73c9c6b0b1"} Jun 10 11:29:01.528334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.528269 2576 scope.go:117] "RemoveContainer" containerID="569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842" Jun 10 11:29:01.528334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.528282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6455dd4794-khzgv" Jun 10 11:29:01.537550 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.537529 2576 scope.go:117] "RemoveContainer" containerID="569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842" Jun 10 11:29:01.537878 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:01.537857 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842\": container with ID starting with 569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842 not found: ID does not exist" containerID="569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842" Jun 10 11:29:01.537928 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.537888 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842"} err="failed to get container status \"569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842\": rpc error: code = NotFound desc = could not find container \"569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842\": container with ID starting with 569a7ad61ef7453e241f9332d49a3d6a29ae167f143113f510dece4321580842 not found: ID does not exist" Jun 10 11:29:01.547043 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.546990 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" podStartSLOduration=2.145302648 podStartE2EDuration="2.54695602s" totalImagesPullingTime="401.653372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:01.544556907 +0000 UTC m=+621.590732913" watchObservedRunningTime="2026-06-10 11:29:01.54695602 +0000 UTC m=+621.593132026" Jun 10 11:29:01.572365 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.572329 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6455dd4794-khzgv"] Jun 10 11:29:01.579243 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.579196 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwrmz"] Jun 10 11:29:01.579427 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.579401 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hwrmz" podUID="4794ef06-d4eb-4bc0-b46c-69829fc16591" containerName="authorino" containerID="cri-o://efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9" gracePeriod=30 Jun 10 11:29:01.581893 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.581866 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6455dd4794-khzgv"] Jun 10 11:29:01.595896 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.595861 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vdk9"] Jun 10 11:29:01.608053 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.608022 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vdk9"] Jun 10 11:29:01.830877 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.830849 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:29:01.907764 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.907727 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv94w\" (UniqueName: \"kubernetes.io/projected/4794ef06-d4eb-4bc0-b46c-69829fc16591-kube-api-access-hv94w\") pod \"4794ef06-d4eb-4bc0-b46c-69829fc16591\" (UID: \"4794ef06-d4eb-4bc0-b46c-69829fc16591\") " Jun 10 11:29:01.910133 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:01.910106 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4794ef06-d4eb-4bc0-b46c-69829fc16591-kube-api-access-hv94w" (OuterVolumeSpecName: "kube-api-access-hv94w") pod "4794ef06-d4eb-4bc0-b46c-69829fc16591" (UID: "4794ef06-d4eb-4bc0-b46c-69829fc16591"). InnerVolumeSpecName "kube-api-access-hv94w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:29:02.009065 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.009026 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv94w\" (UniqueName: \"kubernetes.io/projected/4794ef06-d4eb-4bc0-b46c-69829fc16591-kube-api-access-hv94w\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:29:02.428320 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.428289 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3e034f-3ada-467b-af38-107968d6a1ef" path="/var/lib/kubelet/pods/2b3e034f-3ada-467b-af38-107968d6a1ef/volumes" Jun 10 11:29:02.428599 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.428586 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a465fbef-b812-4b9d-a972-9b9649914f8d" path="/var/lib/kubelet/pods/a465fbef-b812-4b9d-a972-9b9649914f8d/volumes" Jun 10 11:29:02.534525 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.534488 2576 generic.go:356] "Generic (PLEG): container finished" podID="4794ef06-d4eb-4bc0-b46c-69829fc16591" containerID="efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9" exitCode=0 Jun 10 11:29:02.534685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.534531 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwrmz" Jun 10 11:29:02.534685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.534576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwrmz" event={"ID":"4794ef06-d4eb-4bc0-b46c-69829fc16591","Type":"ContainerDied","Data":"efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9"} Jun 10 11:29:02.534685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.534611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwrmz" event={"ID":"4794ef06-d4eb-4bc0-b46c-69829fc16591","Type":"ContainerDied","Data":"1529e1a326ab52e9bf080709f371db7fe4346bf03a29275de01edbf3c2fc3dc0"} Jun 10 11:29:02.534685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.534630 2576 scope.go:117] "RemoveContainer" containerID="efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9" Jun 10 11:29:02.543576 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.543557 2576 scope.go:117] "RemoveContainer" containerID="efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9" Jun 10 11:29:02.543882 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:02.543862 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9\": container with ID starting with efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9 not found: ID does not exist" containerID="efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9" Jun 10 11:29:02.543934 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.543893 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9"} err="failed to get container status \"efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9\": rpc error: code = NotFound desc = could not find container \"efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9\": container with ID starting with efb433e1c257453a15bc52796ff56040110dbbd095ba407606d2848dc0225bf9 not found: ID does not exist" Jun 10 11:29:02.565280 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.565243 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwrmz"] Jun 10 11:29:02.568548 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:02.568520 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwrmz"] Jun 10 11:29:04.428031 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:04.427967 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4794ef06-d4eb-4bc0-b46c-69829fc16591" path="/var/lib/kubelet/pods/4794ef06-d4eb-4bc0-b46c-69829fc16591/volumes" Jun 10 11:29:05.315249 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.315220 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:05.344795 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.344761 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d8bf84cd4-69mfh"] Jun 10 11:29:05.345130 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.345117 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e034f-3ada-467b-af38-107968d6a1ef" containerName="authorino" Jun 10 11:29:05.345191 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.345132 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e034f-3ada-467b-af38-107968d6a1ef" containerName="authorino" Jun 10 11:29:05.345191 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.345142 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4794ef06-d4eb-4bc0-b46c-69829fc16591" containerName="authorino" Jun 10 11:29:05.345191 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.345148 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4794ef06-d4eb-4bc0-b46c-69829fc16591" containerName="authorino" Jun 10 11:29:05.345282 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.345206 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e034f-3ada-467b-af38-107968d6a1ef" containerName="authorino" Jun 10 11:29:05.345282 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.345216 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4794ef06-d4eb-4bc0-b46c-69829fc16591" containerName="authorino" Jun 10 11:29:05.415029 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.414967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:05.417192 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.417168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8bf84cd4-69mfh"] Jun 10 11:29:05.417296 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.417283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:05.420862 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.420839 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 11:29:05.420989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.420884 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 11:29:05.420989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.420887 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rbt2m\"" Jun 10 11:29:05.472144 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.472099 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:05.514685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.514614 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-ntk8b"] Jun 10 11:29:05.537770 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.537736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:05.538103 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.538074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddnx\" (UniqueName: \"kubernetes.io/projected/b585500e-85c8-412c-8af3-18687b3937b7-kube-api-access-sddnx\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:05.546476 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.546455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-ntk8b"] Jun 10 11:29:05.546588 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.546562 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:05.639276 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.639188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:05.639276 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.639243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddnx\" (UniqueName: \"kubernetes.io/projected/b585500e-85c8-412c-8af3-18687b3937b7-kube-api-access-sddnx\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:05.639449 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.639312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:05.639449 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.639366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8hfj\" (UniqueName: \"kubernetes.io/projected/1825ffb2-462f-46ab-8ee4-deea0013a49f-kube-api-access-m8hfj\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:05.639532 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:05.639488 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 11:29:05.639594 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:05.639582 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert podName:b585500e-85c8-412c-8af3-18687b3937b7 nodeName:}" failed. No retries permitted until 2026-06-10 11:29:06.139559109 +0000 UTC m=+626.185735094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert") pod "maas-controller-6d8bf84cd4-69mfh" (UID: "b585500e-85c8-412c-8af3-18687b3937b7") : secret "maas-controller-webhook-cert" not found Jun 10 11:29:05.651329 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.651301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddnx\" (UniqueName: \"kubernetes.io/projected/b585500e-85c8-412c-8af3-18687b3937b7-kube-api-access-sddnx\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:05.740486 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.740446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:05.740668 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.740551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8hfj\" (UniqueName: \"kubernetes.io/projected/1825ffb2-462f-46ab-8ee4-deea0013a49f-kube-api-access-m8hfj\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:05.740668 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:05.740600 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 11:29:05.740733 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:05.740675 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert podName:1825ffb2-462f-46ab-8ee4-deea0013a49f nodeName:}" failed. No retries permitted until 2026-06-10 11:29:06.240658064 +0000 UTC m=+626.286834049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert") pod "maas-controller-68d4cdc5b-ntk8b" (UID: "1825ffb2-462f-46ab-8ee4-deea0013a49f") : secret "maas-controller-webhook-cert" not found Jun 10 11:29:05.751232 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.751202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8hfj\" (UniqueName: \"kubernetes.io/projected/1825ffb2-462f-46ab-8ee4-deea0013a49f-kube-api-access-m8hfj\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:05.999785 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:05.999702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:06.144572 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.144530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:06.147030 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.147002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert\") pod \"maas-controller-6d8bf84cd4-69mfh\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:06.245366 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.245321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:06.247823 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.247799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert\") pod \"maas-controller-68d4cdc5b-ntk8b\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:06.327648 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.327603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:06.456715 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.456683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:06.496169 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:29:06.496139 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb585500e_85c8_412c_8af3_18687b3937b7.slice/crio-0a238adb2d28822b98f15792f1d1102a46a7135637607c4a0aeb727b26160483 WatchSource:0}: Error finding container 0a238adb2d28822b98f15792f1d1102a46a7135637607c4a0aeb727b26160483: Status 404 returned error can't find the container with id 0a238adb2d28822b98f15792f1d1102a46a7135637607c4a0aeb727b26160483 Jun 10 11:29:06.496468 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.496167 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8bf84cd4-69mfh"] Jun 10 11:29:06.560566 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.560535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" event={"ID":"b585500e-85c8-412c-8af3-18687b3937b7","Type":"ContainerStarted","Data":"0a238adb2d28822b98f15792f1d1102a46a7135637607c4a0aeb727b26160483"} Jun 10 11:29:06.600155 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:06.600127 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-ntk8b"] Jun 10 11:29:06.602532 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:29:06.602507 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1825ffb2_462f_46ab_8ee4_deea0013a49f.slice/crio-d24eaf523d5109d03d3866484f4a34ce540358974ead836ee974125324c23b1e WatchSource:0}: Error finding container d24eaf523d5109d03d3866484f4a34ce540358974ead836ee974125324c23b1e: Status 404 returned error can't find the container with id d24eaf523d5109d03d3866484f4a34ce540358974ead836ee974125324c23b1e Jun 10 11:29:07.570695 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:07.570656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" event={"ID":"1825ffb2-462f-46ab-8ee4-deea0013a49f","Type":"ContainerStarted","Data":"d24eaf523d5109d03d3866484f4a34ce540358974ead836ee974125324c23b1e"} Jun 10 11:29:09.262853 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.262818 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:09.359194 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.359093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:09.585234 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.585196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" event={"ID":"b585500e-85c8-412c-8af3-18687b3937b7","Type":"ContainerStarted","Data":"814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3"} Jun 10 11:29:09.585426 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.585343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:09.586743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.586721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" event={"ID":"1825ffb2-462f-46ab-8ee4-deea0013a49f","Type":"ContainerStarted","Data":"57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376"} Jun 10 11:29:09.586831 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.586773 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:09.620550 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.620432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" podStartSLOduration=2.068690171 podStartE2EDuration="4.620411686s" totalImagesPullingTime="2.551721515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:09.618661545 +0000 UTC m=+629.664837574" watchObservedRunningTime="2026-06-10 11:29:09.620411686 +0000 UTC m=+629.666587693" Jun 10 11:29:09.644267 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:09.644219 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" podStartSLOduration=2.186872745 podStartE2EDuration="4.644202882s" totalImagesPullingTime="2.457330137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:09.642770484 +0000 UTC m=+629.688946491" watchObservedRunningTime="2026-06-10 11:29:09.644202882 +0000 UTC m=+629.690378888" Jun 10 11:29:20.598863 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:20.598830 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:29:20.599335 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:20.599025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:20.653082 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:20.653049 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8bf84cd4-69mfh"] Jun 10 11:29:20.653300 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:20.653275 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" podUID="b585500e-85c8-412c-8af3-18687b3937b7" containerName="manager" containerID="cri-o://814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3" gracePeriod=30 Jun 10 11:29:20.901522 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:20.901496 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:21.081424 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.081392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert\") pod \"b585500e-85c8-412c-8af3-18687b3937b7\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " Jun 10 11:29:21.081612 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.081492 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sddnx\" (UniqueName: \"kubernetes.io/projected/b585500e-85c8-412c-8af3-18687b3937b7-kube-api-access-sddnx\") pod \"b585500e-85c8-412c-8af3-18687b3937b7\" (UID: \"b585500e-85c8-412c-8af3-18687b3937b7\") " Jun 10 11:29:21.083812 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.083771 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b585500e-85c8-412c-8af3-18687b3937b7" (UID: "b585500e-85c8-412c-8af3-18687b3937b7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:29:21.083912 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.083813 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b585500e-85c8-412c-8af3-18687b3937b7-kube-api-access-sddnx" (OuterVolumeSpecName: "kube-api-access-sddnx") pod "b585500e-85c8-412c-8af3-18687b3937b7" (UID: "b585500e-85c8-412c-8af3-18687b3937b7"). InnerVolumeSpecName "kube-api-access-sddnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:29:21.182602 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.182516 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b585500e-85c8-412c-8af3-18687b3937b7-webhook-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:29:21.182602 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.182546 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sddnx\" (UniqueName: \"kubernetes.io/projected/b585500e-85c8-412c-8af3-18687b3937b7-kube-api-access-sddnx\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:29:21.652770 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.652736 2576 generic.go:356] "Generic (PLEG): container finished" podID="b585500e-85c8-412c-8af3-18687b3937b7" containerID="814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3" exitCode=0 Jun 10 11:29:21.653219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.652787 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" Jun 10 11:29:21.653219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.652803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" event={"ID":"b585500e-85c8-412c-8af3-18687b3937b7","Type":"ContainerDied","Data":"814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3"} Jun 10 11:29:21.653219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.652868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8bf84cd4-69mfh" event={"ID":"b585500e-85c8-412c-8af3-18687b3937b7","Type":"ContainerDied","Data":"0a238adb2d28822b98f15792f1d1102a46a7135637607c4a0aeb727b26160483"} Jun 10 11:29:21.653219 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.652887 2576 scope.go:117] "RemoveContainer" containerID="814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3" Jun 10 11:29:21.662069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.662054 2576 scope.go:117] "RemoveContainer" containerID="814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3" Jun 10 11:29:21.662295 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:21.662276 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3\": container with ID starting with 814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3 not found: ID does not exist" containerID="814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3" Jun 10 11:29:21.662339 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.662302 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3"} err="failed to get container status \"814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3\": rpc error: code = NotFound desc = could not find container \"814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3\": container with ID starting with 814db69dbf0db8da608a60c96087bdce918bf1b422d077be4585e22a8b4da3a3 not found: ID does not exist" Jun 10 11:29:21.675538 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.675511 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8bf84cd4-69mfh"] Jun 10 11:29:21.679748 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:21.679727 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d8bf84cd4-69mfh"] Jun 10 11:29:22.427957 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:22.427924 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b585500e-85c8-412c-8af3-18687b3937b7" path="/var/lib/kubelet/pods/b585500e-85c8-412c-8af3-18687b3937b7/volumes" Jun 10 11:29:37.638006 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.637930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:37.694839 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.694780 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-554b576757-jgrgh"] Jun 10 11:29:37.695177 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.695163 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b585500e-85c8-412c-8af3-18687b3937b7" containerName="manager" Jun 10 11:29:37.695245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.695178 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b585500e-85c8-412c-8af3-18687b3937b7" containerName="manager" Jun 10 11:29:37.695245 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.695236 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b585500e-85c8-412c-8af3-18687b3937b7" containerName="manager" Jun 10 11:29:37.699397 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.699374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:37.702526 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.702508 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 11:29:37.702779 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.702763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rgdh8\"" Jun 10 11:29:37.713592 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.713566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-554b576757-jgrgh"] Jun 10 11:29:37.721044 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.721013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrwn\" (UniqueName: \"kubernetes.io/projected/3e9475d4-5d61-4f4c-8956-bea17210eac3-kube-api-access-wcrwn\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:37.721203 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.721081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e9475d4-5d61-4f4c-8956-bea17210eac3-maas-api-tls\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:37.822482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.822445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrwn\" (UniqueName: \"kubernetes.io/projected/3e9475d4-5d61-4f4c-8956-bea17210eac3-kube-api-access-wcrwn\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:37.822655 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.822500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e9475d4-5d61-4f4c-8956-bea17210eac3-maas-api-tls\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:37.822655 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:37.822598 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 10 11:29:37.822739 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:37.822661 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9475d4-5d61-4f4c-8956-bea17210eac3-maas-api-tls podName:3e9475d4-5d61-4f4c-8956-bea17210eac3 nodeName:}" failed. No retries permitted until 2026-06-10 11:29:38.322645968 +0000 UTC m=+658.368821954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e9475d4-5d61-4f4c-8956-bea17210eac3-maas-api-tls") pod "maas-api-554b576757-jgrgh" (UID: "3e9475d4-5d61-4f4c-8956-bea17210eac3") : secret "maas-api-serving-cert" not found Jun 10 11:29:37.833617 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:37.833591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrwn\" (UniqueName: \"kubernetes.io/projected/3e9475d4-5d61-4f4c-8956-bea17210eac3-kube-api-access-wcrwn\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:38.075882 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.075846 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:38.171002 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.170956 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wl9zn"] Jun 10 11:29:38.172277 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.172249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:38.174440 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.174425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:38.178104 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.178086 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 11:29:38.185362 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.185341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wl9zn"] Jun 10 11:29:38.231662 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.225788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb99b\" (UniqueName: \"kubernetes.io/projected/800a51d9-0307-4455-9508-1a7a62860766-kube-api-access-jb99b\") pod \"payload-pre-processing-579785bc64-wl9zn\" (UID: \"800a51d9-0307-4455-9508-1a7a62860766\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:38.233378 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.233351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:38.326707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.326597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e9475d4-5d61-4f4c-8956-bea17210eac3-maas-api-tls\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:38.326707 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.326641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb99b\" (UniqueName: \"kubernetes.io/projected/800a51d9-0307-4455-9508-1a7a62860766-kube-api-access-jb99b\") pod \"payload-pre-processing-579785bc64-wl9zn\" (UID: \"800a51d9-0307-4455-9508-1a7a62860766\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:38.329240 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.329214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e9475d4-5d61-4f4c-8956-bea17210eac3-maas-api-tls\") pod \"maas-api-554b576757-jgrgh\" (UID: \"3e9475d4-5d61-4f4c-8956-bea17210eac3\") " pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:38.340941 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.340908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb99b\" (UniqueName: \"kubernetes.io/projected/800a51d9-0307-4455-9508-1a7a62860766-kube-api-access-jb99b\") pod \"payload-pre-processing-579785bc64-wl9zn\" (UID: \"800a51d9-0307-4455-9508-1a7a62860766\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:38.485194 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.485151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:38.610350 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.610249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:38.631429 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.631389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wl9zn"] Jun 10 11:29:38.631941 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:29:38.631911 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800a51d9_0307_4455_9508_1a7a62860766.slice/crio-b25e8a22469c0de7ed84b5d73e3621fbdb771559a95412733f4aee2b458dbf9c WatchSource:0}: Error finding container b25e8a22469c0de7ed84b5d73e3621fbdb771559a95412733f4aee2b458dbf9c: Status 404 returned error can't find the container with id b25e8a22469c0de7ed84b5d73e3621fbdb771559a95412733f4aee2b458dbf9c Jun 10 11:29:38.743913 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.743874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" event={"ID":"800a51d9-0307-4455-9508-1a7a62860766","Type":"ContainerStarted","Data":"b25e8a22469c0de7ed84b5d73e3621fbdb771559a95412733f4aee2b458dbf9c"} Jun 10 11:29:38.751258 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:38.751230 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-554b576757-jgrgh"] Jun 10 11:29:38.752492 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:29:38.752469 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9475d4_5d61_4f4c_8956_bea17210eac3.slice/crio-ecbb9881fc7639af0980c014fa5e77b107d2daada9de7a7b0fb88011964efcea WatchSource:0}: Error finding container ecbb9881fc7639af0980c014fa5e77b107d2daada9de7a7b0fb88011964efcea: Status 404 returned error can't find the container with id ecbb9881fc7639af0980c014fa5e77b107d2daada9de7a7b0fb88011964efcea Jun 10 11:29:39.752083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:39.752044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-554b576757-jgrgh" event={"ID":"3e9475d4-5d61-4f4c-8956-bea17210eac3","Type":"ContainerStarted","Data":"ecbb9881fc7639af0980c014fa5e77b107d2daada9de7a7b0fb88011964efcea"} Jun 10 11:29:41.261223 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:41.261201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 11:29:41.766405 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:41.766372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" event={"ID":"800a51d9-0307-4455-9508-1a7a62860766","Type":"ContainerStarted","Data":"9bdcfe8fc9201bbbea30143c900e1efda20b1fa7216fa74b0e33eea6bb2bf2a6"} Jun 10 11:29:41.773640 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:41.773602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-554b576757-jgrgh" event={"ID":"3e9475d4-5d61-4f4c-8956-bea17210eac3","Type":"ContainerStarted","Data":"d965139b283345d8b1b57ac3b6bc7cffeeedcaad3903b5e1452fd0506924ca31"} Jun 10 11:29:41.773833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:41.773672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:41.789990 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:41.789928 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" podStartSLOduration=1.165642283 podStartE2EDuration="3.789913988s" totalImagesPullingTime="2.624271705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:41.788599489 +0000 UTC m=+661.834775496" watchObservedRunningTime="2026-06-10 11:29:41.789913988 +0000 UTC m=+661.836090022" Jun 10 11:29:41.807716 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:41.807666 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-554b576757-jgrgh" podStartSLOduration=2.303515058 podStartE2EDuration="4.807651086s" totalImagesPullingTime="2.504136028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:41.806408899 +0000 UTC m=+661.852584904" watchObservedRunningTime="2026-06-10 11:29:41.807651086 +0000 UTC m=+661.853827093" Jun 10 11:29:42.774824 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:42.774784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:47.780071 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:47.780044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-554b576757-jgrgh" Jun 10 11:29:49.566525 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:49.566491 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:29:49.566928 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:49.566699 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" containerID="cri-o://0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02" gracePeriod=30 Jun 10 11:29:51.219990 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.219945 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:51.344190 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.344152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjgz6\" (UniqueName: \"kubernetes.io/projected/1feb060a-0985-4cab-99a9-87014f3ab2e9-kube-api-access-rjgz6\") pod \"1feb060a-0985-4cab-99a9-87014f3ab2e9\" (UID: \"1feb060a-0985-4cab-99a9-87014f3ab2e9\") " Jun 10 11:29:51.346407 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.346369 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1feb060a-0985-4cab-99a9-87014f3ab2e9-kube-api-access-rjgz6" (OuterVolumeSpecName: "kube-api-access-rjgz6") pod "1feb060a-0985-4cab-99a9-87014f3ab2e9" (UID: "1feb060a-0985-4cab-99a9-87014f3ab2e9"). InnerVolumeSpecName "kube-api-access-rjgz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:29:51.445281 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.445239 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjgz6\" (UniqueName: \"kubernetes.io/projected/1feb060a-0985-4cab-99a9-87014f3ab2e9-kube-api-access-rjgz6\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:29:51.826026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.825960 2576 generic.go:356] "Generic (PLEG): container finished" podID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerID="0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02" exitCode=143 Jun 10 11:29:51.826242 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.826038 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:51.826242 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.826053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1feb060a-0985-4cab-99a9-87014f3ab2e9","Type":"ContainerDied","Data":"0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02"} Jun 10 11:29:51.826242 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.826114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1feb060a-0985-4cab-99a9-87014f3ab2e9","Type":"ContainerDied","Data":"21b2f4986e25f5948cf4ebcc4ee09a1a1e1c3155253376ad004ba085c52977c6"} Jun 10 11:29:51.826242 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.826140 2576 scope.go:117] "RemoveContainer" containerID="0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02" Jun 10 11:29:51.836289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.836269 2576 scope.go:117] "RemoveContainer" containerID="0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02" Jun 10 11:29:51.836553 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:29:51.836530 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02\": container with ID starting with 0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02 not found: ID does not exist" containerID="0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02" Jun 10 11:29:51.836619 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.836567 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02"} err="failed to get container status \"0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02\": rpc error: code = NotFound desc = could not find container \"0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02\": container with ID starting with 0649e53122e0760a26bc0824298bf068c7ef5d0c2c2486584bd66e20d6a44a02 not found: ID does not exist" Jun 10 11:29:51.848262 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.848227 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:29:51.852135 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.852111 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:29:51.967250 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.967210 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:29:51.967572 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.967559 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" Jun 10 11:29:51.967623 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.967573 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" Jun 10 11:29:51.967660 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.967639 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" containerName="keycloak" Jun 10 11:29:51.972045 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.972025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:51.974935 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.974913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 11:29:51.975084 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.974933 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 11:29:51.975214 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.975197 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 11:29:51.975291 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.975207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wxx6v\"" Jun 10 11:29:51.975291 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.975256 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 11:29:51.981754 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:51.981726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:29:52.049777 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.049740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/96617214-67ea-4396-8d3a-a18a45711ab2-test-realms\") pod \"maas-keycloak-0\" (UID: \"96617214-67ea-4396-8d3a-a18a45711ab2\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.049959 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.049799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j6dd\" (UniqueName: \"kubernetes.io/projected/96617214-67ea-4396-8d3a-a18a45711ab2-kube-api-access-4j6dd\") pod \"maas-keycloak-0\" (UID: \"96617214-67ea-4396-8d3a-a18a45711ab2\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.150912 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.150814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j6dd\" (UniqueName: \"kubernetes.io/projected/96617214-67ea-4396-8d3a-a18a45711ab2-kube-api-access-4j6dd\") pod \"maas-keycloak-0\" (UID: \"96617214-67ea-4396-8d3a-a18a45711ab2\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.150912 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.150901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/96617214-67ea-4396-8d3a-a18a45711ab2-test-realms\") pod \"maas-keycloak-0\" (UID: \"96617214-67ea-4396-8d3a-a18a45711ab2\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.151556 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.151536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/96617214-67ea-4396-8d3a-a18a45711ab2-test-realms\") pod \"maas-keycloak-0\" (UID: \"96617214-67ea-4396-8d3a-a18a45711ab2\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.166539 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.166514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j6dd\" (UniqueName: \"kubernetes.io/projected/96617214-67ea-4396-8d3a-a18a45711ab2-kube-api-access-4j6dd\") pod \"maas-keycloak-0\" (UID: \"96617214-67ea-4396-8d3a-a18a45711ab2\") " pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.283151 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.283115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:52.419335 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.419253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 11:29:52.422917 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:29:52.422889 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96617214_67ea_4396_8d3a_a18a45711ab2.slice/crio-3aa152dca75bda43e0ed65f88439da37cefe8cf47fbd28de768914224242ef45 WatchSource:0}: Error finding container 3aa152dca75bda43e0ed65f88439da37cefe8cf47fbd28de768914224242ef45: Status 404 returned error can't find the container with id 3aa152dca75bda43e0ed65f88439da37cefe8cf47fbd28de768914224242ef45 Jun 10 11:29:52.428996 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.428954 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1feb060a-0985-4cab-99a9-87014f3ab2e9" path="/var/lib/kubelet/pods/1feb060a-0985-4cab-99a9-87014f3ab2e9/volumes" Jun 10 11:29:52.833767 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.833730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"96617214-67ea-4396-8d3a-a18a45711ab2","Type":"ContainerStarted","Data":"7f334690320fc361050a00079fe773953dd8e346dcfbc23fa44cb1656b35316f"} Jun 10 11:29:52.833966 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.833831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"96617214-67ea-4396-8d3a-a18a45711ab2","Type":"ContainerStarted","Data":"3aa152dca75bda43e0ed65f88439da37cefe8cf47fbd28de768914224242ef45"} Jun 10 11:29:52.858267 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:52.858218 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.529718489 podStartE2EDuration="1.858202183s" totalImagesPullingTime="328.483694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:52.855766632 +0000 UTC m=+672.901942638" watchObservedRunningTime="2026-06-10 11:29:52.858202183 +0000 UTC m=+672.904378190" Jun 10 11:29:53.283739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:53.283699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 11:29:53.285628 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:53.285591 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:29:53.783247 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:53.783215 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-wl9zn" Jun 10 11:29:54.284004 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:54.283936 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:29:54.661601 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:54.661505 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:29:55.284239 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:55.284195 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:29:56.284692 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:56.284636 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:29:57.284543 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:57.284495 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:29:58.284646 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:58.284601 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:29:59.283848 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:29:59.283785 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:00.283919 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:00.283862 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:01.284488 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:01.284448 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:02.283250 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:02.283211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 11:30:02.283598 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:02.283558 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:03.284392 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:03.284328 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:04.283689 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:04.283639 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:05.284441 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:05.284395 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 11:30:06.409097 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:06.409053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 11:30:06.427199 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:06.427155 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="96617214-67ea-4396-8d3a-a18a45711ab2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 11:30:16.415604 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:16.415563 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 11:30:18.209449 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:18.209414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:27.128342 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.128261 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74cd8f9864-xqggg"] Jun 10 11:30:27.132037 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.132016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.134664 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.134646 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 11:30:27.142201 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.142177 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74cd8f9864-xqggg"] Jun 10 11:30:27.169039 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.169010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-tls-cert\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.169200 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.169061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cnd\" (UniqueName: \"kubernetes.io/projected/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-kube-api-access-x4cnd\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.169200 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.169113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-oidc-ca\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.269888 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.269850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-oidc-ca\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.270186 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.269915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-tls-cert\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.270186 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.269948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cnd\" (UniqueName: \"kubernetes.io/projected/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-kube-api-access-x4cnd\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.270521 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.270496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-oidc-ca\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.272578 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.272554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-tls-cert\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.278451 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.278429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cnd\" (UniqueName: \"kubernetes.io/projected/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-kube-api-access-x4cnd\") pod \"authorino-74cd8f9864-xqggg\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.441402 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.441312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:30:27.579117 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:27.579090 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74cd8f9864-xqggg"] Jun 10 11:30:27.580585 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:30:27.580559 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd10770e_3229_4cd6_9ae5_19bfcf5cd162.slice/crio-1e23c8b228498e83e3c0a68905c5de5309fbadc4543a9442e8c26d34f3de5af2 WatchSource:0}: Error finding container 1e23c8b228498e83e3c0a68905c5de5309fbadc4543a9442e8c26d34f3de5af2: Status 404 returned error can't find the container with id 1e23c8b228498e83e3c0a68905c5de5309fbadc4543a9442e8c26d34f3de5af2 Jun 10 11:30:28.085779 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.085745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cd8f9864-xqggg" event={"ID":"bd10770e-3229-4cd6-9ae5-19bfcf5cd162","Type":"ContainerStarted","Data":"e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d"} Jun 10 11:30:28.085989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.085793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cd8f9864-xqggg" event={"ID":"bd10770e-3229-4cd6-9ae5-19bfcf5cd162","Type":"ContainerStarted","Data":"1e23c8b228498e83e3c0a68905c5de5309fbadc4543a9442e8c26d34f3de5af2"} Jun 10 11:30:28.109530 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.109471 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74cd8f9864-xqggg" podStartSLOduration=0.713477411 podStartE2EDuration="1.109444027s" totalImagesPullingTime="395.966616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:30:28.104747868 +0000 UTC m=+708.150923886" watchObservedRunningTime="2026-06-10 11:30:28.109444027 +0000 UTC m=+708.155620034" Jun 10 11:30:28.149146 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.149113 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bf7c66f7d-6jc8z"] Jun 10 11:30:28.149532 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.149271 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" podUID="d2c0b340-11c7-4662-87cc-4b1da134573c" containerName="authorino" containerID="cri-o://1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178" gracePeriod=30 Jun 10 11:30:28.427037 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.427006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:30:28.482763 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.482726 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2c0b340-11c7-4662-87cc-4b1da134573c-tls-cert\") pod \"d2c0b340-11c7-4662-87cc-4b1da134573c\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " Jun 10 11:30:28.482951 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.482810 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnb5w\" (UniqueName: \"kubernetes.io/projected/d2c0b340-11c7-4662-87cc-4b1da134573c-kube-api-access-mnb5w\") pod \"d2c0b340-11c7-4662-87cc-4b1da134573c\" (UID: \"d2c0b340-11c7-4662-87cc-4b1da134573c\") " Jun 10 11:30:28.485018 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.484969 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c0b340-11c7-4662-87cc-4b1da134573c-kube-api-access-mnb5w" (OuterVolumeSpecName: "kube-api-access-mnb5w") pod "d2c0b340-11c7-4662-87cc-4b1da134573c" (UID: "d2c0b340-11c7-4662-87cc-4b1da134573c"). InnerVolumeSpecName "kube-api-access-mnb5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:30:28.493276 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.493248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c0b340-11c7-4662-87cc-4b1da134573c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d2c0b340-11c7-4662-87cc-4b1da134573c" (UID: "d2c0b340-11c7-4662-87cc-4b1da134573c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:30:28.568441 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.568406 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:28.584518 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.584492 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2c0b340-11c7-4662-87cc-4b1da134573c-tls-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:30:28.584518 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.584515 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnb5w\" (UniqueName: \"kubernetes.io/projected/d2c0b340-11c7-4662-87cc-4b1da134573c-kube-api-access-mnb5w\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:30:28.672887 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:28.672845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:29.091623 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.091590 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2c0b340-11c7-4662-87cc-4b1da134573c" containerID="1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178" exitCode=0 Jun 10 11:30:29.091829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.091636 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" Jun 10 11:30:29.091829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.091674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" event={"ID":"d2c0b340-11c7-4662-87cc-4b1da134573c","Type":"ContainerDied","Data":"1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178"} Jun 10 11:30:29.091829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.091718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bf7c66f7d-6jc8z" event={"ID":"d2c0b340-11c7-4662-87cc-4b1da134573c","Type":"ContainerDied","Data":"437c3fdde97ee7f69af9ba5347673f047428e90148cd47f54e0d853e9a8c9acd"} Jun 10 11:30:29.091829 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.091739 2576 scope.go:117] "RemoveContainer" containerID="1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178" Jun 10 11:30:29.100850 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.100834 2576 scope.go:117] "RemoveContainer" containerID="1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178" Jun 10 11:30:29.101185 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:30:29.101168 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178\": container with ID starting with 1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178 not found: ID does not exist" containerID="1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178" Jun 10 11:30:29.101265 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.101198 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178"} err="failed to get container status \"1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178\": rpc error: code = NotFound desc = could not find container \"1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178\": container with ID starting with 1f8472723ecf7c2a5ab55654ae5d133de0345ecf5bab43dd47553c4b1c4e8178 not found: ID does not exist" Jun 10 11:30:29.114743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.114715 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bf7c66f7d-6jc8z"] Jun 10 11:30:29.119017 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:29.118994 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-bf7c66f7d-6jc8z"] Jun 10 11:30:30.433165 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:30.433127 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c0b340-11c7-4662-87cc-4b1da134573c" path="/var/lib/kubelet/pods/d2c0b340-11c7-4662-87cc-4b1da134573c/volumes" Jun 10 11:30:41.553620 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:41.553573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:41.653583 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:41.653543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:45.333213 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:45.333174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:48.872162 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.872119 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf"] Jun 10 11:30:48.872652 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.872467 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0b340-11c7-4662-87cc-4b1da134573c" containerName="authorino" Jun 10 11:30:48.872652 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.872479 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0b340-11c7-4662-87cc-4b1da134573c" containerName="authorino" Jun 10 11:30:48.872652 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.872548 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c0b340-11c7-4662-87cc-4b1da134573c" containerName="authorino" Jun 10 11:30:48.877250 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.877227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:48.880035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.880010 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 11:30:48.881223 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.881202 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 11:30:48.881360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.881202 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 11:30:48.881360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.881250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mx8rm\"" Jun 10 11:30:48.890025 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.889658 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf"] Jun 10 11:30:48.902743 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.902709 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:48.954612 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.954572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:48.954804 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.954639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnq75\" (UniqueName: \"kubernetes.io/projected/083a57e0-8a2c-46d9-a85b-5da26b01e690-kube-api-access-xnq75\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:48.954804 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.954680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:48.954804 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.954756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:48.954804 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.954790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:48.954962 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:48.954812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083a57e0-8a2c-46d9-a85b-5da26b01e690-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056190 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056190 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056436 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083a57e0-8a2c-46d9-a85b-5da26b01e690-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056436 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056436 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnq75\" (UniqueName: \"kubernetes.io/projected/083a57e0-8a2c-46d9-a85b-5da26b01e690-kube-api-access-xnq75\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056603 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056658 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056742 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.056809 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.056789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.058594 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.058571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083a57e0-8a2c-46d9-a85b-5da26b01e690-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.058858 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.058843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083a57e0-8a2c-46d9-a85b-5da26b01e690-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.065280 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.065262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnq75\" (UniqueName: \"kubernetes.io/projected/083a57e0-8a2c-46d9-a85b-5da26b01e690-kube-api-access-xnq75\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf\" (UID: \"083a57e0-8a2c-46d9-a85b-5da26b01e690\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.197459 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.197374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:49.340026 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:49.339997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf"] Jun 10 11:30:49.341553 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:30:49.341528 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a57e0_8a2c_46d9_a85b_5da26b01e690.slice/crio-a1307b630e9aacc0aba759be546d5fe7b70685da6aefadd1983bc08d2ab2bb0f WatchSource:0}: Error finding container a1307b630e9aacc0aba759be546d5fe7b70685da6aefadd1983bc08d2ab2bb0f: Status 404 returned error can't find the container with id a1307b630e9aacc0aba759be546d5fe7b70685da6aefadd1983bc08d2ab2bb0f Jun 10 11:30:50.205289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:50.205252 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" event={"ID":"083a57e0-8a2c-46d9-a85b-5da26b01e690","Type":"ContainerStarted","Data":"a1307b630e9aacc0aba759be546d5fe7b70685da6aefadd1983bc08d2ab2bb0f"} Jun 10 11:30:54.229437 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:54.229352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" event={"ID":"083a57e0-8a2c-46d9-a85b-5da26b01e690","Type":"ContainerStarted","Data":"423955f3eecb2a57701e9a8d97261965a90212eb3695958053e4798109b30cdb"} Jun 10 11:30:54.594137 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:54.594104 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:30:56.249562 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:56.249526 2576 generic.go:356] "Generic (PLEG): container finished" podID="083a57e0-8a2c-46d9-a85b-5da26b01e690" containerID="423955f3eecb2a57701e9a8d97261965a90212eb3695958053e4798109b30cdb" exitCode=0 Jun 10 11:30:56.249935 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:56.249598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" event={"ID":"083a57e0-8a2c-46d9-a85b-5da26b01e690","Type":"ContainerDied","Data":"423955f3eecb2a57701e9a8d97261965a90212eb3695958053e4798109b30cdb"} Jun 10 11:30:58.262939 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:58.262905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" event={"ID":"083a57e0-8a2c-46d9-a85b-5da26b01e690","Type":"ContainerStarted","Data":"dd34ba42c461a0e7d3183456834d9bdea34b60a5ed3ea5db156052db9a03e2d6"} Jun 10 11:30:58.298306 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:58.298253 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" podStartSLOduration=3.317659427 podStartE2EDuration="10.298237862s" totalImagesPullingTime="5.704985529s" totalInitContainerRuntime="1.275592906s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:30:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:30:58.29641581 +0000 UTC m=+738.342591817" watchObservedRunningTime="2026-06-10 11:30:58.298237862 +0000 UTC m=+738.344413869" Jun 10 11:30:59.197915 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:59.197873 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:59.198124 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:59.197935 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:59.210228 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:59.210201 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:30:59.278623 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:30:59.278596 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf" Jun 10 11:31:08.267037 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.267004 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf"] Jun 10 11:31:08.272570 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.272549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.276454 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.276430 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 11:31:08.281544 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.281514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf"] Jun 10 11:31:08.297736 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.297707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:31:08.426077 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.426048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.426260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.426092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.426260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.426120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.426260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.426156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.426260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.426180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccbz\" (UniqueName: \"kubernetes.io/projected/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-kube-api-access-sccbz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.426260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.426208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527057 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.526943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527057 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527057 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sccbz\" (UniqueName: \"kubernetes.io/projected/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-kube-api-access-sccbz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527289 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527407 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527464 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.527550 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.527533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.529477 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.529446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.529589 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.529572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.536933 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.536895 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccbz\" (UniqueName: \"kubernetes.io/projected/16fef37b-5f3b-4a7e-8a7e-0b83890dfd60-kube-api-access-sccbz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tg2jf\" (UID: \"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.584582 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.584534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:08.722334 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:08.722308 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf"] Jun 10 11:31:08.723874 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:31:08.723846 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fef37b_5f3b_4a7e_8a7e_0b83890dfd60.slice/crio-4d06e110d1d87d96e1556030396ba5c0a6bb6e2f13012b7aeaac07c8344a6ab6 WatchSource:0}: Error finding container 4d06e110d1d87d96e1556030396ba5c0a6bb6e2f13012b7aeaac07c8344a6ab6: Status 404 returned error can't find the container with id 4d06e110d1d87d96e1556030396ba5c0a6bb6e2f13012b7aeaac07c8344a6ab6 Jun 10 11:31:09.327965 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:09.327929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" event={"ID":"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60","Type":"ContainerStarted","Data":"1c67a08ffc1a095d3d4d71b5afe881d0b302b60fb4f1c1cf5d008e72915d59fa"} Jun 10 11:31:09.328362 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:09.328002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" event={"ID":"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60","Type":"ContainerStarted","Data":"4d06e110d1d87d96e1556030396ba5c0a6bb6e2f13012b7aeaac07c8344a6ab6"} Jun 10 11:31:10.334865 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:10.334830 2576 generic.go:356] "Generic (PLEG): container finished" podID="16fef37b-5f3b-4a7e-8a7e-0b83890dfd60" containerID="1c67a08ffc1a095d3d4d71b5afe881d0b302b60fb4f1c1cf5d008e72915d59fa" exitCode=0 Jun 10 11:31:10.335261 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:10.334910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" event={"ID":"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60","Type":"ContainerDied","Data":"1c67a08ffc1a095d3d4d71b5afe881d0b302b60fb4f1c1cf5d008e72915d59fa"} Jun 10 11:31:11.342429 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:11.342387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" event={"ID":"16fef37b-5f3b-4a7e-8a7e-0b83890dfd60","Type":"ContainerStarted","Data":"a883256a324f80a707e0bb12d44fb53cf81fde3280f3df1b1defb8137887ccfb"} Jun 10 11:31:11.368297 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:11.368243 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" podStartSLOduration=1.963406832 podStartE2EDuration="3.368228935s" totalImagesPullingTime="219.31831ms" totalInitContainerRuntime="1.185503793s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:31:11.365827685 +0000 UTC m=+751.412003694" watchObservedRunningTime="2026-06-10 11:31:11.368228935 +0000 UTC m=+751.414404992" Jun 10 11:31:18.585422 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:18.585382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:18.585793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:18.585462 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:18.603754 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:18.603722 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:19.396220 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:19.396060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tg2jf" Jun 10 11:31:21.472621 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:21.472589 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:31:21.571373 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:21.571339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:31:24.398040 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.398001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59"] Jun 10 11:31:24.410954 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.410918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:31:24.412875 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.412853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.413224 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.413199 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59"] Jun 10 11:31:24.415736 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.415713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 11:31:24.467044 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.467009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b419b648-900e-42df-bb20-4e5e4f207616-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.467216 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.467071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.467216 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.467123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.467216 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.467139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.467216 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.467154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.467216 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.467170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkzfk\" (UniqueName: \"kubernetes.io/projected/b419b648-900e-42df-bb20-4e5e4f207616-kube-api-access-pkzfk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568222 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568222 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568415 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568415 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkzfk\" (UniqueName: \"kubernetes.io/projected/b419b648-900e-42df-bb20-4e5e4f207616-kube-api-access-pkzfk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568508 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b419b648-900e-42df-bb20-4e5e4f207616-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568508 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568654 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568698 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.568841 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.568824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.570599 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.570572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b419b648-900e-42df-bb20-4e5e4f207616-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.571029 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.571007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b419b648-900e-42df-bb20-4e5e4f207616-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.578139 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.578115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkzfk\" (UniqueName: \"kubernetes.io/projected/b419b648-900e-42df-bb20-4e5e4f207616-kube-api-access-pkzfk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59\" (UID: \"b419b648-900e-42df-bb20-4e5e4f207616\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.724085 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.724003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:24.925634 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:24.925603 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59"] Jun 10 11:31:24.926832 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:31:24.926801 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb419b648_900e_42df_bb20_4e5e4f207616.slice/crio-3e49a1592b243f42f8f40ce95a044661fca18e59c23f262bdab934f2de8bb430 WatchSource:0}: Error finding container 3e49a1592b243f42f8f40ce95a044661fca18e59c23f262bdab934f2de8bb430: Status 404 returned error can't find the container with id 3e49a1592b243f42f8f40ce95a044661fca18e59c23f262bdab934f2de8bb430 Jun 10 11:31:25.426424 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:25.426389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" event={"ID":"b419b648-900e-42df-bb20-4e5e4f207616","Type":"ContainerStarted","Data":"de69a6da51501c558b5b765c4714d3956045910c2c81747d6a5052bf7dc18bd4"} Jun 10 11:31:25.426819 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:25.426449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" event={"ID":"b419b648-900e-42df-bb20-4e5e4f207616","Type":"ContainerStarted","Data":"3e49a1592b243f42f8f40ce95a044661fca18e59c23f262bdab934f2de8bb430"} Jun 10 11:31:26.432458 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:26.432427 2576 generic.go:356] "Generic (PLEG): container finished" podID="b419b648-900e-42df-bb20-4e5e4f207616" containerID="de69a6da51501c558b5b765c4714d3956045910c2c81747d6a5052bf7dc18bd4" exitCode=0 Jun 10 11:31:26.432807 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:26.432459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" event={"ID":"b419b648-900e-42df-bb20-4e5e4f207616","Type":"ContainerDied","Data":"de69a6da51501c558b5b765c4714d3956045910c2c81747d6a5052bf7dc18bd4"} Jun 10 11:31:27.445309 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:27.445272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" event={"ID":"b419b648-900e-42df-bb20-4e5e4f207616","Type":"ContainerStarted","Data":"19a574b77c39d874f2f628f7a86b2243dfe54319b16f37b755a0d9c84bb9d058"} Jun 10 11:31:27.469036 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:27.468988 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" podStartSLOduration=1.896142837 podStartE2EDuration="3.468960073s" totalImagesPullingTime="231.003926ms" totalInitContainerRuntime="1.34181331s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:31:27.467847137 +0000 UTC m=+767.514023147" watchObservedRunningTime="2026-06-10 11:31:27.468960073 +0000 UTC m=+767.515136123" Jun 10 11:31:31.712137 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:31.712095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:31:34.725129 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:34.725096 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:34.725512 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:34.725154 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:34.736999 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:34.736951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:31:35.497330 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:31:35.497297 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59" Jun 10 11:32:00.022206 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:00.022088 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:32:04.290398 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:04.290349 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:32:59.853814 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:59.853774 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-867fcb84bf-5z874"] Jun 10 11:32:59.857238 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:59.857219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:32:59.864494 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:59.864465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867fcb84bf-5z874"] Jun 10 11:32:59.979042 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:59.979006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-tls-cert\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:32:59.979042 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:59.979051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-oidc-ca\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:32:59.979296 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:32:59.979178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jpt\" (UniqueName: \"kubernetes.io/projected/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-kube-api-access-57jpt\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.080577 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.080543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-tls-cert\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.080577 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.080582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-oidc-ca\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.080836 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.080627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57jpt\" (UniqueName: \"kubernetes.io/projected/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-kube-api-access-57jpt\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.081382 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.081355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-oidc-ca\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.083041 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.083022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-tls-cert\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.089405 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.089384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jpt\" (UniqueName: \"kubernetes.io/projected/8286cb3e-9a4c-4c7c-8872-dd25dc4ea083-kube-api-access-57jpt\") pod \"authorino-867fcb84bf-5z874\" (UID: \"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083\") " pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.167495 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.167407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867fcb84bf-5z874" Jun 10 11:33:00.309907 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.309869 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867fcb84bf-5z874"] Jun 10 11:33:00.310906 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:33:00.310874 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8286cb3e_9a4c_4c7c_8872_dd25dc4ea083.slice/crio-a99fd3cda1ba27b9b288e7614de9b91577ce7f32b8646a9794a7d6b9bc97339e WatchSource:0}: Error finding container a99fd3cda1ba27b9b288e7614de9b91577ce7f32b8646a9794a7d6b9bc97339e: Status 404 returned error can't find the container with id a99fd3cda1ba27b9b288e7614de9b91577ce7f32b8646a9794a7d6b9bc97339e Jun 10 11:33:00.441997 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.441889 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:33:00.541685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.541651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:33:00.953616 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.953390 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867fcb84bf-5z874" event={"ID":"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083","Type":"ContainerStarted","Data":"7fcbd1d7ed0f9ed109084c235e91dfe20f471dee6fd700c5ecc0956af81b3cb6"} Jun 10 11:33:00.953616 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.953452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867fcb84bf-5z874" event={"ID":"8286cb3e-9a4c-4c7c-8872-dd25dc4ea083","Type":"ContainerStarted","Data":"a99fd3cda1ba27b9b288e7614de9b91577ce7f32b8646a9794a7d6b9bc97339e"} Jun 10 11:33:00.972659 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:00.972600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-867fcb84bf-5z874" podStartSLOduration=1.6055818880000001 podStartE2EDuration="1.972580124s" totalImagesPullingTime="366.998236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:33:00.972044891 +0000 UTC m=+861.018220901" watchObservedRunningTime="2026-06-10 11:33:00.972580124 +0000 UTC m=+861.018756132" Jun 10 11:33:01.007313 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.007283 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74cd8f9864-xqggg"] Jun 10 11:33:01.007699 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.007666 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-74cd8f9864-xqggg" podUID="bd10770e-3229-4cd6-9ae5-19bfcf5cd162" containerName="authorino" containerID="cri-o://e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d" gracePeriod=30 Jun 10 11:33:01.258305 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.258280 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:33:01.394615 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.394579 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4cnd\" (UniqueName: \"kubernetes.io/projected/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-kube-api-access-x4cnd\") pod \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " Jun 10 11:33:01.394615 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.394622 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-oidc-ca\") pod \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " Jun 10 11:33:01.394872 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.394646 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-tls-cert\") pod \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\" (UID: \"bd10770e-3229-4cd6-9ae5-19bfcf5cd162\") " Jun 10 11:33:01.396904 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.396868 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-kube-api-access-x4cnd" (OuterVolumeSpecName: "kube-api-access-x4cnd") pod "bd10770e-3229-4cd6-9ae5-19bfcf5cd162" (UID: "bd10770e-3229-4cd6-9ae5-19bfcf5cd162"). InnerVolumeSpecName "kube-api-access-x4cnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:33:01.399891 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.399863 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "bd10770e-3229-4cd6-9ae5-19bfcf5cd162" (UID: "bd10770e-3229-4cd6-9ae5-19bfcf5cd162"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:33:01.405076 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.405047 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bd10770e-3229-4cd6-9ae5-19bfcf5cd162" (UID: "bd10770e-3229-4cd6-9ae5-19bfcf5cd162"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:33:01.496088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.496002 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4cnd\" (UniqueName: \"kubernetes.io/projected/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-kube-api-access-x4cnd\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:33:01.496088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.496036 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-oidc-ca\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:33:01.496088 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.496047 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd10770e-3229-4cd6-9ae5-19bfcf5cd162-tls-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:33:01.644457 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.644412 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:33:01.747536 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.747440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:33:01.959993 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.959946 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd10770e-3229-4cd6-9ae5-19bfcf5cd162" containerID="e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d" exitCode=0 Jun 10 11:33:01.960482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.960019 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cd8f9864-xqggg" Jun 10 11:33:01.960482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.960028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cd8f9864-xqggg" event={"ID":"bd10770e-3229-4cd6-9ae5-19bfcf5cd162","Type":"ContainerDied","Data":"e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d"} Jun 10 11:33:01.960482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.960061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cd8f9864-xqggg" event={"ID":"bd10770e-3229-4cd6-9ae5-19bfcf5cd162","Type":"ContainerDied","Data":"1e23c8b228498e83e3c0a68905c5de5309fbadc4543a9442e8c26d34f3de5af2"} Jun 10 11:33:01.960482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.960085 2576 scope.go:117] "RemoveContainer" containerID="e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d" Jun 10 11:33:01.970251 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.970233 2576 scope.go:117] "RemoveContainer" containerID="e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d" Jun 10 11:33:01.970544 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:33:01.970524 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d\": container with ID starting with e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d not found: ID does not exist" containerID="e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d" Jun 10 11:33:01.970609 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.970555 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d"} err="failed to get container status \"e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d\": rpc error: code = NotFound desc = could not find container \"e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d\": container with ID starting with e643b525a9cc4d8c29755bf0eefb3c25e9f2fd1cffcd69ff27227fd531d6f24d not found: ID does not exist" Jun 10 11:33:01.988509 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.988476 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74cd8f9864-xqggg"] Jun 10 11:33:01.991685 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:01.991662 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74cd8f9864-xqggg"] Jun 10 11:33:02.428379 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:02.428346 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd10770e-3229-4cd6-9ae5-19bfcf5cd162" path="/var/lib/kubelet/pods/bd10770e-3229-4cd6-9ae5-19bfcf5cd162/volumes" Jun 10 11:33:40.527381 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:40.527348 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:33:40.533150 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:40.533125 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:33:54.866715 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:33:54.866678 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:34:56.508214 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:56.508132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:34:56.743989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:56.743938 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-ntk8b"] Jun 10 11:34:56.744214 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:56.744170 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" podUID="1825ffb2-462f-46ab-8ee4-deea0013a49f" containerName="manager" containerID="cri-o://57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376" gracePeriod=30 Jun 10 11:34:57.003320 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.003296 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:34:57.023991 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.023907 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert\") pod \"1825ffb2-462f-46ab-8ee4-deea0013a49f\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " Jun 10 11:34:57.023991 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.023942 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8hfj\" (UniqueName: \"kubernetes.io/projected/1825ffb2-462f-46ab-8ee4-deea0013a49f-kube-api-access-m8hfj\") pod \"1825ffb2-462f-46ab-8ee4-deea0013a49f\" (UID: \"1825ffb2-462f-46ab-8ee4-deea0013a49f\") " Jun 10 11:34:57.026178 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.026142 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1825ffb2-462f-46ab-8ee4-deea0013a49f" (UID: "1825ffb2-462f-46ab-8ee4-deea0013a49f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:34:57.026178 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.026146 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1825ffb2-462f-46ab-8ee4-deea0013a49f-kube-api-access-m8hfj" (OuterVolumeSpecName: "kube-api-access-m8hfj") pod "1825ffb2-462f-46ab-8ee4-deea0013a49f" (UID: "1825ffb2-462f-46ab-8ee4-deea0013a49f"). InnerVolumeSpecName "kube-api-access-m8hfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:34:57.124518 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.124483 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1825ffb2-462f-46ab-8ee4-deea0013a49f-webhook-cert\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:34:57.124518 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.124514 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8hfj\" (UniqueName: \"kubernetes.io/projected/1825ffb2-462f-46ab-8ee4-deea0013a49f-kube-api-access-m8hfj\") on node \"ip-10-0-130-135.ec2.internal\" DevicePath \"\"" Jun 10 11:34:57.609487 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.609450 2576 generic.go:356] "Generic (PLEG): container finished" podID="1825ffb2-462f-46ab-8ee4-deea0013a49f" containerID="57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376" exitCode=0 Jun 10 11:34:57.609925 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.609504 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" Jun 10 11:34:57.609925 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.609534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" event={"ID":"1825ffb2-462f-46ab-8ee4-deea0013a49f","Type":"ContainerDied","Data":"57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376"} Jun 10 11:34:57.609925 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.609591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d4cdc5b-ntk8b" event={"ID":"1825ffb2-462f-46ab-8ee4-deea0013a49f","Type":"ContainerDied","Data":"d24eaf523d5109d03d3866484f4a34ce540358974ead836ee974125324c23b1e"} Jun 10 11:34:57.609925 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.609613 2576 scope.go:117] "RemoveContainer" containerID="57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376" Jun 10 11:34:57.619885 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.619867 2576 scope.go:117] "RemoveContainer" containerID="57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376" Jun 10 11:34:57.620226 ip-10-0-130-135 kubenswrapper[2576]: E0610 11:34:57.620206 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376\": container with ID starting with 57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376 not found: ID does not exist" containerID="57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376" Jun 10 11:34:57.620295 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.620237 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376"} err="failed to get container status \"57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376\": rpc error: code = NotFound desc = could not find container \"57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376\": container with ID starting with 57a0bbe47187891fa4fb97bd8d06d9bfa07f6f393e3a89f3961229b196eed376 not found: ID does not exist" Jun 10 11:34:57.634774 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.634736 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-ntk8b"] Jun 10 11:34:57.639260 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:57.639231 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-ntk8b"] Jun 10 11:34:58.428793 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.428747 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1825ffb2-462f-46ab-8ee4-deea0013a49f" path="/var/lib/kubelet/pods/1825ffb2-462f-46ab-8ee4-deea0013a49f/volumes" Jun 10 11:34:58.491362 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.491329 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:34:58.630069 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630022 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-lf7tw"] Jun 10 11:34:58.630467 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630423 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd10770e-3229-4cd6-9ae5-19bfcf5cd162" containerName="authorino" Jun 10 11:34:58.630467 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630434 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd10770e-3229-4cd6-9ae5-19bfcf5cd162" containerName="authorino" Jun 10 11:34:58.630467 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630458 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1825ffb2-462f-46ab-8ee4-deea0013a49f" containerName="manager" Jun 10 11:34:58.630467 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630463 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1825ffb2-462f-46ab-8ee4-deea0013a49f" containerName="manager" Jun 10 11:34:58.630633 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630529 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1825ffb2-462f-46ab-8ee4-deea0013a49f" containerName="manager" Jun 10 11:34:58.630633 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.630542 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd10770e-3229-4cd6-9ae5-19bfcf5cd162" containerName="authorino" Jun 10 11:34:58.635131 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.635112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.636598 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.636575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw6xb\" (UniqueName: \"kubernetes.io/projected/744e823a-504f-4162-8f29-ce34a4a62319-kube-api-access-rw6xb\") pod \"maas-controller-68d4cdc5b-lf7tw\" (UID: \"744e823a-504f-4162-8f29-ce34a4a62319\") " pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.636742 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.636631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/744e823a-504f-4162-8f29-ce34a4a62319-webhook-cert\") pod \"maas-controller-68d4cdc5b-lf7tw\" (UID: \"744e823a-504f-4162-8f29-ce34a4a62319\") " pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.639213 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.639190 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rbt2m\"" Jun 10 11:34:58.639411 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.639233 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 11:34:58.639867 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.639197 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 11:34:58.642810 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.642757 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-lf7tw"] Jun 10 11:34:58.737284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.737173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/744e823a-504f-4162-8f29-ce34a4a62319-webhook-cert\") pod \"maas-controller-68d4cdc5b-lf7tw\" (UID: \"744e823a-504f-4162-8f29-ce34a4a62319\") " pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.737284 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.737268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw6xb\" (UniqueName: \"kubernetes.io/projected/744e823a-504f-4162-8f29-ce34a4a62319-kube-api-access-rw6xb\") pod \"maas-controller-68d4cdc5b-lf7tw\" (UID: \"744e823a-504f-4162-8f29-ce34a4a62319\") " pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.739899 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.739870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/744e823a-504f-4162-8f29-ce34a4a62319-webhook-cert\") pod \"maas-controller-68d4cdc5b-lf7tw\" (UID: \"744e823a-504f-4162-8f29-ce34a4a62319\") " pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.747357 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.747320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw6xb\" (UniqueName: \"kubernetes.io/projected/744e823a-504f-4162-8f29-ce34a4a62319-kube-api-access-rw6xb\") pod \"maas-controller-68d4cdc5b-lf7tw\" (UID: \"744e823a-504f-4162-8f29-ce34a4a62319\") " pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:58.946861 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:58.946806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:59.092304 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:59.092274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d4cdc5b-lf7tw"] Jun 10 11:34:59.093630 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:34:59.093595 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744e823a_504f_4162_8f29_ce34a4a62319.slice/crio-f9db2a98ab7d1757907eb673d468ada9affbda7e32977d0f152a6b47df08ff1e WatchSource:0}: Error finding container f9db2a98ab7d1757907eb673d468ada9affbda7e32977d0f152a6b47df08ff1e: Status 404 returned error can't find the container with id f9db2a98ab7d1757907eb673d468ada9affbda7e32977d0f152a6b47df08ff1e Jun 10 11:34:59.095419 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:59.095401 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:34:59.624626 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:59.624586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" event={"ID":"744e823a-504f-4162-8f29-ce34a4a62319","Type":"ContainerStarted","Data":"a4c7bb9201b9bd13ef492a7732095d6fc6781f3bed0b7e1822034706072d80e4"} Jun 10 11:34:59.624833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:59.624673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" event={"ID":"744e823a-504f-4162-8f29-ce34a4a62319","Type":"ContainerStarted","Data":"f9db2a98ab7d1757907eb673d468ada9affbda7e32977d0f152a6b47df08ff1e"} Jun 10 11:34:59.624833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:59.624703 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:34:59.643999 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:34:59.643924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" podStartSLOduration=1.196707464 podStartE2EDuration="1.643907494s" totalImagesPullingTime="447.20003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:59.642943469 +0000 UTC m=+979.689119487" watchObservedRunningTime="2026-06-10 11:34:59.643907494 +0000 UTC m=+979.690083501" Jun 10 11:35:10.634872 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:35:10.634840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d4cdc5b-lf7tw" Jun 10 11:35:38.307072 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:35:38.307029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:35:38.418559 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:35:38.418522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:35:46.806481 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:35:46.806444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:35:52.866858 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:35:52.866816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:35:52.968509 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:35:52.968457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:21.018675 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:21.018595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:25.040656 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:25.040621 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:25.129811 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:25.129777 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:49.005220 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:49.005186 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:55.297221 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:55.297184 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:55.409851 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:55.409819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:55.498053 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:55.498019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:55.684360 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:55.684267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:55.772848 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:55.772802 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:58.243316 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:58.243281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:36:58.347207 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:36:58.347176 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:12.166593 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:12.166556 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:12.267890 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:12.267854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:12.383228 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:12.383192 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:18.398741 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:18.398701 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:18.460353 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:18.460318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:26.536901 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:26.536860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:26.636635 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:26.636602 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:26.741095 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:26.741060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:26.840066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:26.839951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:43.279870 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:43.279833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:43.383833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:43.383781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:43.491078 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:43.491041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:50.111377 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:50.111296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:37:50.211429 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:37:50.211396 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:10.597147 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:10.597109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:10.702612 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:10.702573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:10.822882 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:10.822845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:16.868985 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:16.868936 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:16.917992 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:16.917947 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:16.989733 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:16.989698 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:17.089095 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:17.089062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:17.231129 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:17.231036 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:23.432169 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:23.432122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:23.533961 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:23.533921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:38:40.567319 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:40.567288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:38:40.577306 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:38:40.577282 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:39:19.225533 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:39:19.225497 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:39:39.025094 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:39:39.025052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:42:55.185600 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:42:55.185526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:43:40.606626 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:43:40.606599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:43:40.615842 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:43:40.615808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:45:16.088960 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:45:16.088924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:46:51.141482 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:46:51.141386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:46:51.190202 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:46:51.190150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:48:40.645327 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:48:40.645294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:48:40.655366 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:48:40.655342 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:50:56.585524 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:50:56.585480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:53:40.683270 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:53:40.683238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:53:40.694246 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:53:40.694224 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:54:08.566550 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:54:08.566518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:54:08.656429 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:54:08.656394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:23.500367 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:23.500331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:23.617244 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:23.617205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:23.737827 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:23.737739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:23.832942 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:23.832909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:27.381198 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:27.381167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:29.875045 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:29.875007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:30.074828 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:30.074796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:30.176083 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:30.175963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:32.167498 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:32.167466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:37.544521 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:37.544482 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:37.615318 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:37.615283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:37.782615 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:37.782573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:37.892367 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:37.892281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:38.016694 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:38.016640 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:38.118032 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:38.117996 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:41.060553 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:41.060525 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:44.122066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:44.122027 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:45.385989 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:45.385943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:45.480018 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:45.479965 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:47.872126 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:47.872085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:53.079396 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:53.079350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:53.179655 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:53.179606 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:56.155106 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:56.155061 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:56.237099 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:56.237064 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:55:59.409250 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:55:59.409221 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-867fcb84bf-5z874_8286cb3e-9a4c-4c7c-8872-dd25dc4ea083/authorino/0.log" Jun 10 11:56:04.499512 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:04.499479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-554b576757-jgrgh_3e9475d4-5d61-4f4c-8956-bea17210eac3/maas-api/0.log" Jun 10 11:56:04.851165 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:04.851132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d4cdc5b-lf7tw_744e823a-504f-4162-8f29-ce34a4a62319/manager/0.log" Jun 10 11:56:04.970410 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:04.970379 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-bzzc6_766766bf-1dc8-4376-9488-9a8e46f6e523/server/0.log" Jun 10 11:56:05.087819 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:05.087781 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-j6f9f_44914785-3531-411d-834d-f39b937ba789/manager/0.log" Jun 10 11:56:05.486666 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:05.486640 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-mhh87_91193c3c-a28b-422d-9a32-36fda13d0d5f/copy-manifests/0.log" Jun 10 11:56:05.495371 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:05.495348 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-mhh87_91193c3c-a28b-422d-9a32-36fda13d0d5f/manager/0.log" Jun 10 11:56:06.401859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.401819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz_26fd2ee3-09cc-4718-b18d-1f77fc99585b/pull/0.log" Jun 10 11:56:06.415560 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.415528 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz_26fd2ee3-09cc-4718-b18d-1f77fc99585b/extract/0.log" Jun 10 11:56:06.425932 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.425888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz_26fd2ee3-09cc-4718-b18d-1f77fc99585b/util/0.log" Jun 10 11:56:06.541677 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.541643 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z_fe0b8d4c-a1b6-4646-9937-337e86beac85/pull/0.log" Jun 10 11:56:06.562739 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.562714 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z_fe0b8d4c-a1b6-4646-9937-337e86beac85/extract/0.log" Jun 10 11:56:06.581288 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.581260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z_fe0b8d4c-a1b6-4646-9937-337e86beac85/util/0.log" Jun 10 11:56:06.694061 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.693966 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx_7c98271d-3276-4914-9c63-aff8256aae2e/util/0.log" Jun 10 11:56:06.701267 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.701245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx_7c98271d-3276-4914-9c63-aff8256aae2e/pull/0.log" Jun 10 11:56:06.709760 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.709732 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx_7c98271d-3276-4914-9c63-aff8256aae2e/extract/0.log" Jun 10 11:56:06.827789 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.827760 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg_469705dc-5c80-4315-91b8-9230c30eb241/util/0.log" Jun 10 11:56:06.846230 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.846202 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg_469705dc-5c80-4315-91b8-9230c30eb241/pull/0.log" Jun 10 11:56:06.861149 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.861120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg_469705dc-5c80-4315-91b8-9230c30eb241/extract/0.log" Jun 10 11:56:06.979564 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:06.979475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-867fcb84bf-5z874_8286cb3e-9a4c-4c7c-8872-dd25dc4ea083/authorino/0.log" Jun 10 11:56:07.336029 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:07.336000 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gwxgj_50c72fa1-1327-46f8-87e8-8d1b37f60038/kuadrant-console-plugin/0.log" Jun 10 11:56:08.448803 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:08.448773 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f5c998b9-52svm_d662deb9-2026-46a2-ab24-918965f1d6d7/kube-auth-proxy/0.log" Jun 10 11:56:08.833775 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:08.833743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wl9zn_800a51d9-0307-4455-9508-1a7a62860766/payload-pre-processing/0.log" Jun 10 11:56:09.113778 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.113696 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c986ff4c-bhkkh_b22dbb91-56d1-4bd4-b9a0-32e5f0da154d/router/0.log" Jun 10 11:56:09.467741 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.467667 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf_083a57e0-8a2c-46d9-a85b-5da26b01e690/main/0.log" Jun 10 11:56:09.477119 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.477092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-g9qlf_083a57e0-8a2c-46d9-a85b-5da26b01e690/storage-initializer/0.log" Jun 10 11:56:09.597722 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.597694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-tg2jf_16fef37b-5f3b-4a7e-8a7e-0b83890dfd60/storage-initializer/0.log" Jun 10 11:56:09.613571 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.613547 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-tg2jf_16fef37b-5f3b-4a7e-8a7e-0b83890dfd60/main/0.log" Jun 10 11:56:09.725565 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.725485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59_b419b648-900e-42df-bb20-4e5e4f207616/storage-initializer/0.log" Jun 10 11:56:09.733267 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:09.733245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-rqn59_b419b648-900e-42df-bb20-4e5e4f207616/main/0.log" Jun 10 11:56:13.907405 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:13.907368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:56:14.956428 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:14.956393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024 Jun 10 11:56:17.450120 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:17.450085 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9b28g_6924a2c7-8b35-4d52-8e28-7b8d2b1027ad/global-pull-secret-syncer/0.log" Jun 10 11:56:17.609926 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:17.609894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" Jun 10 11:56:17.730859 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:17.730776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-135.ec2.internal_9708e7c993241cc3ff8212dee587a6f6/haproxy/0.log" Jun 10 11:56:21.267481 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.267429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz_26fd2ee3-09cc-4718-b18d-1f77fc99585b/extract/0.log" Jun 10 11:56:21.302271 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.302240 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz_26fd2ee3-09cc-4718-b18d-1f77fc99585b/util/0.log" Jun 10 11:56:21.326201 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.326106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75949lcz_26fd2ee3-09cc-4718-b18d-1f77fc99585b/pull/0.log" Jun 10 11:56:21.355983 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.355953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z_fe0b8d4c-a1b6-4646-9937-337e86beac85/extract/0.log" Jun 10 11:56:21.429565 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.429540 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z_fe0b8d4c-a1b6-4646-9937-337e86beac85/util/0.log" Jun 10 11:56:21.473880 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.473853 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjk9z_fe0b8d4c-a1b6-4646-9937-337e86beac85/pull/0.log" Jun 10 11:56:21.522788 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.522758 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx_7c98271d-3276-4914-9c63-aff8256aae2e/extract/0.log" Jun 10 11:56:21.565885 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.565856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx_7c98271d-3276-4914-9c63-aff8256aae2e/util/0.log" Jun 10 11:56:21.601240 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.601141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjdgx_7c98271d-3276-4914-9c63-aff8256aae2e/pull/0.log" Jun 10 11:56:21.648018 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.647040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg_469705dc-5c80-4315-91b8-9230c30eb241/extract/0.log" Jun 10 11:56:21.674288 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.674265 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg_469705dc-5c80-4315-91b8-9230c30eb241/util/0.log" Jun 10 11:56:21.702141 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.702115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2jcg_469705dc-5c80-4315-91b8-9230c30eb241/pull/0.log" Jun 10 11:56:21.864643 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:21.864562 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-867fcb84bf-5z874_8286cb3e-9a4c-4c7c-8872-dd25dc4ea083/authorino/0.log" Jun 10 11:56:22.037497 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:22.037469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gwxgj_50c72fa1-1327-46f8-87e8-8d1b37f60038/kuadrant-console-plugin/0.log" Jun 10 11:56:24.254823 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:24.254780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qpj59_e860d108-9d3e-486d-ae20-20edd904f8aa/cluster-monitoring-operator/0.log" Jun 10 11:56:24.563311 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:24.563273 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95xkq_5988075b-709b-4d27-a60c-09296aaca82b/node-exporter/0.log" Jun 10 11:56:24.598560 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:24.598533 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95xkq_5988075b-709b-4d27-a60c-09296aaca82b/kube-rbac-proxy/0.log" Jun 10 11:56:24.628545 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:24.628521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95xkq_5988075b-709b-4d27-a60c-09296aaca82b/init-textfile/0.log" Jun 10 11:56:25.341832 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:25.341803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-vsb69_4d76327c-3e5b-44c4-bded-f0d22fea289a/prometheus-operator-admission-webhook/0.log" Jun 10 11:56:27.895236 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:27.895190 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/1.log" Jun 10 11:56:27.900324 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:27.900306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-twh6x_73725691-5faa-4eea-905c-25449811f5ee/console-operator/2.log" Jun 10 11:56:28.668405 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:28.668359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-2cj7h_ee94c9f0-311f-4fd7-a138-2f02b4a77366/download-server/0.log" Jun 10 11:56:29.519563 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.519535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-knvch_e738674d-7b2c-422b-9ef2-170a4e1098aa/volume-data-source-validator/0.log" Jun 10 11:56:29.651281 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.651242 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns"] Jun 10 11:56:29.655021 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.655001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.659696 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.659674 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dspfd\"/\"openshift-service-ca.crt\"" Jun 10 11:56:29.659862 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.659844 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dspfd\"/\"default-dockercfg-4lqkz\"" Jun 10 11:56:29.661057 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.661028 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dspfd\"/\"kube-root-ca.crt\"" Jun 10 11:56:29.691253 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.691228 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns"] Jun 10 11:56:29.823844 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.823811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-sys\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.823844 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.823850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-podres\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.824160 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.823877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-proc\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.824160 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.823957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnpcg\" (UniqueName: \"kubernetes.io/projected/de12fb65-dcf8-4bae-b24c-7672145a39fc-kube-api-access-cnpcg\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.824160 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.824026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-lib-modules\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.924833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.924800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-sys\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.924842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-podres\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.924880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-proc\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.924910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnpcg\" (UniqueName: \"kubernetes.io/projected/de12fb65-dcf8-4bae-b24c-7672145a39fc-kube-api-access-cnpcg\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.924930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-sys\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.924943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-lib-modules\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.925007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-podres\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925066 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.925027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-proc\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.925333 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.925081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de12fb65-dcf8-4bae-b24c-7672145a39fc-lib-modules\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.939191 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.939165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnpcg\" (UniqueName: \"kubernetes.io/projected/de12fb65-dcf8-4bae-b24c-7672145a39fc-kube-api-access-cnpcg\") pod \"perf-node-gather-daemonset-qrlns\" (UID: \"de12fb65-dcf8-4bae-b24c-7672145a39fc\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:29.964755 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:29.964721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:30.107035 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:30.107011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns"] Jun 10 11:56:30.108508 ip-10-0-130-135 kubenswrapper[2576]: W0610 11:56:30.108483 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde12fb65_dcf8_4bae_b24c_7672145a39fc.slice/crio-e1e9cca4d8d784a0508a9222ae7ad75cb712363b93f4ff8dc150e9ea1cb177a2 WatchSource:0}: Error finding container e1e9cca4d8d784a0508a9222ae7ad75cb712363b93f4ff8dc150e9ea1cb177a2: Status 404 returned error can't find the container with id e1e9cca4d8d784a0508a9222ae7ad75cb712363b93f4ff8dc150e9ea1cb177a2 Jun 10 11:56:30.846427 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:30.846386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" event={"ID":"de12fb65-dcf8-4bae-b24c-7672145a39fc","Type":"ContainerStarted","Data":"10cbe5503170de630f0d58035b2164b123c09239001b747d8ff5a84bcf3e9848"} Jun 10 11:56:30.846820 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:30.846449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" event={"ID":"de12fb65-dcf8-4bae-b24c-7672145a39fc","Type":"ContainerStarted","Data":"e1e9cca4d8d784a0508a9222ae7ad75cb712363b93f4ff8dc150e9ea1cb177a2"} Jun 10 11:56:30.846820 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:30.846603 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:30.884163 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:30.884112 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" podStartSLOduration=1.8840949230000001 podStartE2EDuration="1.884094923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:56:30.883808965 +0000 UTC m=+2270.929984971" watchObservedRunningTime="2026-06-10 11:56:30.884094923 +0000 UTC m=+2270.930270910" Jun 10 11:56:31.080623 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:31.080597 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvw65_3169442e-7553-43a5-a7c7-ba0b446387e9/dns/0.log" Jun 10 11:56:31.116423 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:31.116329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvw65_3169442e-7553-43a5-a7c7-ba0b446387e9/kube-rbac-proxy/0.log" Jun 10 11:56:31.153316 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:31.153287 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mr8cv_9b3aadd6-8821-4d0c-b672-fdc4cb7f87d0/dns-node-resolver/0.log" Jun 10 11:56:32.084268 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:32.084237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kdm2f_2ae2295d-969a-4623-89ca-e20bbaaf0789/node-ca/0.log" Jun 10 11:56:33.583833 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:33.583806 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f5c998b9-52svm_d662deb9-2026-46a2-ab24-918965f1d6d7/kube-auth-proxy/0.log" Jun 10 11:56:33.869854 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:33.869824 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wl9zn_800a51d9-0307-4455-9508-1a7a62860766/payload-pre-processing/0.log" Jun 10 11:56:34.007428 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:34.007392 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c986ff4c-bhkkh_b22dbb91-56d1-4bd4-b9a0-32e5f0da154d/router/0.log" Jun 10 11:56:34.923850 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:34.923814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z8gml_185d1f9f-ac63-4718-ac53-05e983fdd906/serve-healthcheck-canary/0.log" Jun 10 11:56:35.646820 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:35.646787 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-6jznh_edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b/insights-operator/0.log" Jun 10 11:56:35.647091 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:35.647076 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-6jznh_edc9ee7d-bd2c-4e82-9f3d-0276cdc4ec2b/insights-operator/1.log" Jun 10 11:56:35.698390 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:35.698360 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6zk8_e183c53a-1f89-4bdc-b1ff-38bc336bb94c/kube-rbac-proxy/0.log" Jun 10 11:56:35.745599 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:35.745570 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6zk8_e183c53a-1f89-4bdc-b1ff-38bc336bb94c/exporter/0.log" Jun 10 11:56:35.836679 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:35.836647 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6zk8_e183c53a-1f89-4bdc-b1ff-38bc336bb94c/extractor/0.log" Jun 10 11:56:36.862031 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:36.861969 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-qrlns" Jun 10 11:56:39.210080 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:39.210051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-554b576757-jgrgh_3e9475d4-5d61-4f4c-8956-bea17210eac3/maas-api/0.log" Jun 10 11:56:39.355159 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:39.355124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d4cdc5b-lf7tw_744e823a-504f-4162-8f29-ce34a4a62319/manager/0.log" Jun 10 11:56:39.393534 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:39.393501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-bzzc6_766766bf-1dc8-4376-9488-9a8e46f6e523/server/0.log" Jun 10 11:56:39.450398 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:39.450371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-j6f9f_44914785-3531-411d-834d-f39b937ba789/manager/0.log" Jun 10 11:56:39.723314 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:39.723283 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-mhh87_91193c3c-a28b-422d-9a32-36fda13d0d5f/manager/0.log" Jun 10 11:56:39.744917 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:39.744893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-mhh87_91193c3c-a28b-422d-9a32-36fda13d0d5f/copy-manifests/0.log" Jun 10 11:56:41.477271 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:41.477238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7665f65bcf-fbgqw_994c04ad-051c-44ef-a1de-fd3ab0113f46/manager/0.log" Jun 10 11:56:42.373132 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:42.373098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f5c998b9-52svm_d662deb9-2026-46a2-ab24-918965f1d6d7/kube-auth-proxy/0.log" Jun 10 11:56:42.468999 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:42.468950 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wl9zn_800a51d9-0307-4455-9508-1a7a62860766/payload-pre-processing/0.log" Jun 10 11:56:42.540888 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:42.540855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c986ff4c-bhkkh_b22dbb91-56d1-4bd4-b9a0-32e5f0da154d/router/0.log" Jun 10 11:56:43.752478 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:43.752433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f5c998b9-52svm_d662deb9-2026-46a2-ab24-918965f1d6d7/kube-auth-proxy/0.log" Jun 10 11:56:43.862757 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:43.862725 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wl9zn_800a51d9-0307-4455-9508-1a7a62860766/payload-pre-processing/0.log" Jun 10 11:56:43.931074 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:43.931046 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c986ff4c-bhkkh_b22dbb91-56d1-4bd4-b9a0-32e5f0da154d/router/0.log" Jun 10 11:56:45.868894 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:45.868858 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f5c998b9-52svm_d662deb9-2026-46a2-ab24-918965f1d6d7/kube-auth-proxy/0.log" Jun 10 11:56:45.959879 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:45.959842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wl9zn_800a51d9-0307-4455-9508-1a7a62860766/payload-pre-processing/0.log" Jun 10 11:56:46.025404 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:46.025369 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c986ff4c-bhkkh_b22dbb91-56d1-4bd4-b9a0-32e5f0da154d/router/0.log" Jun 10 11:56:46.741232 ip-10-0-130-135 kubenswrapper[2576]: I0610 11:56:46.741194 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcsvl_ea57aa3e-0103-4bfc-b730-35ae58e9f849/konnectivity-agent/0.log" limit=1024